00000100:00100000:0.0:1746144643.312916:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746133376 00000100:00100000:0.0:1746144643.312927:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10551 00000100:00100000:0.0:1746144643.312932:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746132992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144643.312942:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144643.312953:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d02a expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.312969:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.312971:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.312978:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d02a expref: 27 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144643.312990:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d02a expref: 27 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144643.312998:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135787e00, rc 0) 00000100:00100000:0.0:1746144643.313631:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746132992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 697us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144643.313637:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10551 00000100:00100000:0.0:1746144643.313648:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10554 00000100:00100000:0.0:1746144643.313652:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746133376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144643.313658:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144643.313664:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e01737c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d03f expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.313677:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e01737c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d03f expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144643.313688:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e01737c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d03f expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144643.313696:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135787600, rc 0) 00000100:00100000:0.0:1746144643.314017:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746133376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 362us (1210us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144643.314022:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10554 00000100:00100000:0.0:1746144643.317629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144643.320040:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144643.326520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.326563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.326793:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3776 00000100:00100000:0.0:1746144643.326799:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746134272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144643.335959:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1830964747277056:0@lo:400:kworker.0 00000100:00100000:0.0:1746144643.336103:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144643.336852:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746144643.336857:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747277440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144643.336877:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144643.337371:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746134272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10572us (10806us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144643.337377:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3776 00002000:00100000:0.0:1746144643.337382:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880093ee5880 x1830964746134272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:284/0 lens 488/440 e 0 to 0 dl 1746144654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144643.337395:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5880 with x1830964746134272 ext(1048576->2097151) 00002000:00010000:0.0:1746144643.337399:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5880 00000100:00100000:0.0:1746144643.337435:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747277440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144643.337443:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1830964747277056:0@lo:400:kworker.0 00000100:00100000:0.0:1746144643.343020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.343075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.347203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.347244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.347394:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10558 00000100:00100000:0.0:1746144643.347402:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:28463:x1830964746134912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144643.347419:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144643.347428:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135786400/0xa7c849b16e017398 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d05b expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.347443:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec5e000/0xa7c849b16e017280 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152cf90 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.347450:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144643.347451:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144643.347454:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135786400/0xa7c849b16e017398 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d05b expref: 34 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.347471:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec5e000/0xa7c849b16e017280 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cf90 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.347484:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ec5e000/0xa7c849b16e017280 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cf90 expref: 34 pid: 8453 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746144643.347492:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747277824:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144643.347612:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.349291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.350047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.350116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.350149:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746135424 00000100:00100000:0.0:1746144643.350153:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746135424 00010000:00010000:0.0:1746144643.350168:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e016fe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cde5 expref: 36 pid: 29370 timeout: 722 lvb_type: 0 00000100:00100000:0.0:1746144643.350186:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5160 00000100:00100000:0.0:1746144643.350191:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746135424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144643.350198:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144643.350208:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e016fe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cde5 expref: 36 pid: 29370 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746144643.350217:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e016fe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cde5 expref: 36 pid: 29370 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746144643.350230:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e016fe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cde5 expref: 36 pid: 29370 timeout: 722 lvb_type: 0 00010000:00010000:0.0:1746144643.350246:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.350248:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.350254:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96ac00/0xa7c849b16e017391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d054 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.350263:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96ac00/0xa7c849b16e017391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d054 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.350293:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96ac00/0xa7c849b16e017391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d054 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144643.350305:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747278208:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144643.350348:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.351554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.351646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.354032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.357693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.357714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.357765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.357779:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746136320 00000100:00100000:0.0:1746144643.357782:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746136320 00010000:00010000:0.0:1746144643.357793:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d02a expref: 26 pid: 30345 timeout: 722 lvb_type: 1 00000100:00100000:0.0:1746144643.357911:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5164 00000100:00100000:0.0:1746144643.357916:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746136320:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144643.357924:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144643.357931:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d02a expref: 26 pid: 30345 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746144643.357937:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d02a expref: 26 pid: 30345 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746144643.357983:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135787e00/0xa7c849b16e017367 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d02a expref: 26 pid: 30345 timeout: 722 lvb_type: 1 00010000:00010000:0.0:1746144643.357998:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.358000:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.358005:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96b400/0xa7c849b16e01739f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d062 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.358011:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96b400/0xa7c849b16e01739f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d062 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.358034:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96b400/0xa7c849b16e01739f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d062 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144643.358043:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747278848:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144643.358088:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.359076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.359105:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.359163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.359180:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746136576 00000100:00100000:0.0:1746144643.359184:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746136576 00002000:00100000:0.0:1746144643.359208:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fb11c00 x1830964746136576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:284/0 lens 488/0 e 0 to 0 dl 1746144654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144643.359218:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb11c00 with x1830964746136576 ext(2097152->3145727) 00002000:00010000:0.0:1746144643.359222:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb11c00 00000100:00100000:0.0:1746144643.359233:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746137088 00000100:00100000:0.0:1746144643.359235:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746137088 00002000:00100000:0.0:1746144643.359244:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2281472->3145727) req@ffff88009fb12300 x1830964746137088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:284/0 lens 488/0 e 0 to 0 dl 1746144654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144643.359251:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830964746137088 ext(2281472->3145727) 00002000:00010000:0.0:1746144643.359255:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12300 00000100:00100000:0.0:1746144643.359263:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3779 00000100:00100000:0.0:1746144643.359267:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746136832:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144643.359311:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3780 00000100:00100000:0.0:1746144643.359315:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746137088:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144643.360722:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb11880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747278848:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144643.360739:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144643.360759:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746136320:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2843us (2992us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144643.360768:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5164 00000100:00100000:0.0:1746144643.369193:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746137088:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9866us (10020us total) trans 0 rc 864256/864256 00000100:00100000:0.0:1746144643.369314:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3780 00002000:00100000:0.0:1746144643.369323:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2281472->3145727) req@ffff88009fb12300 x1830964746137088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:284/0 lens 488/440 e 0 to 0 dl 1746144654 ref 1 fl Complete:/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144643.369332:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb12300 with x1830964746137088 ext(2281472->3145727) 00002000:00010000:0.0:1746144643.369337:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb12300 00000100:00100000:0.0:1746144643.372091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.376390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.381741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.392563:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.392600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.392641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.392669:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746138240 00000100:00100000:0.0:1746144643.392677:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746138240 00000100:00100000:0.0:1746144643.392712:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746138496 00000100:00100000:0.0:1746144643.392714:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746138496 00000100:00100000:0.0:1746144643.392723:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746138112 00000100:00100000:0.0:1746144643.392725:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746138112 00000100:00100000:0.0:1746144643.392752:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10561 00000100:00100000:0.0:1746144643.392760:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746138240:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144643.392784:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144643.392804:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f14e400/0xa7c849b16e0173ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d077 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144643.392857:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747278976:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144643.392932:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.393010:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10563 00000100:00100000:0.0:1746144643.393015:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746138112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144643.393022:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144643.393032:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f14ea00/0xa7c849b16e0173bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d070 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144643.393054:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747279104:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144643.393072:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.395436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144643.399065:0:30345:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144643 -> 1746144644 00002000:00010000:0.0:1746144643.399074:0:30345:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144643 -> 1746144644 00002000:00010000:0.0:1746144643.399076:0:30345:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144643 -> 1746144644 00000100:00100000:0.0:1746144643.399102:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747278976:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144643.399151:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f14e400/0xa7c849b16e0173ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d077 expref: 27 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144643.399167:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f14e400/0xa7c849b16e0173ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d077 expref: 27 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144643.399182:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14e400, rc 0) 00000100:00100000:0.0:1746144643.399257:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e905050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746138240:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6496us (6703us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144643.399266:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10561 00000100:00100000:0.0:1746144643.402909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.402974:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.403905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.405155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.410925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.415930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.432994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.433038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.433080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.438769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.438813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.438859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.498055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.502573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.507541:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.511808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.511850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.512870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.518487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.533336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.535004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.539390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.539435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.539448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.540532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.541046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.542552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.542583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.542609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.542663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.547053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.557041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.576745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.585600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.604111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.608099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.615581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.626579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.631807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.650316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.668836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.671272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.673485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.674737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.674800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.680038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.680916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.685298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.686548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.694713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.700643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.701771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.705231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.719934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.719996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.723333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.736845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.737710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.753787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.760905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.770630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.778024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.778082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.778717:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3796 00000100:00100000:0.0:1746144643.778724:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746150784:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144643.801629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.805548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.826655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.834022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.842780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.850489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.850524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.850557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.850585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.850612:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746151936 00000100:00100000:0.0:1746144643.850624:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746151936 00010000:00010000:0.0:1746144643.850661:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96b600/0xa7c849b16e0173a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d069 expref: 31 pid: 4758 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.850688:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746152064 00000100:00100000:0.0:1746144643.850691:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746152064 00010000:00010000:0.0:1746144643.850700:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800939e9600/0xa7c849b16e0174b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d12d expref: 24 pid: 29370 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.850710:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746152192 00000100:00100000:0.0:1746144643.850712:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746152192 00010000:00010000:0.0:1746144643.850717:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b12a00/0xa7c849b16e0174e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d165 expref: 32 pid: 8450 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.850724:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746152320 00000100:00100000:0.0:1746144643.850725:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746152320 00010000:00010000:0.0:1746144643.850731:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf71200/0xa7c849b16e017295 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cfa5 expref: 25 pid: 8453 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.850740:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5181 00000100:00100000:0.0:1746144643.850745:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746151936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144643.850758:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144643.850780:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96b600/0xa7c849b16e0173a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d069 expref: 32 pid: 4758 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850789:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96b600/0xa7c849b16e0173a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d069 expref: 32 pid: 4758 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850811:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96b600/0xa7c849b16e0173a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d069 expref: 32 pid: 4758 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850833:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144643.850875:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746151936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 129us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144643.850882:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5181 00000100:00100000:0.0:1746144643.850898:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5182 00000100:00100000:0.0:1746144643.850902:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746152064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144643.850909:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144643.850916:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800939e9600/0xa7c849b16e0174b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d12d expref: 25 pid: 29370 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850924:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800939e9600/0xa7c849b16e0174b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d12d expref: 25 pid: 29370 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850936:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144643.850950:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746152064:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144643.850955:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5182 00000100:00100000:0.0:1746144643.850964:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5183 00000100:00100000:0.0:1746144643.850968:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746152192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144643.850974:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144643.850980:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b12a00/0xa7c849b16e0174e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d165 expref: 30 pid: 8450 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850987:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b12a00/0xa7c849b16e0174e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d165 expref: 30 pid: 8450 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.850995:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144643.851007:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746152192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144643.851011:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5183 00000100:00100000:0.0:1746144643.851018:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5184 00000100:00100000:0.0:1746144643.851022:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746152320:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144643.851028:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144643.851033:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cf71200/0xa7c849b16e017295 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cfa5 expref: 24 pid: 8453 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.851041:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cf71200/0xa7c849b16e017295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cfa5 expref: 24 pid: 8453 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.851050:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.851052:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144643.851060:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.851068:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.851099:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144643.851111:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747284608:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144643.851203:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.853741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.858580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.861069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.877616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.884848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.884882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.884918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.889214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.898430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.932814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.935826:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.939910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.944465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.944498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.944818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.944943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.946044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.960085:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746155520 00000100:00100000:0.0:1746144643.960092:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746155520 00000100:00100000:0.0:1746144643.960161:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9823 00000100:00100000:0.0:1746144643.960168:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:28492:x1830964746155520:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144643.960185:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144643.960199:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e017566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d1b2 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.960271:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01756d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144643.960283:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e9600/0xa7c849b16e017535 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d181 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.960289:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01756d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144643.960312:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e9600/0xa7c849b16e017535 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d181 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.960322:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800939e9600/0xa7c849b16e017535 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d181 expref: 12 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.960332:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747285760:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144643.960407:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.963226:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747285760:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144643.963244:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01756d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144643.968975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.972460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.979309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.979345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.979373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.981661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.981687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.981716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.982372:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10607 00000100:00100000:0.0:1746144643.982378:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746156800:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:0.0:1746144643.982392:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.982412:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.982417:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144643.982418:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144643.982420:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.982433:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144643.982443:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 20 pid: 8450 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.982450:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747287296:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144643.982466:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144643.987448:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.987481:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.988458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.993904:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747287296:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144643.993919:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144643.993966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.993984:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.994012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144643.994021:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746158336 00000100:00100000:0.0:1746144643.994024:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746158336 00010000:00010000:0.0:1746144643.994035:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f5a00/0xa7c849b16e0174be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d13b expref: 38 pid: 29370 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144643.994060:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746158208 00000100:00100000:0.0:1746144643.994062:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746158208 00002000:00100000:0.0:1746144643.994080:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3235840->3514367) req@ffff88012fecc380 x1830964746158208/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:284/0 lens 488/0 e 0 to 0 dl 1746144654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144643.994094:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fecc380 with x1830964746158208 ext(3235840->3514367) 00010000:00010000:0.0:1746144643.994099:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 21 pid: 8450 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.994107:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b12600/0xa7c849b16e017512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3235840->3514367) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d173 expref: 21 pid: 8450 timeout: 723 lvb_type: 0 00002000:00010000:0.0:1746144643.994111:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fecc380 00000100:00100000:0.0:1746144643.994146:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746157952 00000100:00100000:0.0:1746144643.994148:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746157952 00002000:00100000:0.0:1746144643.994157:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3362816->3923967) req@ffff88012fecc700 x1830964746157952/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:284/0 lens 488/0 e 0 to 0 dl 1746144654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144643.994163:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fecc700 with x1830964746157952 ext(3362816->3923967) 00010000:00010000:0.0:1746144643.994167:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b13400/0xa7c849b16e017519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d17a expref: 38 pid: 8450 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144643.995359:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b13400/0xa7c849b16e017519 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d17a expref: 37 pid: 8450 timeout: 723 lvb_type: 0 00002000:00010000:0.0:1746144643.995365:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fecc700 00000100:00100000:0.0:1746144643.995386:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 701 00000100:00100000:0.0:1746144643.995392:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1962:x1830964746157952:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144644.006631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144644.008122:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008130:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008346:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008353:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008359:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008365:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144644.008368:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008375:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008384:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.008388:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864200/0xa7c849b16e0175ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144644.008444:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e904c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746156800:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 26066us (26726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.008451:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10607 00000100:00080000:0.0:1746144644.008809:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144644.011227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.016307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.016973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.018193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.018757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.018771:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746159104 00000100:00100000:0.0:1746144644.018776:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746159104 00010000:00010000:0.0:1746144644.018793:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4078c00/0xa7c849b16e016f54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cdb4 expref: 35 pid: 15388 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.019049:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746159360 00000100:00100000:0.0:1746144644.019052:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746159360 00010000:00010000:0.0:1746144644.019062:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009447de00/0xa7c849b16e016e90 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cd05 expref: 36 pid: 14710 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.019374:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.019383:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746159488 00000100:00100000:0.0:1746144644.019386:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746159488 00010000:00010000:0.0:1746144644.019394:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3c4600/0xa7c849b16e016e97 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cd0c expref: 33 pid: 14709 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.019421:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5207 00000100:00100000:0.0:1746144644.019426:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746159488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.019431:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.019434:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3c4600/0xa7c849b16e016e97 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cd0c expref: 33 pid: 14709 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.019441:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3c4600/0xa7c849b16e016e97 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cd0c expref: 33 pid: 14709 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.019455:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3c4600/0xa7c849b16e016e97 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152cd0c expref: 33 pid: 14709 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.019466:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.019468:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092981000/0xa7c849b16e0175c1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.019474:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092981000/0xa7c849b16e0175c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.019480:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092981000/0xa7c849b16e0175c1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.019493:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.019506:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746159488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.019511:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5207 00000001:00080000:0.0:1746144644.042800:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943641 is committed 00000001:00080000:0.0:1746144644.042815:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943619 is committed 00000001:00080000:0.0:1746144644.042819:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943656 is committed 00000004:00080000:0.0:1746144644.042823:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:0.0:1746144644.042828:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1922 committed 00000004:00080000:0.0:1746144644.042833:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1921 committed 00000004:00080000:0.0:1746144644.042835:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1920 committed 00000004:00080000:0.0:1746144644.042836:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1919 committed 00000004:00080000:0.0:1746144644.042837:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000004:00080000:0.0:1746144644.042839:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1918 committed 00000004:00080000:0.0:1746144644.042840:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000004:00080000:0.0:1746144644.042841:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1917 committed 00000004:00080000:0.0:1746144644.042844:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:0.0:1746144644.042845:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000004:00080000:0.0:1746144644.042847:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1860 committed 00000004:00080000:0.0:1746144644.042848:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1916 committed 00000004:00080000:0.0:1746144644.042850:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1915 committed 00000004:00080000:0.0:1746144644.042851:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1859 committed 00000004:00080000:0.0:1746144644.042853:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1858 committed 00000004:00080000:0.0:1746144644.042854:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1914 committed 00000001:00080000:0.0:1746144644.042862:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943649 is committed 00000001:00080000:0.0:1746144644.042873:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943629 is committed 00000001:00080000:0.0:1746144644.042883:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943652 is committed 00000001:00080000:0.0:1746144644.042891:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943640 is committed 00000001:00080000:0.0:1746144644.042898:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943653 is committed 00000100:00100000:0.0:1746144644.043022:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043070:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.043090:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043103:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.043115:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144644.043119:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.043157:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043170:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.043188:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747288064 00000100:00100000:0.0:1746144644.043194:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747288064 00000100:00100000:0.0:1746144644.043218:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747288576 00000100:00100000:0.0:1746144644.043220:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747288576 00000100:00100000:0.0:1746144644.043228:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747288448 00000100:00100000:0.0:1746144644.043229:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747288448 00000100:00100000:0.0:1746144644.043237:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747288960 00000100:00100000:0.0:1746144644.043239:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747288960 00000100:00100000:0.0:1746144644.043249:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10608 00000100:00100000:0.0:1746144644.043254:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830964747288064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043419:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830964747288064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (348us total) trans 17179873000 rc 0/0 00000100:00100000:0.0:1746144644.043425:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10608 00000100:00100000:0.0:1746144644.043435:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10609 00000100:00100000:0.0:1746144644.043440:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012feced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830964747288576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043508:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012feced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830964747288576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (404us total) trans 17179873001 rc 0/0 00000100:00100000:0.0:1746144644.043513:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10609 00000100:00100000:0.0:1746144644.043521:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10610 00000100:00100000:0.0:1746144644.043525:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830964747288448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043591:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830964747288448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (459us total) trans 17179873002 rc 0/0 00000100:00100000:0.0:1746144644.043596:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10610 00000100:00100000:0.0:1746144644.043604:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10611 00000100:00100000:0.0:1746144644.043608:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830964747288960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043674:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830964747288960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (503us total) trans 17179873003 rc 0/0 00000100:00100000:0.0:1746144644.043680:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10611 00000004:00080000:0.0:1746144644.043709:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fecd880/2, rc 0, transno 17179873002 00000100:00100000:0.0:1746144644.043716:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.043725:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fece680/2, rc 0, transno 17179873003 00000100:00100000:0.0:1746144644.043728:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.043734:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fecca80/2, rc 0, transno 17179873000 00000100:00100000:0.0:1746144644.043737:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.043742:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fecdc00/2, rc 0, transno 17179873001 00000100:00100000:0.0:1746144644.043744:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747288576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.043754:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747288320 00000100:00100000:0.0:1746144644.043756:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747288320 00000100:00100000:0.0:1746144644.043768:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747288832 00000100:00100000:0.0:1746144644.043769:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747288832 00000100:00100000:0.0:1746144644.045579:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747289728 00000100:00100000:0.0:1746144644.045582:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747289728 00000100:00100000:0.0:1746144644.045596:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747289344 00000100:00100000:0.0:1746144644.045598:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747289344 00000100:00100000:0.0:1746144644.045607:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10617 00000100:00100000:0.0:1746144644.045611:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747289728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.045692:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747289728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1240us total) trans 21474840254 rc 0/0 00000100:00100000:0.0:1746144644.045697:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10617 00000100:00100000:0.0:1746144644.045706:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10618 00000100:00100000:0.0:1746144644.045710:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3294:x1830964747289344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.045783:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3294:x1830964747289344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (190us total) trans 21474840255 rc 0/0 00000100:00100000:0.0:1746144644.045787:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10618 00000100:00100000:0.0:1746144644.045821:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747289088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.045837:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.045860:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747289600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.045874:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.045885:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747290112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.045909:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.045928:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747290112 00000100:00100000:0.0:1746144644.045930:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747290112 00000100:00100000:0.0:1746144644.045942:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10620 00000100:00100000:0.0:1746144644.045946:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3296:x1830964747289600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.046875:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3296:x1830964747289600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 929us (999us total) trans 21474840257 rc 0/0 00000100:00100000:0.0:1746144644.046880:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10620 00000004:00080000:0.0:1746144644.046927:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed13800/2, rc 0, transno 21474840256 00000100:00100000:0.0:1746144644.046930:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747289088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.046936:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed11f80/2, rc 0, transno 21474840257 00000100:00100000:0.0:1746144644.046939:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747289600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.046945:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fecf800/2, rc 0, transno 17179873008 00000100:00100000:0.0:1746144644.046948:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747290112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.047039:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed11500/2, rc 0, transno 21474840259 00000100:00100000:0.0:1746144644.047042:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747289472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.047048:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed11c00/2, rc 0, transno 21474840260 00000100:00100000:0.0:1746144644.047050:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747289984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.047861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.051952:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.054202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.056438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.068487:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.069520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.073094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.073955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.073986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.074000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.074181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.074267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.074794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.074806:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746161664 00000100:00100000:0.0:1746144644.074809:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746161664 00000100:00100000:0.0:1746144644.074824:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10629 00000100:00100000:0.0:1746144644.074828:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746161664:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144644.074833:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.074840:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4864200/0xa7c849b16e017631 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d1f8 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144644.074851:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d84, atime: 0x68140d84, ctime: 0x68140d84, blocks: 0x15ef 00010000:00010000:0.0:1746144644.074864:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.074866:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.074870:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4864200/0xa7c849b16e017631 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1f8 expref: 22 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.074878:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4864200/0xa7c849b16e017631 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1f8 expref: 22 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.074885:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864200, rc 0) 00000100:00100000:0.0:1746144644.074902:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746161664:12345-192.168.204.23@tcp:101:cat.0 Request processed in 73us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.074907:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10629 00000100:00100000:0.0:1746144644.082594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.082630:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.083032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.083247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.083261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.083337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.085407:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746163968 00000100:00100000:0.0:1746144644.085411:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746163968 00010000:00010000:0.0:1746144644.085441:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50b400/0xa7c849b16e017607 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1d5 expref: 301 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.085462:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746164096 00000100:00100000:0.0:1746144644.085464:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746164096 00010000:00010000:0.0:1746144644.085473:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a600/0xa7c849b16e0175e4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ce expref: 8 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.085488:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5208 00000100:00100000:0.0:1746144644.085494:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1963:x1830964746163968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.085507:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.085513:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50b400/0xa7c849b16e017607 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1d5 expref: 301 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.085522:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50b400/0xa7c849b16e017607 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1d5 expref: 301 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.085545:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.085549:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.085556:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.085562:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.085597:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1963:x1830964746163968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 102us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.085604:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5208 00000100:00100000:0.0:1746144644.085618:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5209 00000100:00100000:0.0:1746144644.085622:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746164096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.085631:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.085634:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a600/0xa7c849b16e0175e4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ce expref: 8 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.085642:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a600/0xa7c849b16e0175e4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ce expref: 8 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.085652:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.085655:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.085660:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.085666:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.085681:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.085694:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746164096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.085700:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5209 00000100:00100000:0.0:1746144644.085720:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746162304 00000100:00100000:0.0:1746144644.085723:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746162304 00000100:00100000:0.0:1746144644.085738:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746162432 00000100:00100000:0.0:1746144644.085741:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746162432 00000100:00100000:0.0:1746144644.085749:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746162560 00000100:00100000:0.0:1746144644.085751:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746162560 00000100:00100000:0.0:1746144644.085773:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10631 00000100:00100000:0.0:1746144644.085779:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746161920:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144644.085795:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.085808:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135757a00/0xa7c849b16e01764d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d206 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.085825:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.085827:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.085834:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135757a00/0xa7c849b16e01764d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d206 expref: 41 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.086410:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135757a00/0xa7c849b16e01764d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d206 expref: 41 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.086420:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135757a00, rc 0) 00000100:00100000:0.0:1746144644.086440:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746161920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 661us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.086445:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10631 00010000:00010000:0.0:1746144644.086498:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50b400/0xa7c849b16e017607 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1d5 expref: 300 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.086518:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747290240:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144644.086530:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a600/0xa7c849b16e0175e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ce expref: 7 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.086538:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747290368:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144644.086560:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.086568:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.086573:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:0.0:1746144644.086590:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144644.086736:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50bc00/0xa7c849b16e01763f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d230 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.086747:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b50a200/0xa7c849b16e017646 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d230 expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.086753:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.086755:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746144644.086757:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b50a200, rc 0) 00000100:00100000:0.0:1746144644.086772:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28501:x1830964746162816:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3962us (4060us total) trans 8589943662 rc 0/0 00000100:00100000:0.0:1746144644.086782:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9830 00000100:00100000:0.0:1746144644.090301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.103978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.108852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.108916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.109676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.109703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.109720:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746165376 00000100:00100000:0.0:1746144644.109723:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746165376 00002000:00100000:0.0:1746144644.109739:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b019f80 x1830964746165376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.109746:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b019f80 with x1830964746165376 ext(1048576->2097151) 00002000:00010000:0.0:1746144644.109750:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b019f80 00000100:00100000:0.0:1746144644.109760:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746165632 00000100:00100000:0.0:1746144644.109762:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746165632 00002000:00100000:0.0:1746144644.109771:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b01a300 x1830964746165632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.109778:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b01a300 with x1830964746165632 ext(1048576->2097151) 00002000:00010000:0.0:1746144644.109781:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b01a300 00000100:00100000:0.0:1746144644.109791:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3806 00000100:00100000:0.0:1746144644.109797:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746165248:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.111058:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3808 00000100:00100000:0.0:1746144644.111065:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b01a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746165632:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.116259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.116303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.122934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.124656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.127759:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b01a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746165632:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16691us (18051us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144644.127767:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3808 00002000:00100000:0.0:1746144644.127776:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b01a300 x1830964746165632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/440 e 0 to 0 dl 1746144655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.127784:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b01a300 with x1830964746165632 ext(1048576->2097151) 00002000:00010000:0.0:1746144644.127788:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b01a300 00000001:00080000:0.0:1746144644.157491:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943662 is committed 00000001:00080000:0.0:1746144644.157502:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943663 is committed 00000001:00080000:0.0:1746144644.157511:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943664 is committed 00000004:00080000:0.0:1746144644.157514:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1873 committed 00000004:00080000:0.0:1746144644.157520:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1931 committed 00000004:00080000:0.0:1746144644.157526:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1930 committed 00000004:00080000:0.0:1746144644.157527:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1929 committed 00000004:00080000:0.0:1746144644.157528:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1928 committed 00000004:00080000:0.0:1746144644.157530:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1872 committed 00000004:00080000:0.0:1746144644.157531:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1927 committed 00000004:00080000:0.0:1746144644.157534:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1871 committed 00000004:00080000:0.0:1746144644.157535:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1926 committed 00000004:00080000:0.0:1746144644.157539:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1870 committed 00000004:00080000:0.0:1746144644.157540:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1869 committed 00000004:00080000:0.0:1746144644.157542:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:0.0:1746144644.157543:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1925 committed 00000004:00080000:0.0:1746144644.157544:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1924 committed 00000004:00080000:0.0:1746144644.157546:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:0.0:1746144644.157549:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:0.0:1746144644.157550:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1923 committed 00000001:00080000:0.0:1746144644.157559:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943658 is committed 00000100:00100000:0.0:1746144644.157820:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747290880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.157873:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.157899:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747291648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.157914:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.157930:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747292032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.157943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.157950:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747292544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.157970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.157995:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747291008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.158007:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.158013:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747291520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.158022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.158026:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747292160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.158035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.158040:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747292672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.158048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144644.158349:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10639 00000100:00100000:0.0:1746144644.158434:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009392ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3293:x1830964747290752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144644.158564:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144644.158567:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.158569:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.158571:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.158573:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:0.0:1746144644.158601:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009392ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3293:x1830964747290752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (799us total) trans 17179873011 rc 0/0 00000100:00100000:0.0:1746144644.158608:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10639 00000100:00100000:0.0:1746144644.158621:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10641 00000100:00100000:0.0:1746144644.158625:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b01b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3294:x1830964747290880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144644.158684:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144644.158686:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.158687:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144643 -> 1746144643 00002000:00010000:0.0:1746144644.158689:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.158691:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746144644.158708:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b01b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3294:x1830964747290880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (836us total) trans 17179873013 rc 0/0 00000100:00100000:0.0:1746144644.159408:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10641 00000100:00100000:0.0:1746144644.159420:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10646 00000100:00100000:0.0:1746144644.159425:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3295:x1830964747291008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144644.159494:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:0.0:1746144644.159496:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.159498:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.159499:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.159501:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:0.0:1746144644.159523:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3295:x1830964747291008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (1515us total) trans 17179873016 rc 0/0 00000100:00100000:0.0:1746144644.159528:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10646 00000100:00100000:0.0:1746144644.159537:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10648 00000100:00100000:0.0:1746144644.159542:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3295:x1830964747292160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144644.159615:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144644.159617:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.159618:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144643 -> 1746144643 00002000:00010000:0.0:1746144644.159620:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144644 -> 1746144644 00002000:00010000:0.0:1746144644.159621:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144644.159641:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3295:x1830964747292160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1605us total) trans 21474840264 rc 0/0 00000100:00100000:0.0:1746144644.159645:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10648 00000004:00080000:0.0:1746144644.159816:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130929880/2, rc 0, transno 17179873016 00000100:00100000:0.0:1746144644.159825:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747291008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.159835:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce84000/2, rc 0, transno 21474840263 00000100:00100000:0.0:1746144644.159838:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747291520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.159844:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce86680/2, rc 0, transno 21474840264 00000100:00100000:0.0:1746144644.159847:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747292160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.159854:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013129d180/2, rc 0, transno 21474840265 00000100:00100000:0.0:1746144644.159856:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747292672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.159873:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130928000/2, rc 0, transno 17179873011 00000100:00100000:0.0:1746144644.159876:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747290752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.159882:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130929f80/2, rc 0, transno 17179873012 00000100:00100000:0.0:1746144644.159884:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747291392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.159890:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092aa00/2, rc 0, transno 17179873014 00000100:00100000:0.0:1746144644.159892:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747291904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.159899:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013129c700/2, rc 0, transno 21474840266 00000100:00100000:0.0:1746144644.159901:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747292416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.159911:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130929500/2, rc 0, transno 17179873013 00000100:00100000:0.0:1746144644.159913:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747290880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.159919:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092a300/2, rc 0, transno 17179873015 00000100:00100000:0.0:1746144644.159921:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747291648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144644.159929:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce85c00/2, rc 0, transno 21474840261 00000100:00100000:0.0:1746144644.159931:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747292032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144644.159937:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013129ce00/2, rc 0, transno 21474840262 00000100:00100000:0.0:1746144644.159939:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747292544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144644.159993:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747293056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.160015:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144644.160242:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092b800/2, rc 0, transno 17179873017 00000100:00100000:0.0:1746144644.160245:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747293056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144644.160357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.170549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.173226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.173297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.173314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.176172:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3810 00000100:00100000:0.0:1746144644.176185:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746167296:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144644.184680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.186880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.189107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.189743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.189806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.194560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.195489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.196820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.204408:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746169344 00000100:00100000:0.0:1746144644.204416:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746169344 00002000:00100000:0.0:1746144644.204483:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880130928e00 x1830964746169344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.204490:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928e00 with x1830964746169344 ext(2097152->3145727) 00002000:00010000:0.0:1746144644.204493:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928e00 00000100:00100000:0.0:1746144644.204511:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3813 00000100:00100000:0.0:1746144644.204518:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746169472:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.204578:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3815 00000100:00100000:0.0:1746144644.205784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.205854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.216491:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746169472:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11961us (12411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144644.216504:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3813 00002000:00100000:0.0:1746144644.216513:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880130928a80 x1830964746169472/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/440 e 0 to 0 dl 1746144655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.216522:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928a80 with x1830964746169472 ext(3145728->4194303) 00002000:00010000:0.0:1746144644.216528:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928a80 00000100:00100000:0.0:1746144644.230336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.230972:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746170752 00000100:00100000:0.0:1746144644.230976:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746170752 00000100:00100000:0.0:1746144644.235440:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746170880 00000100:00100000:0.0:1746144644.235448:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746170880 00000100:00100000:0.0:1746144644.235486:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10660 00000100:00100000:0.0:1746144644.235492:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:28501:x1830964746170880:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144644.235500:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.235509:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092981e00/0xa7c849b16e0176f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d28b expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.235525:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b50ae00/0xa7c849b16e017638 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ff expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.235532:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec5f200/0xa7c849b16e017670 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d229 expref: 31 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.235537:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.235538:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.235541:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092981e00/0xa7c849b16e0176f5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2736128->3145727] (req 2736128->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d28b expref: 31 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.235556:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec5f200/0xa7c849b16e017670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d229 expref: 31 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.235565:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec5f200/0xa7c849b16e017670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d229 expref: 31 pid: 8388 timeout: 723 lvb_type: 1 00000100:00100000:0.0:1746144644.235573:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747294464:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144644.238167:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b50ae00/0xa7c849b16e017638 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ff expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.238184:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b50ae00/0xa7c849b16e017638 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d1ff expref: 26 pid: 30345 timeout: 723 lvb_type: 1 00000100:00100000:0.0:1746144644.238197:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747294592:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144644.238277:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.239756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.240853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.244659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.251596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.257820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.257872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.260353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.260408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.260559:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10663 00000100:00100000:0.0:1746144644.260568:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746172672:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144644.260575:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.260584:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092981400/0xa7c849b16e01770a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d2a0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.260595:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.260604:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092981400/0xa7c849b16e01770a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2a0 expref: 26 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.260618:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092981400/0xa7c849b16e01770a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2a0 expref: 26 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.260632:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092981400, rc 0) 00000100:00100000:0.0:1746144644.260649:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746172672:12345-192.168.204.23@tcp:101:cat.0 Request processed in 84us (240us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144644.260654:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10663 00000100:00100000:0.0:1746144644.263087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.263176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144644.267886:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144643 -> 1746144644 00000100:00100000:0.0:1746144644.267903:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747295232:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144644.267931:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7d9800/0xa7c849b16e017711 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2a7 expref: 27 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.267942:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7d9800/0xa7c849b16e017711 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2a7 expref: 27 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.267964:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7d9800, rc 0) 00000100:00100000:0.0:1746144644.267993:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746172800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4694us (4916us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144644.268001:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10664 00000100:00100000:0.0:1746144644.271958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.275624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.277274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.279503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.290104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.295690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.299342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.299380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.299509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.299527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.300401:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3824 00000100:00100000:0.0:1746144644.300411:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746174848:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.315813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.315858:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746175232 00000100:00100000:0.0:1746144644.315869:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746175232 00002000:00100000:0.0:1746144644.315911:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4931584->4935679) req@ffff8800943f8e00 x1830964746175232/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.315921:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8e00 with x1830964746175232 ext(4931584->4935679) 00002000:00010000:0.0:1746144644.315926:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f8e00 00000100:00100000:0.0:1746144644.315956:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3825 00000100:00100000:0.0:1746144644.315965:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746175232:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.316335:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746175232:12345-192.168.204.23@tcp:3:cat.0 Request processed in 371us (533us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144644.316341:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3825 00002000:00100000:0.0:1746144644.316347:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4931584->4935679) req@ffff8800943f8e00 x1830964746175232/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746144655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.316353:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8e00 with x1830964746175232 ext(4931584->4935679) 00002000:00010000:0.0:1746144644.316356:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f8e00 00000100:00100000:0.0:1746144644.322442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.329494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.331242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.331327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.350365:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.352404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.365108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.369893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.370892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.373431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.373478:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.376382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.379386:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.379454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.379476:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746177536 00000100:00100000:0.0:1746144644.379482:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746177536 00010000:00010000:0.0:1746144644.379517:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7d9600/0xa7c849b16e017718 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2ae expref: 26 pid: 8453 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.379542:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746177664 00000100:00100000:0.0:1746144644.379544:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746177664 00010000:00010000:0.0:1746144644.379554:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7d9a00/0xa7c849b16e01771f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2b5 expref: 43 pid: 8453 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.379569:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5225 00000100:00100000:0.0:1746144644.379575:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746177536:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.379588:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.379610:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7d9600/0xa7c849b16e017718 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2ae expref: 26 pid: 8453 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.379621:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7d9600/0xa7c849b16e017718 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2ae expref: 26 pid: 8453 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.379645:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.379691:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746177536:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.379697:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5225 00000100:00100000:0.0:1746144644.379712:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5226 00000100:00100000:0.0:1746144644.379717:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746177664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.379724:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.379732:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7d9a00/0xa7c849b16e01771f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2b5 expref: 43 pid: 8453 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.379741:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7d9a00/0xa7c849b16e01771f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2b5 expref: 43 pid: 8453 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.379752:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.380297:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.380304:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f65d400/0xa7c849b16e017773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2d8 expref: 24 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.380312:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f65d400/0xa7c849b16e017773 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2d8 expref: 24 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.380632:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f65d400/0xa7c849b16e017773 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2d8 expref: 23 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144644.381200:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747296640:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144644.381268:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.381798:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10673 00000100:00100000:0.0:1746144644.381807:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1963:x1830964746178304:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144644.381815:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.381824:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2dda00/0xa7c849b16e01778f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d2fb expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144644.381859:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747296768:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144644.381899:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.382250:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10675 00000100:00100000:0.0:1746144644.382257:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746177920:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144644.382264:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.382270:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f14ec00/0xa7c849b16e01779d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d2e6 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.382280:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.382282:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.382286:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f14ec00/0xa7c849b16e01779d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2e6 expref: 13 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.382294:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f14ec00/0xa7c849b16e01779d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2e6 expref: 13 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.382305:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14ec00, rc 0) 00000100:00100000:0.0:1746144644.382321:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746177920:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 65us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.382326:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10675 00000100:00100000:0.0:1746144644.386016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.386072:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746178688 00000100:00100000:0.0:1746144644.386078:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746178688 00002000:00100000:0.0:1746144644.386301:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3428352->3432447) req@ffff8800943f9500 x1830964746178688/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.386310:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9500 with x1830964746178688 ext(3428352->3432447) 00002000:00010000:0.0:1746144644.386314:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9500 00000100:00100000:0.0:1746144644.386328:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3828 00000100:00100000:0.0:1746144644.386334:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746178688:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144644.386840:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746178688:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 505us (824us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144644.386846:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3828 00002000:00100000:0.0:1746144644.386850:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3428352->3432447) req@ffff8800943f9500 x1830964746178688/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/4536 e 0 to 0 dl 1746144655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.386857:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9500 with x1830964746178688 ext(3428352->3432447) 00002000:00010000:0.0:1746144644.386859:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9500 00000100:00100000:0.0:1746144644.389458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.389500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.391882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.396228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.400682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.400708:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746179712 00000100:00100000:0.0:1746144644.400715:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746179712 00000100:00100000:0.0:1746144644.400765:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9841 00000100:00100000:0.0:1746144644.400772:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28515:x1830964746179712:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144644.400790:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.400805:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14f600/0xa7c849b16e0177c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d317 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.400890:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.400902:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.400911:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.400920:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.400925:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.400930:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401010:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14f400/0xa7c849b16e0177dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401019:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14f400/0xa7c849b16e0177dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401028:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14f400/0xa7c849b16e0177dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144644.401035:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144644.401102:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401108:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401113:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401118:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f14e400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144644.401121:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401127:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401156:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144644.401159:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144644.401163:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401168:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e400/0xa7c849b16e0177ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401181:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401185:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401192:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401195:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f14e800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144644.401197:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401202:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401207:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639600) 00010000:00010000:0.0:1746144644.401209:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144644.401211:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401215:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14e800/0xa7c849b16e0177d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.401248:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14f600/0xa7c849b16e0177c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d317 expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.401258:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f14f400/0xa7c849b16e0177dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d317 expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.401264:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.401265:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144644.401268:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.401273:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.401280:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f14f400, rc 0) 00000100:00100000:0.0:1746144644.401428:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28515:x1830964746179712:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 655us (752us total) trans 8589943671 rc 0/0 00000100:00100000:0.0:1746144644.401434:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9841 00000100:00100000:0.0:1746144644.401707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.401723:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746179840 00000100:00100000:0.0:1746144644.401727:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746179840 00010000:00010000:0.0:1746144644.401743:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e0177ab lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d309 expref: 10 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.401759:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5228 00000100:00100000:0.0:1746144644.401764:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746179840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.401772:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.401776:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e0177ab lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d309 expref: 10 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.401784:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e0177ab lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d309 expref: 10 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.401795:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.401798:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.401804:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.401809:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144644.402299:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.402477:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746179840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 712us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.402483:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5228 00000100:00100000:0.0:1746144644.404629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.404702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.405000:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10676 00000100:00100000:0.0:1746144644.405009:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746179968:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144644.405024:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.405038:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f14fc00/0xa7c849b16e0177ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d31e expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144644.405077:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747297280:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144644.405153:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.412574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.416051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.460093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.466478:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.479946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.482401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.490253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.496626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.497576:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 708 00000100:00100000:0.0:1746144644.497585:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746181504:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144644.508703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.509380:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.518341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.520685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.550896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.563689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.563774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.572942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.579225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.579275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.581248:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746183936 00000100:00100000:0.0:1746144644.581253:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746183936 00002000:00100000:0.0:1746144644.581274:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb4ed80 x1830964746183936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.581282:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb4ed80 with x1830964746183936 ext(1048576->2097151) 00002000:00010000:0.0:1746144644.581286:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb4ed80 00000100:00100000:0.0:1746144644.581639:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3833 00000100:00100000:0.0:1746144644.581646:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+30:1963:x1830964746183936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.600664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.600700:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746184704 00000100:00100000:0.0:1746144644.600706:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746184704 00002000:00100000:0.0:1746144644.600739:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012c944380 x1830964746184704/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.600749:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944380 with x1830964746184704 ext(0->1048575) 00002000:00010000:0.0:1746144644.600759:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944380 00000100:00100000:0.0:1746144644.600777:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3835 00000100:00100000:0.0:1746144644.600784:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746184704:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144644.626605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.626741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.634920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.636633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.636657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.636818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.638062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.638080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.638102:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746186240 00000100:00100000:0.0:1746144644.638104:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746186240 00002000:00100000:0.0:1746144644.638120:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3362816->4194303) req@ffff88012c944a80 x1830964746186240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.638126:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944a80 with x1830964746186240 ext(3362816->4194303) 00002000:00010000:0.0:1746144644.638129:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c944a80 00000100:00100000:0.0:1746144644.638149:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746185728 00000100:00100000:0.0:1746144644.638152:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746185728 00002000:00100000:0.0:1746144644.638160:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2691072->3145727) req@ffff88012c947480 x1830964746185728/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.638165:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947480 with x1830964746185728 ext(2691072->3145727) 00010000:00010000:0.0:1746144644.638169:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f62ca00/0xa7c849b16e017806 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d333 expref: 47 pid: 29370 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.638178:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f62ca00/0xa7c849b16e017806 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2691072->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d333 expref: 47 pid: 29370 timeout: 723 lvb_type: 0 00002000:00010000:0.0:1746144644.638182:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c947480 00000100:00100000:0.0:1746144644.638198:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 711 00000100:00100000:0.0:1746144644.638202:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1962:x1830964746185728:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144644.656034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.659237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.660087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.661726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.666093:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746187520 00000100:00100000:0.0:1746144644.666096:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746187520 00010000:00010000:0.0:1746144644.666112:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135787800/0xa7c849b16e017829 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d341 expref: 17 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.666127:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5233 00000100:00100000:0.0:1746144644.666154:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746187520:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.666163:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.666169:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135787800/0xa7c849b16e017829 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d341 expref: 17 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.666177:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135787800/0xa7c849b16e017829 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d341 expref: 17 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.666190:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135787800/0xa7c849b16e017829 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d341 expref: 17 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.666201:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.666204:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d26000/0xa7c849b16e0178a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.666211:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d26000/0xa7c849b16e0178a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.666216:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.666241:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746187520:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.666246:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5233 00000100:00100000:0.0:1746144644.666254:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746187648 00000100:00100000:0.0:1746144644.666256:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746187648 00010000:00010000:0.0:1746144644.666263:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d310 expref: 9 pid: 20319 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.666275:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5234 00000100:00100000:0.0:1746144644.666278:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746187648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.666283:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.666287:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d310 expref: 9 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.666294:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d310 expref: 9 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.666303:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf71200/0xa7c849b16e0177c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d310 expref: 9 pid: 20319 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.666311:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.666313:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d26000/0xa7c849b16e0178a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.666319:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d26000/0xa7c849b16e0178a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.666328:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d26000/0xa7c849b16e0178a0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.666341:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.666353:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746187648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.666358:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5234 00010000:00010000:0.0:1746144644.671271:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144644.685782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.685874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.686757:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746188160 00000100:00100000:0.0:1746144644.686761:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746188160 00000100:00100000:0.0:1746144644.686783:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10687 00000100:00100000:0.0:1746144644.686789:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:28519:x1830964746188160:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144644.686797:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.686806:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f010800/0xa7c849b16e0178b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d38e expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.686819:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.686826:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2dc800/0xa7c849b16e017892 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d379 expref: 45 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.686831:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.686832:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.686834:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f010800/0xa7c849b16e0178b5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3383296->4194303] (req 3383296->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d38e expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.686855:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2dc800/0xa7c849b16e017892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d379 expref: 45 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.686863:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2dc800/0xa7c849b16e017892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d379 expref: 45 pid: 30345 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.686870:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747299328:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144644.686902:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.686909:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 27 pid: 30345 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.686916:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747299456:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144644.686930:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.692568:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.692627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.692693:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746188416 00000100:00100000:0.0:1746144644.692699:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746188416 00010000:00010000:0.0:1746144644.692723:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 28 pid: 30345 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.692744:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5235 00000100:00100000:0.0:1746144644.692750:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746188416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.692762:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.692777:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 27 pid: 30345 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.692794:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 27 pid: 30345 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.692812:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e41d600/0xa7c849b16e01788b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d372 expref: 27 pid: 30345 timeout: 723 lvb_type: 0 00010000:00010000:0.0:1746144644.693260:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.693283:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746188416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 533us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.693289:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5235 00000100:00100000:0.0:1746144644.703897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.704053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.704808:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10689 00000100:00100000:0.0:1746144644.704818:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746188544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144644.704827:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.706178:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f011400/0xa7c849b16e0178c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d395 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.706205:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.706218:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f011400/0xa7c849b16e0178c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d395 expref: 46 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.706230:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f011400/0xa7c849b16e0178c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d395 expref: 46 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144644.706268:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f011400, rc 0) 00000100:00100000:0.0:1746144644.706325:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746188544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1507us (2270us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144644.706332:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10689 00000100:00100000:0.0:1746144644.707724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.713671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.713923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.714160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.722953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.723310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.727027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.742970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.743019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.745284:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10692 00000100:00100000:0.0:1746144644.745295:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:28519:x1830964746190336:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144644.745303:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.745314:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f010400/0xa7c849b16e0178d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d3b1 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.745330:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b50ba00/0xa7c849b16e0178ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d387 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.745337:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.745338:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144644.745341:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f010400/0xa7c849b16e0178d8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3358719] (req 3145728->3358719) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3b1 expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.745369:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b50ba00/0xa7c849b16e0178ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d387 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.745381:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b50ba00/0xa7c849b16e0178ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d387 expref: 30 pid: 29370 timeout: 723 lvb_type: 0 00000100:00100000:0.0:1746144644.745401:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747300096:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144644.745448:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144644.745731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.748558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.753707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.753739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.761653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.777994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.795088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.803490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.809291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.811354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.811399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.814045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.820964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.821016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.826520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.826553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.833283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.887287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.903811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.903858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.903897:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746194944 00000100:00100000:0.0:1746144644.903901:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746194944 00000100:00100000:0.0:1746144644.903941:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9847 00000100:00100000:0.0:1746144644.903949:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:28537:x1830964746194944:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144644.903972:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144644.903990:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e017909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d3e2 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.904082:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e017910 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.904096:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e017910 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144644.904109:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e017910 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144644.904120:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144644.904243:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e017909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3e2 expref: 20 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.904261:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e017910 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3e2 expref: 19 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144644.904269:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144644.904272:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746144644.904275:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f011c00, rc 0) 00000100:00100000:0.0:1746144644.904324:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:28537:x1830964746194944:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 376us (466us total) trans 8589943680 rc 0/0 00000100:00100000:0.0:1746144644.904331:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9847 00000100:00100000:0.0:1746144644.931921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.932021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.947814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.947876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.947907:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746195456 00000100:00100000:0.0:1746144644.947913:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746195456 00010000:00010000:0.0:1746144644.947940:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad600/0xa7c849b16e0176e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d27d expref: 30 pid: 8450 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746144644.947960:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746195584 00000100:00100000:0.0:1746144644.947962:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746195584 00010000:00010000:0.0:1746144644.947971:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41c800/0xa7c849b16e017788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2ed expref: 9 pid: 30345 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746144644.947983:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5246 00000100:00100000:0.0:1746144644.947988:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746195456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144644.947999:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144644.948020:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad600/0xa7c849b16e0176e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d27d expref: 29 pid: 8450 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144644.948029:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad600/0xa7c849b16e0176e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d27d expref: 29 pid: 8450 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144644.948052:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad600/0xa7c849b16e0176e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d27d expref: 29 pid: 8450 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144644.948066:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.948094:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746195456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.948099:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5246 00000100:00100000:0.0:1746144644.948522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.954694:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747302528:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144644.954719:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144644.954775:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746195712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6099us (6251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144644.954785:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5248 00000100:00100000:0.0:1746144644.958455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.959119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.961752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.978461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.993526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.993565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.993604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144644.993636:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746196992 00000100:00100000:0.0:1746144644.993646:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746196992 00002000:00100000:0.0:1746144644.993695:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f168a80 x1830964746196992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.993705:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168a80 with x1830964746196992 ext(3145728->4194303) 00002000:00010000:0.0:1746144644.993711:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f168a80 00000100:00100000:0.0:1746144644.993728:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746197120 00000100:00100000:0.0:1746144644.993730:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746197120 00002000:00100000:0.0:1746144644.993742:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f169f80 x1830964746197120/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.993749:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169f80 with x1830964746197120 ext(2097152->3145727) 00002000:00010000:0.0:1746144644.993752:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f169f80 00000100:00100000:0.0:1746144644.993760:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746197248 00000100:00100000:0.0:1746144644.993761:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746197248 00002000:00100000:0.0:1746144644.993770:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f169c00 x1830964746197248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:285/0 lens 488/0 e 0 to 0 dl 1746144655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144644.993776:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169c00 with x1830964746197248 ext(3145728->4194303) 00002000:00010000:0.0:1746144644.993778:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f169c00 00000100:00100000:0.0:1746144644.993805:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3854 00000100:00100000:0.0:1746144644.993813:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746196992:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144645.023017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.024999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144645.026865:0:4760:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144644 -> 1746144645 00002000:00010000:0.0:1746144645.026872:0:4760:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144644 -> 1746144645 00002000:00010000:0.0:1746144645.026874:0:4760:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144644 -> 1746144645 00000100:00100000:0.0:1746144645.026891:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f435f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747303040:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144645.026922:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e487a00/0xa7c849b16e017933 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3fe expref: 35 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.026934:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e487a00/0xa7c849b16e017933 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3fe expref: 35 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.026956:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e487a00, rc 0) 00000100:00100000:0.0:1746144645.026997:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746197632:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3637us (3984us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144645.027004:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10702 00000100:00100000:0.0:1746144645.032662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.039063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.042092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.048761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.048797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.048821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.048848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.048907:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746198528 00000100:00100000:0.0:1746144645.048917:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746198528 00000100:00100000:0.0:1746144645.048963:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746198656 00000100:00100000:0.0:1746144645.048965:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746198656 00000100:00100000:0.0:1746144645.048978:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746198784 00000100:00100000:0.0:1746144645.048979:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746198784 00000100:00100000:0.0:1746144645.048988:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746198912 00000100:00100000:0.0:1746144645.048990:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746198912 00000100:00100000:0.0:1746144645.049005:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10703 00000100:00100000:0.0:1746144645.049013:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746198528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.049033:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.049052:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50e1800/0xa7c849b16e01793a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d405 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.049270:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747303424:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.049298:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10705 00000100:00100000:0.0:1746144645.049304:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:1962:x1830964746198784:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.049312:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.049318:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50e1200/0xa7c849b16e017948 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d413 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.049340:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747303552:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.049359:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.049368:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.049397:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10706 00000100:00100000:0.0:1746144645.049403:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+34:1962:x1830964746198912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.049409:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.049415:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50e1a00/0xa7c849b16e01794f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d41a expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.049426:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.049427:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.049435:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50e1a00/0xa7c849b16e01794f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d41a expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.049451:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50e1a00/0xa7c849b16e01794f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d41a expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.049460:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50e1a00, rc 0) 00000100:00100000:0.0:1746144645.049485:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746198912:12345-192.168.204.23@tcp:101:cat.0 Request processed in 82us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.049490:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10706 00000100:00100000:0.0:1746144645.050551:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747303552:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144645.050575:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50e1200/0xa7c849b16e017948 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d413 expref: 34 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.050586:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50e1200/0xa7c849b16e017948 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d413 expref: 34 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.050608:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50e1200, rc 0) 00000100:00100000:0.0:1746144645.050629:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:1962:x1830964746198784:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1326us (1807us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144645.050635:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10705 00000100:00100000:0.0:1746144645.052500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.052545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.057968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.070597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.077435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.093611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.097189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.110233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.116915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.150234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.150269:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746200576 00000100:00100000:0.0:1746144645.150277:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746200576 00000100:00100000:0.0:1746144645.150325:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10709 00000100:00100000:0.0:1746144645.150332:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:28544:x1830964746200576:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.150352:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.151640:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50e0400/0xa7c849b16e017964 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d42f expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.151682:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4867c00/0xa7c849b16e01792c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3f7 expref: 34 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.151691:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144645.151692:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144645.151696:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50e0400/0xa7c849b16e017964 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d42f expref: 33 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.151729:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4867c00/0xa7c849b16e01792c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1667071) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3f7 expref: 34 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.151742:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4867c00/0xa7c849b16e01792c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1667071) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3f7 expref: 34 pid: 30345 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746144645.151755:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747304192:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144645.151830:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.154965:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747304192:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144645.154993:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50e0400/0xa7c849b16e017964 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d42f expref: 33 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.155010:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50e0400, rc 0) 00000100:00100000:0.0:1746144645.155045:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:28544:x1830964746200576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4714us (4821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.155059:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10709 00000100:00100000:0.0:1746144645.169784:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746200704:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8147us (8849us total) trans 21474840276 rc 0/0 00000100:00100000:0.0:1746144645.169795:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 720 00002000:00100000:0.0:1746144645.169805:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1081344->1667071) req@ffff88013129ca80 x1830964746200704/t21474840276(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:286/0 lens 488/448 e 0 to 0 dl 1746144656 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.169814:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ca80 with x1830964746200704 ext(1081344->1667071) 00010000:00010000:0.0:1746144645.169823:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4867c00/0xa7c849b16e01792c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3f7 expref: 37 pid: 30345 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746144645.169837:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4867c00/0xa7c849b16e01792c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3f7 expref: 37 pid: 30345 timeout: 724 lvb_type: 0 00002000:00010000:0.0:1746144645.169844:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013129ca80 00000100:00100000:0.0:1746144645.182434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.264788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144645.266018:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144645.276957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.277895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144645.278042:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144645.279786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.279830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.284060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.285277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.289832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.292843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.292877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.292906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.292933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144645.293120:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746144645.293124:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144645.293182:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10714 00000100:00100000:0.0:1746144645.293188:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746203904:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144645.293210:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.293216:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e0179cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d46e expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.293230:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.293232:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.293240:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e0179cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d46e expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.293253:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e0179cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d46e expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.293261:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eae4c00, rc 0) 00000100:00100000:0.0:1746144645.293290:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746203904:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 102us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.293295:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10714 00000100:00100000:0.0:1746144645.293480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.294364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.294395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.294425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.297682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.301195:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.307932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.312238:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746205568 00000100:00100000:0.0:1746144645.312246:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746205568 00010000:00010000:0.0:1746144645.312280:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135756c00/0xa7c849b16e0179db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d475 expref: 8 pid: 4760 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746144645.312307:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5258 00000100:00100000:0.0:1746144645.312314:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746205568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.312327:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144645.312351:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135756c00/0xa7c849b16e0179db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d475 expref: 8 pid: 4760 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.312360:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135756c00/0xa7c849b16e0179db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d475 expref: 8 pid: 4760 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.312394:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135756c00/0xa7c849b16e0179db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d475 expref: 8 pid: 4760 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.312412:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144645.312446:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746205568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 133us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.312453:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5258 00000100:00100000:0.0:1746144645.314946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.315066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.315090:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746205824 00000100:00100000:0.0:1746144645.315096:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746205824 00000100:00100000:0.0:1746144645.315131:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746205696 00000100:00100000:0.0:1746144645.315256:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746205696 00010000:00010000:0.0:1746144645.315270:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf71200/0xa7c849b16e0178d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3aa expref: 9 pid: 8451 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746144645.315293:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5259 00000100:00100000:0.0:1746144645.315402:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746205696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.315414:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144645.315440:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cf71200/0xa7c849b16e0178d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3aa expref: 9 pid: 8451 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746144645.315452:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cf71200/0xa7c849b16e0178d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3aa expref: 9 pid: 8451 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746144645.315464:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf71200/0xa7c849b16e0178d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d3aa expref: 9 pid: 8451 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746144645.316681:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144645.316709:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746205696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1408us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.316717:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5259 00000100:00100000:0.0:1746144645.317893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.318001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.318026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.318230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.320097:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.323054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.323103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.323894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.347390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.347622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.360125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.360206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.361024:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10723 00000100:00100000:0.0:1746144645.361031:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746209664:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.361038:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.361047:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eae4e00/0xa7c849b16e017a36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d4ad expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.361068:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747306496:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.361089:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.367573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.371972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.379348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.415884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.418970:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746210944 00000100:00100000:0.0:1746144645.418976:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746210944 00000100:00100000:0.0:1746144645.419017:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10728 00000100:00100000:0.0:1746144645.419024:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:28555:x1830964746210944:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.419037:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.419051:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eae5200/0xa7c849b16e017a59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d4d7 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.419072:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbfae00/0xa7c849b16e017a28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4a6 expref: 33 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.419077:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144645.419079:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144645.419081:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eae5200/0xa7c849b16e017a59 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4d7 expref: 38 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.419102:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbfae00/0xa7c849b16e017a28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4a6 expref: 33 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.419111:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbfae00/0xa7c849b16e017a28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4a6 expref: 33 pid: 4760 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746144645.419119:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747307136:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144645.425088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.430543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.441533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.441611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.453310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.453347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.453391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.489631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.494218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.496566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.497964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.499478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.505439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.505463:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746213760 00000100:00100000:0.0:1746144645.505470:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746213760 00002000:00100000:0.0:1746144645.505504:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012cefe300 x1830964746213760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:286/0 lens 488/0 e 0 to 0 dl 1746144656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.505518:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefe300 with x1830964746213760 ext(4194304->4935679) 00002000:00010000:0.0:1746144645.505522:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefe300 00000100:00100000:0.0:1746144645.505880:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3881 00000100:00100000:0.0:1746144645.505888:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746213760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144645.525523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.550750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.550785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.550816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.550847:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746214400 00000100:00100000:0.0:1746144645.550850:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746214400 00002000:00100000:0.0:1746144645.551126:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b482a00 x1830964746214400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:286/0 lens 488/0 e 0 to 0 dl 1746144656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.551149:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b482a00 with x1830964746214400 ext(3145728->4194303) 00002000:00010000:0.0:1746144645.551152:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b482a00 00000100:00100000:0.0:1746144645.551164:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3883 00000100:00100000:0.0:1746144645.551169:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+36:1962:x1830964746214400:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144645.568860:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746214144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17899us (18122us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144645.568867:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3882 00002000:00100000:0.0:1746144645.568872:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009b480380 x1830964746214144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:286/0 lens 488/440 e 0 to 0 dl 1746144656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.568878:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480380 with x1830964746214144 ext(2097152->3145727) 00002000:00010000:0.0:1746144645.568881:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b480380 00000100:00100000:0.0:1746144645.577184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.578864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.582813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.582841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.582875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.582906:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746215168 00000100:00100000:0.0:1746144645.582912:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746215168 00010000:00010000:0.0:1746144645.582940:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e0179cd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d46e expref: 9 pid: 8451 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746144645.582963:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746215296 00000100:00100000:0.0:1746144645.582965:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746215296 00010000:00010000:0.0:1746144645.582974:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbfbe00/0xa7c849b16e017995 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d452 expref: 40 pid: 30345 timeout: 724 lvb_type: 1 00000100:00100000:0.0:1746144645.582986:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746215424 00000100:00100000:0.0:1746144645.582987:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746215424 00010000:00010000:0.0:1746144645.582995:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50e0400/0xa7c849b16e017964 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d42f expref: 37 pid: 4760 timeout: 724 lvb_type: 0 00000100:00100000:0.0:1746144645.583007:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5271 00000100:00100000:0.0:1746144645.583012:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746215168:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.583023:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144645.583040:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e0179cd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d46e expref: 9 pid: 8451 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.583048:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e0179cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d46e expref: 9 pid: 8451 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.583072:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144645.583101:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746215168:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.583107:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5271 00000100:00100000:0.0:1746144645.583119:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5272 00000100:00100000:0.0:1746144645.583123:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746215296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.583130:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144645.583160:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbfbe00/0xa7c849b16e017995 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d452 expref: 40 pid: 30345 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.583167:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbfbe00/0xa7c849b16e017995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d452 expref: 40 pid: 30345 timeout: 724 lvb_type: 1 00010000:00010000:0.0:1746144645.583177:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144645.583190:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746215296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.583195:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5272 00000100:00100000:0.0:1746144645.583205:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5273 00000100:00100000:0.0:1746144645.583209:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:1963:x1830964746215424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.583215:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144645.583221:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50e0400/0xa7c849b16e017964 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d42f expref: 37 pid: 4760 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746144645.583228:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50e0400/0xa7c849b16e017964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d42f expref: 37 pid: 4760 timeout: 724 lvb_type: 0 00010000:00010000:0.0:1746144645.583238:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.583240:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.583245:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008be70600/0xa7c849b16e017a98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1265664->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4fa expref: 37 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.583253:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008be70600/0xa7c849b16e017a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1265664->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4fa expref: 37 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.583276:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008be70600/0xa7c849b16e017a98 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1265664->1855487) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d4fa expref: 37 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.583285:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747308032:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144645.583337:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.586072:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746215040:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 6500us (7208us total) trans 0 rc 741376/741376 00000100:00100000:0.0:1746144645.586079:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3885 00002000:00100000:0.0:1746144645.586085:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b481500 x1830964746215040/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:286/0 lens 488/440 e 0 to 0 dl 1746144656 ref 1 fl Complete:/200/0 rc 741376/741376 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.586093:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481500 with x1830964746215040 ext(4194304->4935679) 00002000:00010000:0.0:1746144645.586098:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481500 00000100:00100000:0.0:1746144645.586202:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747308032:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144645.586210:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144645.586224:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+35:1963:x1830964746215424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3014us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144645.586233:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5273 00000100:00100000:0.0:1746144645.590458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.646544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.652935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.652997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.653630:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.653661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.653757:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746216448 00000100:00100000:0.0:1746144645.653760:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746216448 00000100:00100000:0.0:1746144645.653786:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10733 00000100:00100000:0.0:1746144645.653791:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746216448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.653807:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.653822:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f991000/0xa7c849b16e017aa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d508 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.653855:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747308544:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.654536:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.657933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.657968:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746216832 00000100:00100000:0.0:1746144645.657974:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746216832 00002000:00100000:0.0:1746144645.658005:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3010560->3014655) req@ffff88009b481180 x1830964746216832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:286/0 lens 488/0 e 0 to 0 dl 1746144656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.658014:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481180 with x1830964746216832 ext(3010560->3014655) 00002000:00010000:0.0:1746144645.658018:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481180 00000100:00100000:0.0:1746144645.658038:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3888 00000100:00100000:0.0:1746144645.658044:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746216832:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144645.658203:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746216832:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 157us (275us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144645.658208:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3888 00002000:00100000:0.0:1746144645.658212:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3010560->3014655) req@ffff88009b481180 x1830964746216832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:286/0 lens 488/4536 e 0 to 0 dl 1746144656 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.658219:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481180 with x1830964746216832 ext(3010560->3014655) 00002000:00010000:0.0:1746144645.658221:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481180 00000100:00100000:0.0:1746144645.665705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.671251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.693998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.697334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.722963:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746218112 00000100:00100000:0.0:1746144645.722973:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746218112 00000100:00100000:0.0:1746144645.723012:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746218240 00000100:00100000:0.0:1746144645.723014:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746218240 00000100:00100000:0.0:1746144645.723024:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746218496 00000100:00100000:0.0:1746144645.723026:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746218496 00000100:00100000:0.0:1746144645.723042:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10737 00000100:00100000:0.0:1746144645.723048:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e904050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+37:1960:x1830964746218112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.723067:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.723085:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f990c00/0xa7c849b16e017ac2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d524 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.723155:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747309312:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.723232:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.728543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.734791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.737080:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746218752:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8237us (8540us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144645.737091:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3891 00002000:00100000:0.0:1746144645.737103:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b483b80 x1830964746218752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:286/0 lens 488/440 e 0 to 0 dl 1746144656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.737112:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483b80 with x1830964746218752 ext(1048576->2097151) 00002000:00010000:0.0:1746144645.737118:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b483b80 00000100:00100000:0.0:1746144645.748790:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746219136 00000100:00100000:0.0:1746144645.748803:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746219136 00002000:00100000:0.0:1746144645.748860:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f435f80 x1830964746219136/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:286/0 lens 488/0 e 0 to 0 dl 1746144656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.748871:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435f80 with x1830964746219136 ext(1048576->2097151) 00002000:00010000:0.0:1746144645.748877:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f435f80 00000100:00100000:0.0:1746144645.748916:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746219648 00000100:00100000:0.0:1746144645.748922:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746219648 00002000:00100000:0.0:1746144645.748942:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3280896->4194303) req@ffff88013129ed80 x1830964746219648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:286/0 lens 488/0 e 0 to 0 dl 1746144656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.748949:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ed80 with x1830964746219648 ext(3280896->4194303) 00002000:00010000:0.0:1746144645.748952:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013129ed80 00000100:00100000:0.0:1746144645.764868:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+36:1961:x1830964746219136:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15835us (16779us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144645.764880:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3892 00002000:00100000:0.0:1746144645.764893:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f435f80 x1830964746219136/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:286/0 lens 488/440 e 0 to 0 dl 1746144656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144645.764909:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435f80 with x1830964746219136 ext(1048576->2097151) 00002000:00010000:0.0:1746144645.764915:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f435f80 00000100:00100000:0.0:1746144645.779375:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746220416 00000100:00100000:0.0:1746144645.779387:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746220416 00000100:00100000:0.0:1746144645.779460:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10741 00000100:00100000:0.0:1746144645.779468:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+36:1960:x1830964746220416:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.779484:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.779502:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008be70600/0xa7c849b16e017ade lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d547 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.779898:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747309952:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.779998:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.785458:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747309952:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144645.785478:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008be70600/0xa7c849b16e017ade lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d547 expref: 37 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.785487:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008be70600/0xa7c849b16e017ade lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d547 expref: 37 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144645.785502:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be70600, rc 0) 00000100:00100000:0.0:1746144645.785952:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+36:1960:x1830964746220416:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6480us (7050us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144645.785961:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10741 00000100:00100000:0.0:1746144645.790759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.792116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.798104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.812665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.812747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.820800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.822057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.846723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.848548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.851924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.851975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.852001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.852045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.852067:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746222208 00000100:00100000:0.0:1746144645.852069:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746222208 00010000:00010000:0.0:1746144645.852092:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fa00/0xa7c849b16e017781 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d2f4 expref: 7 pid: 29370 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1746144645.852111:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746222464 00000100:00100000:0.0:1746144645.852112:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746222464 00010000:00010000:0.0:1746144645.852121:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3ac600/0xa7c849b16e0176ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d284 expref: 25 pid: 8450 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144645.852153:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5281 00000100:00100000:0.0:1746144645.852157:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746222336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.852163:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144645.852174:0:7309:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746144645.852179:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3ac800/0xa7c849b16e017703 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d299 expref: 10 pid: 29370 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144645.852196:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3ac800/0xa7c849b16e017703 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d299 expref: 10 pid: 29370 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144645.852616:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3ac800/0xa7c849b16e017703 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d299 expref: 10 pid: 29370 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144645.852655:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.852658:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.852666:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68e00/0xa7c849b16e017b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2043903) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d563 expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.852676:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68e00/0xa7c849b16e017b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2043903) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d563 expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.852712:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed68e00/0xa7c849b16e017b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d563 expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.852725:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093760380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747310848:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144645.852786:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.877394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.877484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.888503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.888560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.895663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.916790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.923764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.923937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.929646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.936115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.938636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.944574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.950564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.951000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.953835:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746225408 00000100:00100000:0.0:1746144645.953842:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746225408 00010000:00010000:0.0:1746144645.953868:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbfa600/0xa7c849b16e017aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d54e expref: 11 pid: 8450 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144645.953892:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5286 00000100:00100000:0.0:1746144645.953898:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746225408:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144645.953908:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144645.953927:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbfa600/0xa7c849b16e017aec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d54e expref: 11 pid: 8450 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144645.953939:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbfa600/0xa7c849b16e017aec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d54e expref: 11 pid: 8450 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144645.953958:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbfa600/0xa7c849b16e017aec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d54e expref: 11 pid: 8450 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144645.953988:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.953991:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144645.953998:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e71d600/0xa7c849b16e017b1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4046847] (req 3145728->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d57f expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.954015:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71d600/0xa7c849b16e017b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4046847] (req 3145728->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d57f expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144645.954046:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e71d600/0xa7c849b16e017b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4046847] (req 3145728->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d57f expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.954057:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747311872:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144645.954126:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144645.954325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.958969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.959013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.960119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.962436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.979861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144645.998847:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10757 00000100:00100000:0.0:1746144645.998855:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746226944:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144645.998863:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144645.998871:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b23800/0xa7c849b16e017b4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d5b0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144645.998903:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747312256:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144645.998951:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.004981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144646.005207:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144646.011273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.029570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144646.030054:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144646.036275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.044690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.046976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.054437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.059120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.059178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.059200:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746228352 00000100:00100000:0.0:1746144646.059208:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746228352 00010000:00010000:0.0:1746144646.059246:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4efe200/0xa7c849b16e0179c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d460 expref: 6 pid: 29370 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1746144646.059285:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746228224 00000100:00100000:0.0:1746144646.059288:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746228224 00010000:00010000:0.0:1746144646.059299:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135757200/0xa7c849b16e0179a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d444 expref: 24 pid: 4760 timeout: 725 lvb_type: 1 00000100:00100000:0.0:1746144646.059313:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5288 00000100:00100000:0.0:1746144646.059319:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746228352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.059333:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.059358:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4efe200/0xa7c849b16e0179c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d460 expref: 6 pid: 29370 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144646.059380:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4efe200/0xa7c849b16e0179c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d460 expref: 6 pid: 29370 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144646.059404:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4efe200/0xa7c849b16e0179c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d460 expref: 6 pid: 29370 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144646.059431:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.059468:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746228352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 149us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.059475:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5288 00000100:00100000:0.0:1746144646.059491:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5289 00000100:00100000:0.0:1746144646.059496:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746228224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.059502:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.059509:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135757200/0xa7c849b16e0179a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d444 expref: 24 pid: 4760 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144646.059517:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135757200/0xa7c849b16e0179a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d444 expref: 24 pid: 4760 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144646.059528:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135757200/0xa7c849b16e0179a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d444 expref: 24 pid: 4760 timeout: 725 lvb_type: 1 00010000:00010000:0.0:1746144646.059537:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.059551:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746228224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.059557:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5289 00000100:00100000:0.0:1746144646.059617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.059631:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746228480 00000100:00100000:0.0:1746144646.059633:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746228480 00010000:00010000:0.0:1746144646.059644:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e487e00/0xa7c849b16e017956 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d421 expref: 10 pid: 4760 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.059661:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5290 00000100:00100000:0.0:1746144646.059665:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746228480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.059671:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.059677:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e487e00/0xa7c849b16e017956 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d421 expref: 10 pid: 4760 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.059685:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e487e00/0xa7c849b16e017956 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d421 expref: 10 pid: 4760 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.059696:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e487e00/0xa7c849b16e017956 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d421 expref: 10 pid: 4760 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.059705:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.059707:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.059713:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.059727:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.059761:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144646.059773:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747313024:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144646.059827:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.066192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.072555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.076637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.090145:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.090174:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746229632 00000100:00100000:0.0:1746144646.090182:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746229632 00002000:00100000:0.0:1746144646.090222:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1101824->1105919) req@ffff880092935500 x1830964746229632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:287/0 lens 488/0 e 0 to 0 dl 1746144657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.090231:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935500 with x1830964746229632 ext(1101824->1105919) 00002000:00010000:0.0:1746144646.090237:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092935500 00000100:00100000:0.0:1746144646.090255:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3912 00000100:00100000:0.0:1746144646.090261:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746229632:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144646.090447:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746229632:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 185us (323us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144646.090454:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3912 00002000:00100000:0.0:1746144646.090459:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1101824->1105919) req@ffff880092935500 x1830964746229632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746144657 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.090465:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935500 with x1830964746229632 ext(1101824->1105919) 00002000:00010000:0.0:1746144646.090468:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092935500 00000100:00100000:0.0:1746144646.094461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.094492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.094552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.094597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.094649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144646.098549:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144645 -> 1746144646 00002000:00010000:0.0:1746144646.098556:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144645 -> 1746144646 00002000:00010000:0.0:1746144646.098558:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144645 -> 1746144646 00000100:00100000:0.0:1746144646.098584:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747313664:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144646.098632:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e41ce00/0xa7c849b16e017b78 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5da expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.098644:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e41ce00/0xa7c849b16e017b78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5da expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.098657:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41ce00, rc 0) 00000100:00100000:0.0:1746144646.098696:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746229760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3942us (4242us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144646.098704:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10763 00000100:00100000:0.0:1746144646.098757:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747313920:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144646.098771:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e487800/0xa7c849b16e017b86 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5e8 expref: 12 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.098778:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e487800/0xa7c849b16e017b86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5e8 expref: 12 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.098785:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e487800, rc 0) 00000100:00100000:0.0:1746144646.098797:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746230016:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3833us (4245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144646.098801:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10765 00000100:00100000:0.0:1746144646.106538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.108089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.118826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.118885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.122276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.122301:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746231168 00000100:00100000:0.0:1746144646.122308:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746231168 00002000:00100000:0.0:1746144646.122346:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c7800 x1830964746231168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:287/0 lens 488/0 e 0 to 0 dl 1746144657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.122356:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7800 with x1830964746231168 ext(3145728->4194303) 00002000:00010000:0.0:1746144646.122373:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c7800 00000100:00100000:0.0:1746144646.122391:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3914 00000100:00100000:0.0:1746144646.122398:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746231168:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144646.135156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.135190:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746231296 00000100:00100000:0.0:1746144646.135197:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746231296 00010000:00010000:0.0:1746144646.135225:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 28 pid: 4760 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.135251:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5294 00000100:00100000:0.0:1746144646.135258:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746231296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.135272:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.135291:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 28 pid: 4760 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.135302:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 28 pid: 4760 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.135324:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b060400/0xa7c849b16e017b63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5c5 expref: 28 pid: 4760 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.135343:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.135345:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.135353:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e41da00/0xa7c849b16e017b9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5fd expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.135373:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41da00/0xa7c849b16e017b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5fd expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.135408:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e41da00/0xa7c849b16e017b9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5fd expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144646.135420:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747314304:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144646.135474:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.142009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.142110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.152187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.159745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.163491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.168314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.172574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.187249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.190840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.191827:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+12:28594:x1830964746232704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4363us (4588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.191834:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10771 00000100:00100000:0.0:1746144646.212553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.226902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.239194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.239218:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746233344 00000100:00100000:0.0:1746144646.239226:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746233344 00000100:00100000:0.0:1746144646.239267:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10772 00000100:00100000:0.0:1746144646.239274:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:28600:x1830964746233344:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144646.239292:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.239310:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d619 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.239364:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e41d800/0xa7c849b16e017b6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5cc expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.239374:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.239381:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144646.239382:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144646.239386:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4161535] (req 3960832->4161535) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.239413:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.239424:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 12 pid: 8450 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.239436:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747314944:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144646.239488:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e41d800/0xa7c849b16e017b6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5cc expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.239495:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e41d800/0xa7c849b16e017b6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5cc expref: 28 pid: 4760 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.239502:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747315072:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144646.239518:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.251608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.251635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.251697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.251740:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747314944:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144646.251748:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747315072:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144646.251770:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->4161535] (req 3960832->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.251786:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b060600, rc 0) 00000100:00100000:0.0:1746144646.251818:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:28600:x1830964746233344:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 12545us (12634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.251826:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10772 00000100:00100000:0.0:1746144646.251845:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746233728 00000100:00100000:0.0:1746144646.251850:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746233728 00000100:00100000:0.0:1746144646.251870:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10773 00000100:00100000:0.0:1746144646.251875:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+12:28594:x1830964746233728:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144646.251886:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.251897:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2dc800/0xa7c849b16e017bbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d620 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.251912:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.251914:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.251920:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2dc800/0xa7c849b16e017bbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d620 expref: 13 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.251931:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2dc800/0xa7c849b16e017bbe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d620 expref: 13 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.251938:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2dc800, rc 0) 00000100:00100000:0.0:1746144646.251952:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:28594:x1830964746233728:12345-192.168.204.23@tcp:101:cat.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.251956:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10773 00000100:00100000:0.0:1746144646.251972:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746233472 00000100:00100000:0.0:1746144646.251975:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746233472 00010000:00010000:0.0:1746144646.251986:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 13 pid: 8450 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.252002:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746233600 00000100:00100000:0.0:1746144646.252004:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746233600 00010000:00010000:0.0:1746144646.252012:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41d800/0xa7c849b16e017b6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d5cc expref: 28 pid: 4760 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.252026:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5297 00000100:00100000:0.0:1746144646.252030:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746233472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.252038:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.252056:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 13 pid: 8450 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.252065:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 13 pid: 8450 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.252079:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e017b24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4046848->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d586 expref: 13 pid: 8450 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.252088:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.252103:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746233472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 72us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.252109:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5297 00000100:00100000:0.0:1746144646.257999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.258092:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747315200:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144646.258107:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.258154:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746233600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6094us (6517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.258163:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5298 00000100:00100000:0.0:1746144646.263521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.263550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.263572:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746234368 00000100:00100000:0.0:1746144646.263578:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746234368 00002000:00100000:0.0:1746144646.263608:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee09180 x1830964746234368/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:287/0 lens 488/0 e 0 to 0 dl 1746144657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.263616:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09180 with x1830964746234368 ext(2097152->3145727) 00002000:00010000:0.0:1746144646.263621:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee09180 00000100:00100000:0.0:1746144646.263635:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746234496 00000100:00100000:0.0:1746144646.263637:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746234496 00002000:00100000:0.0:1746144646.263646:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008b9a1180 x1830964746234496/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:287/0 lens 488/0 e 0 to 0 dl 1746144657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.263652:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a1180 with x1830964746234496 ext(2097152->3145727) 00002000:00010000:0.0:1746144646.263655:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a1180 00000100:00100000:0.0:1746144646.263667:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3920 00000100:00100000:0.0:1746144646.263673:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+39:1963:x1830964746234368:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144646.264177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.264195:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746234752 00000100:00100000:0.0:1746144646.264197:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746234752 00002000:00100000:0.0:1746144646.264213:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4157440->4161535) req@ffff88008b9a0e00 x1830964746234752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:287/0 lens 488/0 e 0 to 0 dl 1746144657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.264219:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0e00 with x1830964746234752 ext(4157440->4161535) 00002000:00010000:0.0:1746144646.264223:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0e00 00000100:00100000:0.0:1746144646.264234:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3922 00000100:00100000:0.0:1746144646.264239:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746234752:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144646.264344:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746234752:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 104us (167us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144646.264350:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3922 00002000:00100000:0.0:1746144646.264354:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4157440->4161535) req@ffff88008b9a0e00 x1830964746234752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:287/0 lens 488/4536 e 0 to 0 dl 1746144657 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.264377:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0e00 with x1830964746234752 ext(4157440->4161535) 00002000:00010000:0.0:1746144646.264379:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0e00 00000100:00100000:0.0:1746144646.302598:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746234880 00000100:00100000:0.0:1746144646.302608:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746234880 00000100:00100000:0.0:1746144646.302659:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10774 00000100:00100000:0.0:1746144646.302668:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:28594:x1830964746234880:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144646.302687:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.302707:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0xa7c849b16e017bc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d627 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.302739:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->18446744073709551615] (req 3960832->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.302747:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144646.302749:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144646.302753:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0xa7c849b16e017bc5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d627 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.302784:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->18446744073709551615] (req 3960832->4161535) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.302796:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->18446744073709551615] (req 3960832->4161535) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 26 pid: 29370 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.302808:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747315328:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144646.304185:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.309762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.309820:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746235008 00000100:00100000:0.0:1746144646.309831:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746235008 00002000:00100000:0.0:1746144646.309887:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3960832->4161535) req@ffff88008b9a1f80 x1830964746235008/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:287/0 lens 488/0 e 0 to 0 dl 1746144657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.309899:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a1f80 with x1830964746235008 ext(3960832->4161535) 00010000:00010000:0.0:1746144646.309910:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->18446744073709551615] (req 3960832->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 27 pid: 29370 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.309926:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->18446744073709551615] (req 3960832->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 27 pid: 29370 timeout: 725 lvb_type: 0 00002000:00010000:0.0:1746144646.309933:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a1f80 00000100:00100000:0.0:1746144646.309990:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 733 00000100:00100000:0.0:1746144646.310001:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746235008:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144646.310385:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747315328:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144646.310415:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f385600/0xa7c849b16e017bc5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d627 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.310433:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f385600, rc 0) 00000100:00100000:0.0:1746144646.310468:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:28594:x1830964746234880:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7798us (7962us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.310476:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10774 00000100:00100000:0.0:1746144646.325827:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746235136 00000100:00100000:0.0:1746144646.325840:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746235136 00010000:00010000:0.0:1746144646.325880:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060600/0xa7c849b16e017bb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3960832->18446744073709551615] (req 3960832->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d619 expref: 29 pid: 29370 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.394935:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746235904 00000100:00100000:0.0:1746144646.394943:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746235904 00000100:00100000:0.0:1746144646.395007:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746236032 00000100:00100000:0.0:1746144646.395010:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746236032 00000100:00100000:0.0:1746144646.395030:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10777 00000100:00100000:0.0:1746144646.395036:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746236032:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144646.395044:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.395057:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cf71c00/0xa7c849b16e017bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d63c expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.395072:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.395074:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.395080:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf71c00/0xa7c849b16e017bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d63c expref: 31 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.395091:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cf71c00/0xa7c849b16e017bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d63c expref: 31 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.395100:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf71c00, rc 0) 00000100:00100000:0.0:1746144646.395541:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746236032:12345-192.168.204.23@tcp:101:cat.0 Request processed in 503us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.395547:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10777 00000100:00100000:0.0:1746144646.399712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.406179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.406210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.406228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.430674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.438225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.439805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.442971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.447665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.452587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.456547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.463977:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747316352:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144646.464011:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.464069:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746238336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3765us (4577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.464082:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5303 00000100:00100000:0.0:1746144646.470405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.474369:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093760e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747316480:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144646.474393:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.474449:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746238720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3861us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.474460:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5304 00000100:00100000:0.0:1746144646.513998:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746239104 00000100:00100000:0.0:1746144646.514008:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746239104 00000100:00100000:0.0:1746144646.514059:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10781 00000100:00100000:0.0:1746144646.514068:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:28604:x1830964746239104:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144646.514087:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.514106:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d658 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.514131:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.514162:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.514170:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d658 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.514191:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d658 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.514203:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d8be400, rc 0) 00000100:00100000:0.0:1746144646.514255:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:28604:x1830964746239104:12345-192.168.204.23@tcp:101:cat.0 Request processed in 188us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.514262:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10781 00000100:00100000:0.0:1746144646.523300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.523369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.549319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.558122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.568259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.578662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.585322:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747316864:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144646.585347:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.585412:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746240128:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6535us (6766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.585422:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5305 00000100:00100000:0.0:1746144646.589267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.611525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.618332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.621475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.628032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.628723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.636393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.636450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.644634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.644713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.644746:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746241792 00000100:00100000:0.0:1746144646.644751:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746241792 00010000:00010000:0.0:1746144646.645237:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e487a00/0xa7c849b16e017ba9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d60b expref: 10 pid: 29370 timeout: 725 lvb_type: 0 00000100:00100000:0.0:1746144646.650671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.650697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.650716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.650761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.650788:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746242176 00000100:00100000:0.0:1746144646.650792:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746242176 00000100:00100000:0.0:1746144646.650899:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10788 00000100:00100000:0.0:1746144646.650905:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746242048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144646.650914:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.650923:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f380c00/0xa7c849b16e017c27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d689 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144646.650947:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f272d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747318016:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144646.650968:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.650982:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10790 00000100:00100000:0.0:1746144646.650987:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746242176:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144646.650992:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.650999:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f62f200/0xa7c849b16e017c35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d690 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.651012:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.651014:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.651018:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f62f200/0xa7c849b16e017c35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d690 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.651028:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f62f200/0xa7c849b16e017c35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d690 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.651034:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62f200, rc 0) 00000100:00100000:0.0:1746144646.651046:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746242176:12345-192.168.204.23@tcp:101:cat.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.651052:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10790 00000100:00100000:0.0:1746144646.655447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.655791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.656787:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.658629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.666059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.666109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.668684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.671131:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746243456:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4820us (5013us total) trans 17179873032 rc 0/0 00000100:00100000:0.0:1746144646.671156:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 739 00002000:00100000:0.0:1746144646.671164:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (602112->1048575) req@ffff88009f270a80 x1830964746243456/t17179873032(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:287/0 lens 488/448 e 0 to 0 dl 1746144657 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144646.671171:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f270a80 with x1830964746243456 ext(602112->1048575) 00010000:00010000:0.0:1746144646.671180:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e3a4e00/0xa7c849b16e017c12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d674 expref: 18 pid: 8389 timeout: 725 lvb_type: 0 00010000:00010000:0.0:1746144646.671191:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e3a4e00/0xa7c849b16e017c12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 602112->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d674 expref: 18 pid: 8389 timeout: 725 lvb_type: 0 00002000:00010000:0.0:1746144646.671195:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f270a80 00000100:00100000:0.0:1746144646.673932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.679969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.680981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.686955:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747318656:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144646.686981:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.687038:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746244224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5867us (6056us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.687048:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5312 00000100:00100000:0.0:1746144646.687384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.693098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.716227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.716310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.716359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.741855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.768379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.771547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.773976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.774058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.774096:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746246528 00000100:00100000:0.0:1746144646.774103:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746246528 00000100:00100000:0.0:1746144646.777538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.784232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.784282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.784309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.784882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.784899:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746246912 00000100:00100000:0.0:1746144646.784901:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746246912 00000100:00100000:0.0:1746144646.784917:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10794 00000100:00100000:0.0:1746144646.784921:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746247040:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144646.784933:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.784952:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d6c1 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.784975:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.784976:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.784989:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c1 expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.784999:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c1 expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.785009:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87600, rc 0) 00000100:00100000:0.0:1746144646.785591:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746247040:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 667us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.785596:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10794 00000100:00100000:0.0:1746144646.785690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.785701:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746247424 00000100:00100000:0.0:1746144646.785704:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746247424 00000100:00100000:0.0:1746144646.785719:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10798 00000100:00100000:0.0:1746144646.785722:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746247424:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144646.785728:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.785734:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd86400/0xa7c849b16e017c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d6d6 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.785743:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.785744:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.785749:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd86400/0xa7c849b16e017c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6d6 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.785757:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd86400/0xa7c849b16e017c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6d6 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.785763:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd86400, rc 0) 00000100:00100000:0.0:1746144646.785775:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746247424:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 52us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.785780:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10798 00000100:00100000:0.0:1746144646.791633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.795864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.798658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.800814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.802790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.807540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.811400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.811438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.811511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.811579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.812047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.812060:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746248960 00000100:00100000:0.0:1746144646.812063:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746248960 00000100:00100000:0.0:1746144646.812079:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10804 00000100:00100000:0.0:1746144646.812083:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746248960:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144646.812097:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87c00/0xa7c849b16e017ce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.812105:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e487400/0xa7c849b16e017bb0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d612 expref: 16 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.812111:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e017c82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c8 expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.812118:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5344000/0xa7c849b16e017bd3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d635 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.812122:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.812123:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.812125:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87c00/0xa7c849b16e017ce4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.812156:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5344000/0xa7c849b16e017bd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d635 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.812696:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5344000/0xa7c849b16e017bd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d635 expref: 31 pid: 8450 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1746144646.812710:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747320064:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144646.812738:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e017c82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c8 expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.812746:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e017c82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c8 expref: 10 pid: 8389 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1746144646.812754:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747320704:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144646.812799:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e487400/0xa7c849b16e017bb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d612 expref: 16 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.812807:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e487400/0xa7c849b16e017bb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d612 expref: 16 pid: 29370 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144646.812814:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747320832:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144646.812826:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144646.812901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.822722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.822752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.822764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.822780:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746249344 00000100:00100000:0.0:1746144646.822782:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746249344 00010000:00010000:0.0:1746144646.822803:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d658 expref: 32 pid: 29370 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144646.822831:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746249600 00000100:00100000:0.0:1746144646.822833:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746249600 00010000:00010000:0.0:1746144646.822843:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c1 expref: 10 pid: 30345 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1746144646.822857:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5317 00000100:00100000:0.0:1746144646.822864:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746249344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.822877:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.822904:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d658 expref: 32 pid: 29370 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144646.822915:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d658 expref: 32 pid: 29370 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144646.822942:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e017bf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d658 expref: 32 pid: 29370 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144646.822963:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.823008:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746249344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.823015:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5317 00000100:00100000:0.0:1746144646.823059:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5318 00000100:00100000:0.0:1746144646.823063:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746249600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.823070:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.823085:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c1 expref: 10 pid: 30345 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144646.823094:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c1 expref: 10 pid: 30345 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144646.823108:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd87600/0xa7c849b16e017c66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d6c1 expref: 10 pid: 30345 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144646.823117:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.823130:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746249600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.823160:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5318 00000100:00100000:0.0:1746144646.823187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.823199:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746250368 00000100:00100000:0.0:1746144646.823202:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746250368 00010000:00010000:0.0:1746144646.823212:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7ada00/0xa7c849b16e017c3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d69e expref: 17 pid: 4760 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144646.823224:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5319 00000100:00100000:0.0:1746144646.823227:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746250368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144646.823232:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144646.823241:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d7ada00/0xa7c849b16e017c3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d69e expref: 17 pid: 4760 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144646.823249:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d7ada00/0xa7c849b16e017c3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d69e expref: 17 pid: 4760 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144646.823264:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7ada00/0xa7c849b16e017c3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d69e expref: 17 pid: 4760 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144646.823271:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144646.823283:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746250368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 55us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.823287:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5319 00000100:00100000:0.0:1746144646.827909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.827995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.835290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.839924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.844434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.844613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.845581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.845609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.845623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.845643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.847482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144646.847699:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f124400/0xa7c849b16e017cf9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144646.847706:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f124400/0xa7c849b16e017cf9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000001:00080000:0.0:1746144646.881516:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943680 is committed 00000001:00080000:0.0:1746144646.881526:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943671 is committed 00000001:00080000:0.0:1746144646.881532:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943694 is committed 00000004:00080000:0.0:1746144646.881537:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1881 committed 00000004:00080000:0.0:1746144646.881556:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1940 committed 00000004:00080000:0.0:1746144646.881562:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1939 committed 00000004:00080000:0.0:1746144646.881564:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1938 committed 00000004:00080000:0.0:1746144646.881566:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1937 committed 00000004:00080000:0.0:1746144646.881568:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1880 committed 00000004:00080000:0.0:1746144646.881569:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1936 committed 00000004:00080000:0.0:1746144646.881570:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1879 committed 00000004:00080000:0.0:1746144646.881572:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1935 committed 00000004:00080000:0.0:1746144646.881573:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1878 committed 00000004:00080000:0.0:1746144646.881577:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1877 committed 00000004:00080000:0.0:1746144646.881578:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1876 committed 00000004:00080000:0.0:1746144646.881580:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1934 committed 00000004:00080000:0.0:1746144646.881581:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1933 committed 00000004:00080000:0.0:1746144646.881583:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1875 committed 00000004:00080000:0.0:1746144646.881584:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1874 committed 00000004:00080000:0.0:1746144646.881586:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1932 committed 00000001:00080000:0.0:1746144646.881590:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943693 is committed 00000001:00080000:0.0:1746144646.881593:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943690 is committed 00000100:00100000:0.0:1746144646.883446:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840268 gen 2 00000004:00080000:0.0:1746144646.883451:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f480, transno 21474840213 00000004:00080000:0.0:1746144646.883457:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f100, transno 21474840214 00000004:00080000:0.0:1746144646.883460:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33d880, transno 21474840215 00000004:00080000:0.0:1746144646.883462:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ed80, transno 21474840216 00000004:00080000:0.0:1746144646.883464:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33d180, transno 21474840217 00000004:00080000:0.0:1746144646.883465:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33dc00, transno 21474840218 00000004:00080000:0.0:1746144646.883468:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33e300, transno 21474840219 00000004:00080000:0.0:1746144646.883470:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f800, transno 21474840220 00000004:00080000:0.0:1746144646.883472:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a0380, transno 21474840224 00000004:00080000:0.0:1746144646.883475:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e875880, transno 21474840225 00000004:00080000:0.0:1746144646.883478:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e877b80, transno 21474840226 00000004:00080000:0.0:1746144646.883479:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e876300, transno 21474840227 00000004:00080000:0.0:1746144646.883482:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e877100, transno 21474840228 00000004:00080000:0.0:1746144646.883484:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e876680, transno 21474840229 00000004:00080000:0.0:1746144646.883486:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e875c00, transno 21474840230 00000004:00080000:0.0:1746144646.883488:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e874700, transno 21474840231 00000004:00080000:0.0:1746144646.883490:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39bb80, transno 21474840232 00000004:00080000:0.0:1746144646.883492:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136448380, transno 21474840233 00000004:00080000:0.0:1746144646.883494:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c946a00, transno 21474840234 00000004:00080000:0.0:1746144646.883497:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c4e00, transno 21474840235 00000004:00080000:0.0:1746144646.883499:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136449c00, transno 21474840236 00000004:00080000:0.0:1746144646.883501:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f399180, transno 21474840237 00000004:00080000:0.0:1746144646.883503:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136448700, transno 21474840238 00000004:00080000:0.0:1746144646.883505:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39ad80, transno 21474840239 00000004:00080000:0.0:1746144646.883508:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed13100, transno 21474840253 00000004:00080000:0.0:1746144646.883510:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed11180, transno 21474840254 00000004:00080000:0.0:1746144646.883512:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed10000, transno 21474840255 00000004:00080000:0.0:1746144646.883514:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed13800, transno 21474840256 00000004:00080000:0.0:1746144646.883517:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed11f80, transno 21474840257 00000004:00080000:0.0:1746144646.883519:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed10a80, transno 21474840258 00000004:00080000:0.0:1746144646.883521:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed11500, transno 21474840259 00000004:00080000:0.0:1746144646.883523:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed11c00, transno 21474840260 00000004:00080000:0.0:1746144646.883525:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce85c00, transno 21474840261 00000004:00080000:0.0:1746144646.883528:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013129ce00, transno 21474840262 00000004:00080000:0.0:1746144646.883530:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce84000, transno 21474840263 00000004:00080000:0.0:1746144646.883532:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce86680, transno 21474840264 00000004:00080000:0.0:1746144646.883534:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013129d180, transno 21474840265 00000004:00080000:0.0:1746144646.883536:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013129c700, transno 21474840266 00000004:00080000:0.0:1746144646.883538:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013129d500, transno 21474840267 00000004:00080000:0.0:1746144646.883540:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092934000, transno 21474840268 00000100:00100000:0.0:1746144646.883548:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88013644a680 x1830964747322880/t21474840286(21474840286) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144662 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746144646.883558:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644a680/2, rc 0, transno 21474840286 00000100:00100000:0.0:1746144646.883562:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747322880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144646.883567:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747323392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144646.883589:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.883604:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747323904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144646.883617:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.883627:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747324416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144646.883639:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.883653:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746144646.883657:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747322752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144646.883669:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.883685:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747323264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144646.883700:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.883710:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747323776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144646.883723:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.883734:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747324288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144646.883746:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144646.884889:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10813 00000100:00100000:0.0:1746144646.885310:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747323264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144646.886328:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3296:x1830964747323264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1431us (2624us total) trans 21474840291 rc 0/0 00000100:00100000:0.0:1746144646.886334:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10813 00000100:00100000:0.0:1746144646.886356:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10818 00000100:00100000:0.0:1746144646.886361:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747323520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144646.887491:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747323520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1129us (3506us total) trans 21474840293 rc 0/0 00000100:00100000:0.0:1746144646.887497:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10818 00000100:00100000:0.0:1746144646.887584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000004:00080000:0.0:1746144646.888681:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 40 done 00000100:00100000:0.0:1746144646.891628:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747324672 00000100:00100000:0.0:1746144646.891636:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747324672 00000100:00100000:0.0:1746144646.891814:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10822 00000100:00100000:0.0:1746144646.891821:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747324672:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144646.893228:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f437480/2, rc 0, transno 17179873041 00000100:00100000:0.0:1746144646.893234:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747324672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144646.894907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.902940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.902979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.903002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.903017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.903032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.903075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.903099:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746253312 00000100:00100000:0.0:1746144646.903107:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746253312 00000100:00100000:0.0:1746144646.904035:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746253440 00000100:00100000:0.0:1746144646.904039:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746253440 00000100:00100000:0.0:1746144646.904523:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10827 00000100:00100000:0.0:1746144646.904626:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746253696:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144646.904633:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144646.904644:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb00000/0xa7c849b16e017d31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d71c expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144646.904655:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d86, atime: 0x68140d86, ctime: 0x68140d86, blocks: 0x821 00010000:00010000:0.0:1746144646.904663:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.904664:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.904669:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb00000/0xa7c849b16e017d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d71c expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.904930:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eb00000/0xa7c849b16e017d31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d71c expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144646.904936:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb00000, rc 0) 00000100:00100000:0.0:1746144646.904951:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746253696:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 326us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144646.904955:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10827 00000100:00100000:0.0:1746144646.914981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.919955:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3945 00000100:00100000:0.0:1746144646.919964:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746254720:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144646.919980:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b50d800/0xa7c849b16e017d4d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.919989:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.919991:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.919994:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b50d800/0xa7c849b16e017d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.920002:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b50d800/0xa7c849b16e017d4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144646.926842:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3948 00000100:00100000:0.0:1746144646.926854:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746255488:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144646.926874:0:31507:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7fa00/0xa7c849b16e017d69 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.926882:0:31507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.926883:0:31507:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144646.926886:0:31507:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7fa00/0xa7c849b16e017d69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31507 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144646.926895:0:31507:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7fa00/0xa7c849b16e017d69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31507 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144646.974354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.975888:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.978071:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746256896 00000100:00100000:0.0:1746144646.978075:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746256896 00000100:00100000:0.0:1746144646.978092:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746256768 00000100:00100000:0.0:1746144646.978094:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746256768 00000100:00100000:0.0:1746144646.978103:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746257024 00000100:00100000:0.0:1746144646.978104:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746257024 00000100:00100000:0.0:1746144646.978115:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10832 00000100:00100000:0.0:1746144646.978120:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746256896:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144646.978267:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:0.0:1746144646.978270:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144646.978272:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144646 -> 1746144647 00002000:00010000:0.0:1746144646.978275:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144646.978277:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5611 00000100:00100000:0.0:1746144646.978294:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746256896:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 173us (1028us total) trans 17179873044 rc 0/0 00000100:00100000:0.0:1746144646.978300:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10832 00000100:00100000:0.0:1746144646.980658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144646.983216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144646.984648:0:14712:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f33f000/0xa7c849b16e017d7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00010000:00010000:0.0:1746144646.984655:0:14712:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f33f000/0xa7c849b16e017d7e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00000040:00080000:0.0:1746144646.986585:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2758, 88 off229640 00000004:00080000:0.0:1746144646.986600:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626195464969ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.987993:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2695, 88 off224088 00000004:00080000:0.0:1746144646.988002:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196867066ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988023:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2696, 88 off224176 00000004:00080000:0.0:1746144646.988026:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196891728ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988039:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2759, 88 off229728 00000004:00080000:0.0:1746144646.988043:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626196908981ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988050:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2760, 88 off229816 00000004:00080000:0.0:1746144646.988053:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626196917941ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988059:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2697, 88 off224264 00000004:00080000:0.0:1746144646.988062:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196927223ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988068:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2698, 88 off224352 00000004:00080000:0.0:1746144646.988071:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196936051ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988077:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2699, 88 off224440 00000004:00080000:0.0:1746144646.988081:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196946333ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988087:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2761, 88 off229904 00000004:00080000:0.0:1746144646.988089:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626196954666ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988095:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2700, 88 off224528 00000004:00080000:0.0:1746144646.988098:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196963221ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988104:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2762, 88 off229992 00000004:00080000:0.0:1746144646.988107:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626196972601ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988114:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2701, 88 off224616 00000004:00080000:0.0:1746144646.988116:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626196981436ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144646.988122:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2763, 88 off230080 00000004:00080000:0.0:1746144646.988124:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626196990003ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988130:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2764, 88 off230168 00000004:00080000:0.0:1746144646.988148:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626197013496ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988156:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2765, 88 off230256 00000004:00080000:0.0:1746144646.988159:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626197024796ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988166:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2766, 88 off230344 00000004:00080000:0.0:1746144646.988168:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 626197034076ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144646.988175:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2702, 88 off224704 00000004:00080000:0.0:1746144646.988178:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626197043156ns, next at 593480289301ns, rc = 0 00000001:00080000:0.0:1746144647.014177:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943696 is committed 00000004:00080000:0.0:1746144647.014189:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:0.0:1746144647.014196:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1949 committed 00000004:00080000:0.0:1746144647.014203:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1948 committed 00000004:00080000:0.0:1746144647.014204:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1947 committed 00000004:00080000:0.0:1746144647.014207:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1946 committed 00000004:00080000:0.0:1746144647.014208:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:0.0:1746144647.014209:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1945 committed 00000004:00080000:0.0:1746144647.014211:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000004:00080000:0.0:1746144647.014214:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1944 committed 00000004:00080000:0.0:1746144647.014215:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1886 committed 00000004:00080000:0.0:1746144647.014217:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1885 committed 00000004:00080000:0.0:1746144647.014219:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1884 committed 00000004:00080000:0.0:1746144647.014220:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1943 committed 00000004:00080000:0.0:1746144647.014222:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1942 committed 00000004:00080000:0.0:1746144647.014223:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1883 committed 00000004:00080000:0.0:1746144647.014225:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1882 committed 00000004:00080000:0.0:1746144647.014227:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1941 committed 00000100:00100000:0.0:1746144647.014862:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747325184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144647.014887:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.014906:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747325696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.014920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.014931:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747326208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.014944:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.014955:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747326720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.014967:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144647.016935:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136958000/2, rc 0, transno 21474840300 00000100:00100000:0.0:1746144647.016942:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747325184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144647.016952:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33f800/2, rc 0, transno 17179873045 00000100:00100000:0.0:1746144647.016961:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747325696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144647.016967:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33c000/2, rc 0, transno 17179873046 00000100:00100000:0.0:1746144647.016970:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747326208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.017699:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747325952 00000100:00100000:0.0:1746144647.017703:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747325952 00000100:00100000:0.0:1746144647.017726:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10842 00000100:00100000:0.0:1746144647.017732:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1830964747324928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144647.017846:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144647.017849:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144647.017851:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144647.017853:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144647.017854:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746144647.017879:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3295:x1830964747324928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (515us total) trans 21474840301 rc 0/0 00000100:00100000:0.0:1746144647.017885:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10842 00000100:00100000:0.0:1746144647.017897:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10845 00000100:00100000:0.0:1746144647.017901:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1830964747326464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.017978:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3295:x1830964747326464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (504us total) trans 17179873049 rc 0/0 00000100:00100000:0.0:1746144647.017983:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10845 00000100:00100000:0.0:1746144647.017992:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747325312 00000100:00100000:0.0:1746144647.017994:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747325312 00000100:00100000:0.0:1746144647.018003:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747326336 00000100:00100000:0.0:1746144647.018005:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747326336 00000100:00100000:0.0:1746144647.018011:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747326848 00000100:00100000:0.0:1746144647.018013:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747326848 00000100:00100000:0.0:1746144647.018687:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10847 00000100:00100000:0.0:1746144647.018693:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3294:x1830964747326336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144647.018784:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830964747326336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (821us total) trans 21474840302 rc 0/0 00000100:00100000:0.0:1746144647.018790:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10847 00000100:00100000:0.0:1746144647.018799:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10849 00000100:00100000:0.0:1746144647.018804:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830964747326848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.018880:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3294:x1830964747326848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (891us total) trans 17179873051 rc 0/0 00000100:00100000:0.0:1746144647.018885:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10849 00000004:00080000:0.0:1746144647.018955:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d0c4a80/2, rc 0, transno 17179873047 00000100:00100000:0.0:1746144647.018960:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747326720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.023242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.045932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.048863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.052919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.054190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.054251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.054268:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746258560 00000100:00100000:0.0:1746144647.054272:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746258560 00000100:00100000:0.0:1746144647.054297:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10853 00000100:00100000:0.0:1746144647.054302:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:28631:x1830964746258560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144647.054309:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.054317:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d74d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.054329:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.054330:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.054334:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d74d expref: 14 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.054943:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d74d expref: 14 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.054956:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed33a00, rc 0) 00000100:00100000:0.0:1746144647.054973:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:28631:x1830964746258560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 671us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.054978:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10853 00000100:00100000:0.0:1746144647.062205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.062256:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.062285:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746259072 00000100:00100000:0.0:1746144647.062293:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746259072 00010000:00010000:0.0:1746144647.062332:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d000/0xa7c849b16e017db6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d73f expref: 298 pid: 14710 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144647.062378:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746258944 00000100:00100000:0.0:1746144647.062381:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746258944 00010000:00010000:0.0:1746144647.062393:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e017dbd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d738 expref: 10 pid: 20319 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144647.062410:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5342 00000100:00100000:0.0:1746144647.062416:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1963:x1830964746259072:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.062430:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.062435:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d000/0xa7c849b16e017db6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d73f expref: 298 pid: 14710 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.062445:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d000/0xa7c849b16e017db6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d73f expref: 298 pid: 14710 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.062466:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.062472:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1200/0xa7c849b16e017de7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144647.062479:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1200/0xa7c849b16e017de7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144647.062484:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.062522:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1963:x1830964746259072:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.062528:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5342 00000100:00100000:0.0:1746144647.062541:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5343 00000100:00100000:0.0:1746144647.062546:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746258944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.062552:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.062555:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e017dbd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d738 expref: 10 pid: 20319 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.062563:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e017dbd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d738 expref: 10 pid: 20319 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.062778:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e017dbd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d738 expref: 10 pid: 20319 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.062793:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.062796:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1200/0xa7c849b16e017de7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144647.062808:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1200/0xa7c849b16e017de7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144647.062814:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1200/0xa7c849b16e017de7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144647.062961:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.062978:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746258944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 431us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.062984:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5343 00000100:00100000:0.0:1746144647.068532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.068590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.071326:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746259968 00000100:00100000:0.0:1746144647.071332:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746259968 00002000:00100000:0.0:1746144647.071370:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4b63100 x1830964746259968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.071379:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63100 with x1830964746259968 ext(0->1048575) 00002000:00010000:0.0:1746144647.071384:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b63100 00000100:00100000:0.0:1746144647.071409:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3952 00000100:00100000:0.0:1746144647.071415:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746259968:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144647.072408:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746260096 00000100:00100000:0.0:1746144647.072412:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746260096 00010000:00010000:0.0:1746144647.072428:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62da00/0xa7c849b16e017e03 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d769 expref: 300 pid: 15388 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144647.072445:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5344 00000100:00100000:0.0:1746144647.072450:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1962:x1830964746260096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.072457:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.072461:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62da00/0xa7c849b16e017e03 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d769 expref: 300 pid: 15388 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.073082:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62da00/0xa7c849b16e017e03 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d769 expref: 300 pid: 15388 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.073100:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.073103:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62dc00/0xa7c849b16e017e11 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.073109:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62dc00/0xa7c849b16e017e11 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.073114:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.073177:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1962:x1830964746260096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 725us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.073184:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5344 00000100:00100000:0.0:1746144647.076278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.076322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.077684:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746260480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 984us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.077690:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5345 00000100:00100000:0.0:1746144647.088997:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746259968:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 17573us (17799us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144647.089009:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3952 00002000:00100000:0.0:1746144647.089021:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4b63100 x1830964746259968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.089030:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63100 with x1830964746259968 ext(0->1048575) 00002000:00010000:0.0:1746144647.089036:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b63100 00000100:00100000:0.0:1746144647.097949:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144647.098409:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144647.105065:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746261120 00000100:00100000:0.0:1746144647.105074:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746261120 00000100:00100000:0.0:1746144647.105124:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9872 00000100:00100000:0.0:1746144647.105131:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28632:x1830964746261120:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144647.105167:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.105190:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e017e2d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d78c expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144647.107832:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943700 is committed 00000001:00080000:0.0:1746144647.107844:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943698 is committed 00000001:00080000:0.0:1746144647.107848:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943697 is committed 00000001:00080000:0.0:1746144647.107854:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943701 is committed 00000004:00080000:0.0:1746144647.107858:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:0.0:1746144647.108009:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1958 committed 00000004:00080000:0.0:1746144647.108016:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1957 committed 00000004:00080000:0.0:1746144647.108018:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1956 committed 00000004:00080000:0.0:1746144647.108019:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1955 committed 00000004:00080000:0.0:1746144647.108021:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000004:00080000:0.0:1746144647.108023:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1954 committed 00000004:00080000:0.0:1746144647.108024:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:0.0:1746144647.108025:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1953 committed 00000004:00080000:0.0:1746144647.108027:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:0.0:1746144647.108028:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000004:00080000:0.0:1746144647.108029:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:0.0:1746144647.108031:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1952 committed 00000004:00080000:0.0:1746144647.108032:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1951 committed 00000004:00080000:0.0:1746144647.108033:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00080000:0.0:1746144647.108034:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000004:00080000:0.0:1746144647.108036:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1950 committed 00000100:00100000:0.0:1746144647.108182:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747327872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.108221:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.108243:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747328384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.108254:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.108264:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746144647.108267:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747328000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.108277:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.108285:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747328512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144647.108294:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144647.108313:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747327872 00000100:00100000:0.0:1746144647.108318:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747327872 00000100:00100000:0.0:1746144647.108336:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747328384 00000100:00100000:0.0:1746144647.108338:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747328384 00000100:00100000:0.0:1746144647.108357:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747328000 00000100:00100000:0.0:1746144647.108358:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747328000 00000100:00100000:0.0:1746144647.108367:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747328512 00000100:00100000:0.0:1746144647.108368:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747328512 00000100:00100000:0.0:1746144647.108377:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10856 00000100:00100000:0.0:1746144647.108381:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3293:x1830964747327872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144647.109505:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144647.109509:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144647.109511:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144647.109513:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144647 -> 1746144647 00002000:00010000:0.0:1746144647.109514:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144647.110253:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747327872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1870us (2030us total) trans 17179873060 rc 0/0 00000100:00100000:0.0:1746144647.110261:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10856 00000100:00100000:0.0:1746144647.111226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.111252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.114088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.116983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.117432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.122117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.124204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144647.124379:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144647.126646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.130926:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746262912 00000100:00100000:0.0:1746144647.130930:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746262912 00010000:00010000:0.0:1746144647.130949:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96be00/0xa7c849b16e017d1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d715 expref: 10 pid: 8453 timeout: 726 lvb_type: 1 00000100:00100000:0.0:1746144647.130971:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5348 00000100:00100000:0.0:1746144647.130977:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746262912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.130987:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.131006:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96be00/0xa7c849b16e017d1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d715 expref: 10 pid: 8453 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144647.131019:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96be00/0xa7c849b16e017d1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d715 expref: 10 pid: 8453 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144647.131219:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96be00/0xa7c849b16e017d1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d715 expref: 10 pid: 8453 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144647.131355:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.133796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.133842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.134972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.138562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.143722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.143771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.153718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.157491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.164276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.165125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.165371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.186054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.190831:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10880 00000100:00100000:0.0:1746144647.190839:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746265728:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144647.190848:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.190857:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f08f200/0xa7c849b16e017e65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d7bd expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.190871:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.190872:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.190881:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f08f200/0xa7c849b16e017e65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7bd expref: 16 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144647.190895:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f08f200/0xa7c849b16e017e65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7bd expref: 16 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144647.190911:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f08f200, rc 0) 00000100:00100000:0.0:1746144647.190933:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746265728:12345-192.168.204.23@tcp:101:cat.0 Request processed in 96us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.190939:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10880 00000100:00100000:0.0:1746144647.192461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.195618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.197719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.202083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.211867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.215005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.223089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.226309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.229547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.239795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.239831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.239851:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.239895:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746267648 00000100:00100000:0.0:1746144647.239904:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746267648 00002000:00100000:0.0:1746144647.239948:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f437b80 x1830964746267648/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.239958:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437b80 with x1830964746267648 ext(2097152->3145727) 00002000:00010000:0.0:1746144647.239964:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437b80 00000100:00100000:0.0:1746144647.239979:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746267904 00000100:00100000:0.0:1746144647.239981:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746267904 00002000:00100000:0.0:1746144647.239990:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f434a80 x1830964746267904/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.239998:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434a80 with x1830964746267904 ext(3145728->4194303) 00002000:00010000:0.0:1746144647.240000:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434a80 00000100:00100000:0.0:1746144647.240007:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746268160 00000100:00100000:0.0:1746144647.240009:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746268160 00002000:00100000:0.0:1746144647.240019:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f435500 x1830964746268160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.240026:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435500 with x1830964746268160 ext(3145728->4194303) 00002000:00010000:0.0:1746144647.240029:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435500 00000100:00100000:0.0:1746144647.240057:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3964 00000100:00100000:0.0:1746144647.240065:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746267648:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144647.248351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.256432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.256469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.256498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.256821:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746267904:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16723us (16987us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144647.256828:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3965 00002000:00100000:0.0:1746144647.256834:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f434a80 x1830964746267904/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.256842:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434a80 with x1830964746267904 ext(3145728->4194303) 00002000:00010000:0.0:1746144647.256846:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434a80 00000100:00100000:0.0:1746144647.256864:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3968 00000100:00100000:0.0:1746144647.256869:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746268800:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144647.268517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.272984:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.282632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.288202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.369581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.389251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.391801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.394876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.403932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.403980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.408905:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5355 00000100:00100000:0.0:1746144647.408915:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746271232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.408928:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.408948:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f08f200/0xa7c849b16e017e65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7bd expref: 18 pid: 7257 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144647.408960:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f08f200/0xa7c849b16e017e65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7bd expref: 18 pid: 7257 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144647.408980:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f08f200/0xa7c849b16e017e65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7bd expref: 18 pid: 7257 timeout: 726 lvb_type: 1 00010000:00010000:0.0:1746144647.409010:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.409012:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.409020:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.409033:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.409070:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144647.409081:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747332352:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144647.409191:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144647.411619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.414667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.420030:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3973 00000100:00100000:0.0:1746144647.420038:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746272256:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144647.420178:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746272256:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 141us (293us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144647.420183:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3973 00002000:00100000:0.0:1746144647.420188:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3084288->3088383) req@ffff88009b811880 x1830964746272256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.420195:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b811880 with x1830964746272256 ext(3084288->3088383) 00002000:00010000:0.0:1746144647.420198:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b811880 00000100:00100000:0.0:1746144647.424304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.424369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.424933:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.426711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.442446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.442512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.468678:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.473042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.474259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.474457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.474509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.474530:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746274688 00000100:00100000:0.0:1746144647.474534:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746274688 00002000:00100000:0.0:1746144647.474552:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2797568->3088383) req@ffff880093e31180 x1830964746274688/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.474563:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31180 with x1830964746274688 ext(2797568->3088383) 00010000:00010000:0.0:1746144647.474568:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 33 pid: 29370 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.474578:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 33 pid: 29370 timeout: 726 lvb_type: 0 00002000:00010000:0.0:1746144647.474584:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e31180 00000100:00100000:0.0:1746144647.474595:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 748 00000100:00100000:0.0:1746144647.474599:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746274688:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144647.474890:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747332608:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144647.474915:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099592e00/0xa7c849b16e017f22 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d811 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.474925:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099592e00, rc 0) 00000100:00100000:0.0:1746144647.474947:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:28646:x1830964746274048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6117us (6276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.474953:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10887 00000100:00100000:0.0:1746144647.481262:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746274688:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6648us (6738us total) trans 17179873064 rc 0/0 00000100:00100000:0.0:1746144647.481276:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 748 00002000:00100000:0.0:1746144647.481289:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2797568->3088383) req@ffff880093e31180 x1830964746274688/t17179873064(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/448 e 0 to 0 dl 1746144658 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.481299:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31180 with x1830964746274688 ext(2797568->3088383) 00010000:00010000:0.0:1746144647.481308:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 37 pid: 29370 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.481323:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 37 pid: 29370 timeout: 726 lvb_type: 0 00002000:00010000:0.0:1746144647.481331:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e31180 00000100:00100000:0.0:1746144647.481530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.481550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.481580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.481613:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746275200 00000100:00100000:0.0:1746144647.481621:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746275200 00010000:00010000:0.0:1746144647.481647:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e017e18 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d777 expref: 17 pid: 4758 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144647.481673:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746274944 00000100:00100000:0.0:1746144647.481675:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746274944 00010000:00010000:0.0:1746144647.484267:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1252000/0xa7c849b16e017e26 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d785 expref: 20 pid: 7257 timeout: 726 lvb_type: 0 00000100:00100000:0.0:1746144647.484317:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5358 00000100:00100000:0.0:1746144647.484328:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746274944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.484355:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.484376:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1252000/0xa7c849b16e017e26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d785 expref: 20 pid: 7257 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.484384:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1252000/0xa7c849b16e017e26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d785 expref: 20 pid: 7257 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.484401:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1252000/0xa7c849b16e017e26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d785 expref: 20 pid: 7257 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.484415:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.484417:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.484424:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.484431:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.484460:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144647.484471:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747333120:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144647.484526:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144647.484764:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746274560:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10178us (10506us total) trans 0 rc 757760/757760 00000100:00100000:0.0:1746144647.484772:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 747 00002000:00100000:0.0:1746144647.484780:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3436544->4194303) req@ffff880093e30380 x1830964746274560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:H/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.484789:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30380 with x1830964746274560 ext(3436544->4194303) 00010000:00010000:0.0:1746144647.484796:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 35 pid: 29370 timeout: 726 lvb_type: 0 00010000:00010000:0.0:1746144647.484807:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b76e400/0xa7c849b16e017ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7f5 expref: 35 pid: 29370 timeout: 726 lvb_type: 0 00002000:00010000:0.0:1746144647.484813:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e30380 00000100:00100000:0.0:1746144647.488824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.489245:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3977 00000100:00100000:0.0:1746144647.489254:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746275456:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144647.489432:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746275456:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 178us (608us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144647.489437:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3977 00002000:00100000:0.0:1746144647.489442:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1318912->1323007) req@ffff880093e30a80 x1830964746275456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/4536 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.489450:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30a80 with x1830964746275456 ext(1318912->1323007) 00002000:00010000:0.0:1746144647.489453:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e30a80 00000100:00100000:0.0:1746144647.494041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.495814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.496435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.502019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.509068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.509159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.509385:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3981 00000100:00100000:0.0:1746144647.509391:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746276480:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144647.514405:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746276224:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12198us (12378us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144647.514418:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3979 00002000:00100000:0.0:1746144647.514432:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093e32a00 x1830964746276224/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.514441:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32a00 with x1830964746276224 ext(3145728->4194303) 00002000:00010000:0.0:1746144647.514447:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e32a00 00000100:00100000:0.0:1746144647.525322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.531763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.541554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.548808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.549960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.622860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.634632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.639520:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747333888:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.639536:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747334016:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144647.639568:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133c67000/0xa7c849b16e017f6f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1515520->1568767] (req 1515520->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d842 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.639594:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133c67000, rc 0) 00000100:00100000:0.0:1746144647.639657:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+19:28652:x1830964746278656:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4795us (5032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.639665:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10893 00000100:00100000:0.0:1746144647.642120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.653583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.657536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.658580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.661325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.661800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.667839:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 595 00000100:00100000:0.0:1746144647.667849:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:1960:x1830964746280192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.667861:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.667883:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333000/0xa7c849b16e017fa7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d850 expref: 306 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.668401:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.668405:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.668462:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:1960:x1830964746280192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 615us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.668469:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 595 00010000:00010000:0.0:1746144647.668830:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017f8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668838:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017f8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144647.668884:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:0.0:1746144647.668888:0:15388:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144647.668904:0:15388:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017f8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668915:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017f8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668925:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668930:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668936:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668941:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099592c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144647.668945:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668951:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668959:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144647.668962:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144647.668965:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668970:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099592c00/0xa7c849b16e017f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668979:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668986:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668990:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.668994:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d8be400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144647.668996:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.669001:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.669007:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041600) 00010000:00010000:0.0:1746144647.669009:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144647.669011:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.669015:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d8be400/0xa7c849b16e017f84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.669048:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3c5200/0xa7c849b16e017f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d849 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.669060:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017f8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d849 expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.669066:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.669068:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144647.669070:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87c00, rc 0) 00000100:00100000:0.0:1746144647.669111:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28655:x1830964746279296:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 10830us (11584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.669118:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9878 00010000:00010000:0.0:1746144647.678381:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144647.683061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.685429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.685499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.686465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.686505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.695680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.704028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.709589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.710347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.715507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.715538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.718535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.720837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.720873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.720909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.728052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.734388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.734440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.776817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.783041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.793124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.796607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.799763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.799820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.802265:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746284672:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6175us (6311us total) trans 0 rc 462848/462848 00000100:00100000:0.0:1746144647.802276:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3988 00002000:00100000:0.0:1746144647.802288:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f01d500 x1830964746284672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 504/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 462848/462848 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.802296:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01d500 with x1830964746284672 ext(1048576->2097151) 00002000:00010000:0.0:1746144647.802301:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01d500 00000100:00100000:0.0:1746144647.813476:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746285440 00000100:00100000:0.0:1746144647.813485:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746285440 00000100:00100000:0.0:1746144647.813528:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10907 00000100:00100000:0.0:1746144647.813537:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+14:28662:x1830964746285440:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144647.814685:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.814706:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e018087 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d8d5 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.814739:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.814746:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144647.814747:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144647.814751:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e018087 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8d5 expref: 15 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.814780:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.814790:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 20 pid: 29370 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144647.814813:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747336320:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.814892:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144647.817021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.817100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:1.0:1746144647.818104:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1212416->1695743) req@ffff8800937a3480 x1830964746285696/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144647.818119:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a3480 with x1830964746285696 ext(1212416->1695743) 00010000:00010000:1.0:1746144647.818125:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 20 pid: 29370 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.818152:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 20 pid: 29370 timeout: 727 lvb_type: 0 00002000:00010000:1.0:1746144647.818158:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a3480 00000100:00100000:1.0:1746144647.818172:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 750 00000100:00100000:1.0:1746144647.818178:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746285696:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144647.843292:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746285696:12345-192.168.204.23@tcp:4:cat.0 Request processed in 25102us (26265us total) trans 21474840316 rc 0/0 00000100:00100000:1.0:1746144647.843305:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 750 00002000:00100000:1.0:1746144647.843336:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1212416->1695743) req@ffff8800937a3480 x1830964746285696/t21474840316(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/448 e 0 to 0 dl 1746144658 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144647.843345:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a3480 with x1830964746285696 ext(1212416->1695743) 00010000:00010000:1.0:1746144647.843355:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 22 pid: 29370 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.843369:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e017fed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d881 expref: 22 pid: 29370 timeout: 727 lvb_type: 0 00002000:00010000:1.0:1746144647.843375:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a3480 00000100:00100000:1.0:1746144647.844111:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746285824 00000100:00100000:1.0:1746144647.844120:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746285824 00010000:00010000:1.0:1746144647.844245:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 17 pid: 8453 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1746144647.844524:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5368 00000100:00100000:1.0:1746144647.844534:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746285824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144647.844548:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144647.844568:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 17 pid: 8453 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.844580:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 17 pid: 8453 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.844605:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094034a00/0xa7c849b16e017f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1318912->1904639) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d818 expref: 17 pid: 8453 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.844714:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144647.844716:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144647.844724:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edd3800/0xa7c849b16e018080 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ce expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144647.844734:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd3800/0xa7c849b16e018080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ce expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144647.845102:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edd3800/0xa7c849b16e018080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ce expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144647.845226:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747336448:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144647.845317:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144647.846227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.849534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144647.849587:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746286208 00000100:00100000:1.0:1746144647.849594:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746286208 00002000:00100000:1.0:1746144647.849717:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800937a0380 x1830964746286208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144647.849726:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0380 with x1830964746286208 ext(1048576->2097151) 00002000:00010000:1.0:1746144647.849731:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a0380 00000100:00100000:1.0:1746144647.849828:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3989 00000100:00100000:1.0:1746144647.849836:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746286208:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144647.858914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.858946:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746286592 00000100:00100000:0.0:1746144647.858954:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746286592 00000100:00100000:0.0:1746144647.858998:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9885 00000100:00100000:0.0:1746144647.859007:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:28667:x1830964746286592:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144647.859034:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.859052:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332c00/0xa7c849b16e01808e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d8dc expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.859180:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.859194:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017ffb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d888 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.859201:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332e00/0xa7c849b16e01803a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ab expref: 17 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.859207:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333600/0xa7c849b16e018064 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8b9 expref: 310 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.859216:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.859244:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333600/0xa7c849b16e018064 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8b9 expref: 310 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.859255:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333600/0xa7c849b16e018064 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8b9 expref: 310 pid: 20319 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144647.859266:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747336704:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144647.859297:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746286720 00000100:00100000:1.0:1746144647.859302:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746286720 00002000:00100000:1.0:1746144647.859340:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f01ea00 x1830964746286720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144647.859349:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01ea00 with x1830964746286720 ext(1048576->2097151) 00010000:00010000:0.0:1746144647.859352:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332e00/0xa7c849b16e01803a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ab expref: 17 pid: 15388 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144647.859354:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01ea00 00010000:00010000:0.0:1746144647.859360:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332e00/0xa7c849b16e01803a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ab expref: 17 pid: 15388 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1746144647.859366:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746286976 00000100:00100000:0.0:1746144647.859367:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747336832:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144647.859368:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746286976 00002000:00100000:1.0:1746144647.859382:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f01fb80 x1830964746286976/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 504/0 e 0 to 0 dl 1746144658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144647.859388:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01fb80 with x1830964746286976 ext(1048576->2097151) 00010000:00010000:0.0:1746144647.859390:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017ffb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d888 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144647.859396:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f01fb80 00010000:00010000:0.0:1746144647.859397:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017ffb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d888 expref: 8 pid: 15388 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144647.859403:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747336960:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144647.859407:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3990 00000100:00100000:1.0:1746144647.859413:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746286720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144647.859422:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144647.861716:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746286208:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11872us (12175us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144647.861729:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3989 00002000:00100000:0.0:1746144647.861739:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800937a0380 x1830964746286208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:288/0 lens 488/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144647.861748:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0380 with x1830964746286208 ext(1048576->2097151) 00002000:00010000:0.0:1746144647.862313:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a0380 00000100:00100000:0.0:1746144647.862826:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747336704:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.862858:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747336832:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.862878:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747336960:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144647.862905:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:0.0:1746144647.862931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.863935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.864649:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5371 00000100:00100000:0.0:1746144647.864656:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746287360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.864669:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.864675:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017ffb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d888 expref: 9 pid: 15388 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.864685:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017ffb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d888 expref: 9 pid: 15388 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.864707:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87c00/0xa7c849b16e017ffb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d888 expref: 9 pid: 15388 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.864736:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.864741:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.864749:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.864755:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.864789:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746287360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 134us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.864796:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5371 00000100:00100000:0.0:1746144647.866542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144647.867007:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.867015:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144647.867033:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144647.867205:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332c00/0xa7c849b16e01808e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 311 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.867219:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.867225:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.867228:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746144647.867230:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f332000, rc 0) 00000100:00100000:0.0:1746144647.867250:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:28667:x1830964746286592:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8244us (8337us total) trans 8589943722 rc 0/0 00000100:00100000:0.0:1746144647.867257:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9885 00000100:00100000:0.0:1746144647.882963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144647.883416:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746286720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24001us (24579us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144647.883426:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3990 00002000:00100000:1.0:1746144647.883436:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f01ea00 x1830964746286720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:288/0 lens 488/440 e 0 to 0 dl 1746144658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144647.883445:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01ea00 with x1830964746286720 ext(1048576->2097151) 00002000:00010000:1.0:1746144647.883450:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01ea00 00000100:00100000:0.0:1746144647.895343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.895373:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746287744 00000100:00100000:1.0:1746144647.895430:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746288000 00000100:00100000:1.0:1746144647.895438:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746288000 00000100:00100000:1.0:1746144647.895488:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10909 00000100:00100000:1.0:1746144647.895496:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746288000:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144647.895519:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144647.895539:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eb00a00/0xa7c849b16e0180aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d8f1 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144647.895562:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144647.895564:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144647.895572:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eb00a00/0xa7c849b16e0180aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f1 expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144647.895588:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eb00a00/0xa7c849b16e0180aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f1 expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144647.895599:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb00a00, rc 0) 00000100:00100000:1.0:1746144647.895644:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746288000:12345-192.168.204.23@tcp:101:cat.0 Request processed in 149us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144647.895650:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10909 00000100:00100000:0.0:1746144647.901262:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746287744 00000100:00100000:0.0:1746144647.902432:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9886 00000100:00100000:0.0:1746144647.902443:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:28669:x1830964746287744:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144647.902598:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.902619:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e0180b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d8ea expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.902923:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.902962:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.902975:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.902989:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.902994:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.902998:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903097:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e0180c6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903107:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e0180c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903111:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e0180c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144647.903118:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144647.903220:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903226:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903232:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903238:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094035e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144647.903241:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903248:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903259:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144647.903262:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144647.903266:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903271:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e0180b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903285:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903294:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903298:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903302:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094034200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144647.903304:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903309:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903314:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f03ec00) 00010000:00010000:0.0:1746144647.903316:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144647.903317:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903322:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e0180bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144647.903367:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e0180b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ea expref: 20 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.903378:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e0180c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ea expref: 19 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.903383:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144647.903385:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144647.903387:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094034a00, rc 0) 00000100:00100000:0.0:1746144647.903444:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:28669:x1830964746287744:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1003us (8102us total) trans 8589943723 rc 0/0 00000100:00100000:0.0:1746144647.903452:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9886 00000100:00100000:0.0:1746144647.929317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144647.930711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.931321:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746288384 00000100:00100000:0.0:1746144647.931334:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746288384 00000100:00100000:0.0:1746144647.931359:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10910 00000100:00100000:0.0:1746144647.931364:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:28665:x1830964746288384:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144647.931379:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144647.931398:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094035600/0xa7c849b16e0180d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d8f8 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.931423:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133c67000/0xa7c849b16e017f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d842 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.931431:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144647.931432:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144647.931436:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094035600/0xa7c849b16e0180d4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f8 expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.931463:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133c67000/0xa7c849b16e017f6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d842 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.931473:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133c67000/0xa7c849b16e017f6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d842 expref: 17 pid: 29370 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144647.931485:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747337088:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.931544:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144647.931620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.939775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.951489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.961613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.969094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.974641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.981768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.981812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.981939:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747337728:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.981950:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747337856:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144647.981959:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747337984:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144647.981991:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [442368->1048575] (req 442368->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 20 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.982010:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418fc00, rc 0) 00000100:00100000:0.0:1746144647.982069:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+20:28669:x1830964746289408:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5658us (7428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.982078:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10912 00000100:00100000:1.0:1746144647.983731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144647.983842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144647.984301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.984735:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746289920 00000100:00100000:0.0:1746144647.984744:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746289920 00010000:00010000:0.0:1746144647.984778:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3a4a00/0xa7c849b16e017d15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d707 expref: 10 pid: 8451 timeout: 727 lvb_type: 1 00000100:00100000:0.0:1746144647.984803:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746289792 00000100:00100000:0.0:1746144647.984805:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746289792 00010000:00010000:0.0:1746144647.984815:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009304bc00/0xa7c849b16e017dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d746 expref: 33 pid: 7257 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144647.984833:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746290048 00000100:00100000:0.0:1746144647.984835:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746290048 00010000:00010000:0.0:1746144647.984844:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d74d expref: 20 pid: 4758 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144647.984864:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5376 00000100:00100000:0.0:1746144647.984871:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746289920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.984886:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.984909:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e3a4a00/0xa7c849b16e017d15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d707 expref: 10 pid: 8451 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746144647.984919:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e3a4a00/0xa7c849b16e017d15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d707 expref: 10 pid: 8451 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746144647.984940:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e3a4a00/0xa7c849b16e017d15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d707 expref: 10 pid: 8451 timeout: 727 lvb_type: 1 00010000:00010000:0.0:1746144647.984963:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.985001:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746289920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 130us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.985008:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5376 00000100:00100000:0.0:1746144647.985021:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5377 00000100:00100000:0.0:1746144647.985026:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746289792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.985032:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.985039:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009304bc00/0xa7c849b16e017dd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d746 expref: 33 pid: 7257 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.985047:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009304bc00/0xa7c849b16e017dd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d746 expref: 33 pid: 7257 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.985057:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304bc00/0xa7c849b16e017dd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d746 expref: 33 pid: 7257 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.985064:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.985077:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746289792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 51us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.985081:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5377 00000100:00100000:0.0:1746144647.985089:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5378 00000100:00100000:0.0:1746144647.985094:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746290048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144647.985100:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144647.985107:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d74d expref: 20 pid: 4758 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.985114:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d74d expref: 20 pid: 4758 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.985123:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e017dd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d74d expref: 20 pid: 4758 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144647.985131:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.985152:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144647.985160:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.985168:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144647.985197:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144647.985209:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747338112:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144647.985252:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144647.985507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144647.985523:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746290176 00000100:00100000:1.0:1746144647.985526:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746290176 00010000:00010000:1.0:1746144647.985542:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f22b800/0xa7c849b16e017e7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7d9 expref: 23 pid: 8453 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1746144647.985555:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5379 00000100:00100000:1.0:1746144647.985560:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746290176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144647.985568:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144647.985581:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f22b800/0xa7c849b16e017e7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7d9 expref: 23 pid: 8453 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.985589:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f22b800/0xa7c849b16e017e7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7d9 expref: 23 pid: 8453 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.985601:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f22b800/0xa7c849b16e017e7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7d9 expref: 23 pid: 8453 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144647.985616:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144647.985618:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144647.985622:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e9c00/0xa7c849b16e0180db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ff expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144647.985628:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7e9c00/0xa7c849b16e0180db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ff expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144647.985646:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7e9c00/0xa7c849b16e0180db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ff expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144647.985653:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b810380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747338240:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144647.985675:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144647.989881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144647.991506:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747338112:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144647.991532:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144647.991575:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746290048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6479us (7274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144647.992191:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5378 00000100:00100000:0.0:1746144647.992234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.005352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.005404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.005894:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746291072 00000100:00100000:1.0:1746144648.005899:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746291072 00000100:00100000:1.0:1746144648.005932:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10913 00000100:00100000:1.0:1746144648.005937:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:28669:x1830964746291072:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144648.005947:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144648.005963:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d90d expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.005988:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edd3800/0xa7c849b16e018080 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ce expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.005996:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eb00a00/0xa7c849b16e0180aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f1 expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.006002:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144648.006004:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144648.006007:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d90d expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.006037:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eb00a00/0xa7c849b16e0180aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f1 expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.006053:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eb00a00/0xa7c849b16e0180aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f1 expref: 17 pid: 7257 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1746144648.006065:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747338368:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144648.006819:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edd3800/0xa7c849b16e018080 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ce expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.006827:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edd3800/0xa7c849b16e018080 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ce expref: 21 pid: 7257 timeout: 727 lvb_type: 0 00000100:00100000:1.0:1746144648.006834:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747338496:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144648.006853:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.013924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.014019:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747338368:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144648.014032:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747338496:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144648.014082:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d90d expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.014102:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb38e00, rc 0) 00000100:00100000:1.0:1746144648.014184:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:28669:x1830964746291072:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8245us (8778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144648.014193:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10913 00000100:00100000:0.0:1746144648.015083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.016164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.016226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.016596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.019065:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3998 00000100:00100000:0.0:1746144648.019074:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746291968:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144648.021893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.021908:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746292608 00000100:00100000:0.0:1746144648.021913:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746292608 00002000:00100000:0.0:1746144648.021938:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1052672->1056767) req@ffff88009398a300 x1830964746292608/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.021946:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398a300 with x1830964746292608 ext(1052672->1056767) 00002000:00010000:0.0:1746144648.021950:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398a300 00000100:00100000:0.0:1746144648.021975:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4001 00000100:00100000:0.0:1746144648.021981:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746292608:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144648.024081:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746292608:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 2091us (2180us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144648.024090:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4001 00002000:00100000:0.0:1746144648.024097:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1052672->1056767) req@ffff88009398a300 x1830964746292608/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.024105:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398a300 with x1830964746292608 ext(1052672->1056767) 00002000:00010000:0.0:1746144648.024110:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398a300 00000100:00100000:0.0:1746144648.027196:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746291968:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8114us (11022us total) trans 0 rc 176128/176128 00000100:00100000:0.0:1746144648.027207:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3998 00002000:00100000:0.0:1746144648.027218:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3321855) req@ffff880093988700 x1830964746291968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 176128/176128 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.027228:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988700 with x1830964746291968 ext(3145728->3321855) 00002000:00010000:0.0:1746144648.027233:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988700 00000100:00100000:0.0:1746144648.031882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.032030:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746292864 00000100:00100000:1.0:1746144648.032041:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746292864 00000100:00100000:1.0:1746144648.032095:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3940 00000100:00100000:1.0:1746144648.032102:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:28669:x1830964746292864:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144648.033652:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:28669:x1830964746292864:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1546us (1776us total) trans 8589943725 rc 0/0 00000100:00100000:1.0:1746144648.033661:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3940 00000100:00100000:0.0:1746144648.039398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.039454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.040291:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746292992 00000100:00100000:1.0:1746144648.040302:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746292992 00000100:00100000:1.0:1746144648.040375:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746293120 00000100:00100000:1.0:1746144648.040378:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746293120 00000100:00100000:1.0:1746144648.040398:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10914 00000100:00100000:1.0:1746144648.040406:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746292992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144648.040426:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144648.040446:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb38000/0xa7c849b16e0180f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d914 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144648.040499:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747338752:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144648.040520:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10915 00000100:00100000:0.0:1746144648.040529:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746293120:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.040538:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.040548:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd3200/0xa7c849b16e0180f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d91b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.040575:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747338880:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144648.040580:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.040599:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746144648.043935:0:4760:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144647 -> 1746144648 00002000:00010000:1.0:1746144648.043942:0:4760:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144647 -> 1746144648 00002000:00010000:1.0:1746144648.043944:0:4760:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144647 -> 1746144648 00000100:00100000:1.0:1746144648.043969:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747338752:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144648.044006:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb38000/0xa7c849b16e0180f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d914 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.044020:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb38000/0xa7c849b16e0180f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d914 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.044054:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb38000, rc 0) 00000100:00100000:1.0:1746144648.044098:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746292992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3691us (4711us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144648.044107:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10914 00000100:00100000:0.0:1746144648.052358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.052412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.052501:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746293248 00000100:00100000:1.0:1746144648.052512:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746293248 00000100:00100000:1.0:1746144648.052564:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746293376 00000100:00100000:1.0:1746144648.052566:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746293376 00000100:00100000:1.0:1746144648.052584:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10916 00000100:00100000:1.0:1746144648.052591:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746293248:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144648.052611:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144648.052630:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb39200/0xa7c849b16e0180fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d922 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144648.053130:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747339136:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144648.053811:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.056800:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747339136:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144648.056841:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb39200/0xa7c849b16e0180fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d922 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.056853:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb39200/0xa7c849b16e0180fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d922 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.056876:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb39200, rc 0) 00000100:00100000:0.0:1746144648.056920:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746293248:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4329us (4573us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144648.056928:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10916 00000100:00100000:0.0:1746144648.061810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.063652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.066834:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746293888 00000100:00100000:0.0:1746144648.066840:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746293888 00000100:00100000:0.0:1746144648.066881:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9887 00000100:00100000:0.0:1746144648.066888:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:28676:x1830964746293888:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.066911:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.066925:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329200/0xa7c849b16e01811a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d93e expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.067026:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067045:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067055:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067067:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067073:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067078:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067215:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e01812f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067223:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e01812f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067229:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e01812f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144648.067239:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144648.067502:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067509:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067514:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067519:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c329800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144648.067523:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067528:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067537:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144648.067540:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144648.067544:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067548:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329800/0xa7c849b16e018121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067569:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067574:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067578:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067586:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edd3200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144648.067588:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067593:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067599:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639200) 00010000:00010000:0.0:1746144648.067601:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144648.067603:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067608:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3200/0xa7c849b16e018128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144648.067640:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c329200/0xa7c849b16e01811a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d93e expref: 23 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.067649:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e01812f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d93e expref: 22 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.067655:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144648.067656:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144648.067659:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3800, rc 0) 00000100:00100000:0.0:1746144648.067694:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+22:28676:x1830964746293888:12345-192.168.204.23@tcp:101:cat.0 Request processed in 806us (1408us total) trans 8589943726 rc 0/0 00000100:00100000:0.0:1746144648.067700:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9887 00000100:00100000:0.0:1746144648.071636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.072578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.073527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.083608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.085047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.085092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.088066:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4004 00000100:00100000:0.0:1746144648.088076:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746295040:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144648.104872:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746295040:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16792us (19773us total) trans 0 rc 1040384/1040384 00000100:00100000:0.0:1746144648.104881:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4004 00002000:00100000:0.0:1746144648.104888:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1056768->2097151) req@ffff88012b1cc380 x1830964746295040/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.104896:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cc380 with x1830964746295040 ext(1056768->2097151) 00002000:00010000:0.0:1746144648.104900:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cc380 00000100:00100000:0.0:1746144648.113247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.116865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.116897:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746295296 00000100:00100000:0.0:1746144648.116903:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746295296 00002000:00100000:0.0:1746144648.116942:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3321856->4059135) req@ffff88012b1ce680 x1830964746295296/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.116951:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ce680 with x1830964746295296 ext(3321856->4059135) 00010000:00010000:0.0:1746144648.116958:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e9c00/0xa7c849b16e0180db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ff expref: 21 pid: 7257 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.116969:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b7e9c00/0xa7c849b16e0180db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3321856->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8ff expref: 21 pid: 7257 timeout: 727 lvb_type: 0 00002000:00010000:0.0:1746144648.116981:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1ce680 00000100:00100000:0.0:1746144648.117011:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 752 00000100:00100000:0.0:1746144648.117069:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746295296:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144648.132452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.146811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.146869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.168486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.172181:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746295808:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25075us (25380us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144648.172190:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4005 00002000:00100000:0.0:1746144648.172199:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b1cc700 x1830964746295808/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.172209:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cc700 with x1830964746295808 ext(3145728->4194303) 00002000:00010000:0.0:1746144648.172213:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cc700 00000100:00100000:0.0:1746144648.181365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.197772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.197885:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746296576 00000100:00100000:1.0:1746144648.197895:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746296576 00000100:00100000:1.0:1746144648.197957:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3941 00000100:00100000:1.0:1746144648.197965:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:28676:x1830964746296576:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144648.198223:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:28676:x1830964746296576:12345-192.168.204.23@tcp:35:cat.0 Request processed in 257us (462us total) trans 8589943728 rc 0/0 00000100:00100000:1.0:1746144648.198230:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3941 00000100:00100000:0.0:1746144648.210413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.210510:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746296832 00000100:00100000:1.0:1746144648.210521:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746296832 00000100:00100000:1.0:1746144648.210579:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3942 00000100:00100000:1.0:1746144648.210586:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:28681:x1830964746296832:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144648.210831:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:28681:x1830964746296832:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 244us (427us total) trans 8589943729 rc 0/0 00000100:00100000:1.0:1746144648.210838:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3942 00000100:00100000:0.0:1746144648.293022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.294572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.294594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.294697:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747339904:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144648.294724:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f08fe00/0xa7c849b16e018175 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d961 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.294741:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f08fe00/0xa7c849b16e018175 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d961 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.294752:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f08fe00, rc 0) 00000100:00100000:0.0:1746144648.294788:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746296960:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1570us (1775us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144648.294794:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10923 00000100:00100000:0.0:1746144648.294810:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746297088 00000100:00100000:0.0:1746144648.294813:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746297088 00000100:00100000:0.0:1746144648.294830:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746297216 00000100:00100000:0.0:1746144648.294832:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746297216 00000100:00100000:0.0:1746144648.294844:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10924 00000100:00100000:0.0:1746144648.294849:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746297088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.294858:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144648.294859:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10925 00000100:00100000:1.0:1746144648.294866:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746297216:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.294868:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e01817c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d968 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.294872:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144648.294879:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b19fbc00/0xa7c849b16e018183 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d96f expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.294889:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144648.294891:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144648.294895:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747340032:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144648.294899:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19fbc00/0xa7c849b16e018183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d96f expref: 25 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.294912:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b19fbc00/0xa7c849b16e018183 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d96f expref: 25 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.294920:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19fbc00, rc 0) 00000100:00100000:1.0:1746144648.294934:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746297216:12345-192.168.204.23@tcp:101:cat.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.294934:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144648.294939:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10925 00000100:00100000:0.0:1746144648.298100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.307016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.326768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.327652:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747340288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144648.327703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746144648.328476:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144648.330052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.330093:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746297856 00000100:00100000:0.0:1746144648.330098:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746297856 00010000:00010000:0.0:1746144648.330123:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 22 pid: 4760 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.330170:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5383 00000100:00100000:0.0:1746144648.330176:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746297856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.330187:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.330206:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 22 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.330216:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 22 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.330234:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009418fc00/0xa7c849b16e0180e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 442368->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d906 expref: 22 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.330250:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.330253:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.330260:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 32 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.330267:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 32 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.330294:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 32 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.330304:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747340416:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144648.330374:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144648.334857:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747340288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144648.342093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.345287:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144648.345302:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747340800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746144648.345357:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144648.345391:0:13589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747340800 00000100:00100000:1.0:1746144648.345396:0:13589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747340800 00000100:00100000:1.0:1746144648.345435:0:13589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1746144648.345441:0:13589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747340800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746144648.345461:0:13589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 382926848 pending 22151168 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746144648.345488:0:13589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747340800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144648.345493:0:13589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1746144648.345524:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747340800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144648.347257:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746298112 00000100:00100000:0.0:1746144648.347262:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746298112 00000100:00100000:0.0:1746144648.347274:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746298496 00000100:00100000:0.0:1746144648.347275:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746298496 00000100:00100000:0.0:1746144648.347302:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10928 00000100:00100000:0.0:1746144648.347307:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746298496:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.347324:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.347344:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e0181bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d98b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.347367:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.347369:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.347378:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e0181bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d98b expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.349448:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e0181bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d98b expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.349468:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136932600, rc 0) 00000100:00100000:0.0:1746144648.349495:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746298496:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2185us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.349501:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10928 00000100:00100000:0.0:1746144648.349555:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 599 00000100:00100000:0.0:1746144648.349560:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746298112:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.349570:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.349591:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f107000/0xa7c849b16e0181a6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d97d expref: 26 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.349614:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144648.349618:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144648.349632:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746298112:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 72us (6732us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.349637:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 599 00000100:00100000:0.0:1746144648.351512:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746298624 00000100:00100000:0.0:1746144648.351518:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746298624 00010000:00010000:0.0:1746144648.351538:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e018087 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8d5 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.351567:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5384 00000100:00100000:0.0:1746144648.351573:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746298624:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.351582:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.351599:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e018087 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8d5 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.351610:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e018087 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8d5 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.351625:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e018087 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8d5 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.351636:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144648.351656:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746298624:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 84us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.351665:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5384 00000100:00100000:0.0:1746144648.352552:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746299008 00000100:00100000:0.0:1746144648.352556:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746299008 00010000:00010000:0.0:1746144648.352568:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8200/0xa7c849b16e0180a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8e3 expref: 24 pid: 4760 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.352585:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5385 00000100:00100000:0.0:1746144648.352589:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746299008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.352596:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.352604:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8200/0xa7c849b16e0180a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8e3 expref: 24 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.352613:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8200/0xa7c849b16e0180a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8e3 expref: 24 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.352625:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8200/0xa7c849b16e0180a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8e3 expref: 24 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.352634:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.352636:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.352641:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0181b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d984 expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.352649:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0181b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d984 expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.352677:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0181b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d984 expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.352689:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747341440:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144648.352745:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.358808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.361949:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746299520 00000100:00100000:1.0:1746144648.361956:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746299520 00000100:00100000:0.0:1746144648.361966:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747341440:192.168.204.23@tcp:105: 00002000:00100000:1.0:1746144648.361988:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1150976->1155071) req@ffff88012ce84000 x1830964746299520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746144648.361988:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746144648.361995:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84000 with x1830964746299520 ext(1150976->1155071) 00002000:00010000:1.0:1746144648.361998:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84000 00000100:00100000:0.0:1746144648.362022:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746299008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9432us (10193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.362030:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5385 00000100:00100000:1.0:1746144648.362031:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4009 00000100:00100000:1.0:1746144648.362038:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746299520:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144648.362189:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746299520:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 151us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144648.362195:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4009 00002000:00100000:1.0:1746144648.362199:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1150976->1155071) req@ffff88012ce84000 x1830964746299520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.362206:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84000 with x1830964746299520 ext(1150976->1155071) 00002000:00010000:1.0:1746144648.362209:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84000 00000100:00100000:0.0:1746144648.366059:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746299648 00000100:00100000:0.0:1746144648.366070:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746299648 00000100:00100000:0.0:1746144648.366131:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 600 00000100:00100000:0.0:1746144648.366167:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746299648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.366183:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.366210:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106c00/0xa7c849b16e0181d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d992 expref: 27 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.366236:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144648.366241:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144648.366293:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746299648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.366300:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 600 00000100:00100000:0.0:1746144648.367466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.372491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.372922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.374115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.374179:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746300160 00000100:00100000:0.0:1746144648.374182:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746300160 00010000:00010000:0.0:1746144648.374197:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f08e000/0xa7c849b16e01814b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d953 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.374221:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5387 00000100:00100000:0.0:1746144648.374227:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746300160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.374234:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.374242:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f08e000/0xa7c849b16e01814b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d953 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.374250:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f08e000/0xa7c849b16e01814b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d953 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.374261:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f08e000/0xa7c849b16e01814b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d953 expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.374272:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.374274:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.374280:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96a600/0xa7c849b16e0181e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d999 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.374286:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96a600/0xa7c849b16e0181e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d999 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.374305:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96a600/0xa7c849b16e0181e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d999 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.374333:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747341952:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144648.374374:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.376684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.376757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.376773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.376843:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747341952:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144648.376855:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144648.376883:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746300160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2655us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.376891:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5387 00000100:00100000:0.0:1746144648.376997:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10932 00000100:00100000:0.0:1746144648.377004:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:28689:x1830964746300544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.377012:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.377020:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136933c00/0xa7c849b16e0181fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d9ae expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.377033:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144648.377037:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136933c00/0xa7c849b16e0181fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ae expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.377046:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136933c00/0xa7c849b16e0181fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ae expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.377053:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136933c00, rc 0) 00000100:00100000:0.0:1746144648.377075:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:28689:x1830964746300544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.377080:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10932 00000100:00100000:0.0:1746144648.377299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.377504:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746300416 00000100:00100000:0.0:1746144648.377509:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746300416 00002000:00100000:0.0:1746144648.377536:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1286143) req@ffff8800920ad880 x1830964746300416/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.377545:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad880 with x1830964746300416 ext(1048576->1286143) 00010000:00010000:0.0:1746144648.377551:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d90d expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:0.0:1746144648.377561:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d90d expref: 17 pid: 4760 timeout: 727 lvb_type: 0 00002000:00010000:0.0:1746144648.377567:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920ad880 00000100:00100000:0.0:1746144648.377580:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746300800 00000100:00100000:0.0:1746144648.377583:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746300800 00002000:00100000:0.0:1746144648.377594:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (4018176->4022271) req@ffff8800920ac700 x1830964746300800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.377601:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac700 with x1830964746300800 ext(4018176->4022271) 00002000:00010000:0.0:1746144648.377604:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ac700 00000100:00100000:0.0:1746144648.377616:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 754 00000100:00100000:0.0:1746144648.377621:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746300416:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144648.384678:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746300416:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 7048us (7913us total) trans 21474840318 rc 0/0 00000100:00100000:1.0:1746144648.384691:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 754 00002000:00100000:1.0:1746144648.384704:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1286143) req@ffff8800920ad880 x1830964746300416/t21474840318(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/448 e 0 to 0 dl 1746144659 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.384713:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad880 with x1830964746300416 ext(1048576->1286143) 00010000:00010000:1.0:1746144648.384725:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d90d expref: 19 pid: 4760 timeout: 727 lvb_type: 0 00010000:00010000:1.0:1746144648.384739:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cb38e00/0xa7c849b16e0180e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d90d expref: 19 pid: 4760 timeout: 727 lvb_type: 0 00002000:00010000:1.0:1746144648.384745:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920ad880 00000100:00100000:0.0:1746144648.385086:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746301056 00000100:00100000:0.0:1746144648.385090:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746301056 00010000:00010000:0.0:1746144648.385110:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094035600/0xa7c849b16e0180d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8f8 expref: 34 pid: 7257 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.385151:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746301184 00000100:00100000:0.0:1746144648.385154:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746301184 00010000:00010000:0.0:1746144648.385164:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106200/0xa7c849b16e01813d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d945 expref: 24 pid: 7257 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1746144648.385342:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5389 00000100:00100000:1.0:1746144648.385350:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746301184:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144648.385358:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144648.385378:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f106200/0xa7c849b16e01813d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d945 expref: 24 pid: 7257 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1746144648.385386:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f106200/0xa7c849b16e01813d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d945 expref: 24 pid: 7257 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1746144648.385402:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f106200/0xa7c849b16e01813d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d945 expref: 24 pid: 7257 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1746144648.385427:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144648.385449:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746301184:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144648.385455:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5389 00000100:00100000:0.0:1746144648.391019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.394277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.394333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.394402:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746301696 00000100:00100000:1.0:1746144648.394406:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746301696 00002000:00100000:1.0:1746144648.394443:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1150976->1155071) req@ffff8800a4b62a00 x1830964746301696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.394452:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62a00 with x1830964746301696 ext(1150976->1155071) 00002000:00010000:1.0:1746144648.394457:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62a00 00000100:00100000:1.0:1746144648.394485:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4011 00000100:00100000:1.0:1746144648.394490:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746301696:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144648.394637:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746301696:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 146us (303us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144648.394642:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4011 00002000:00100000:1.0:1746144648.394647:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1150976->1155071) req@ffff8800a4b62a00 x1830964746301696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.394653:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62a00 with x1830964746301696 ext(1150976->1155071) 00002000:00010000:1.0:1746144648.394656:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62a00 00000100:00100000:0.0:1746144648.395090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.397359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.402534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.402563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.404034:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4012 00000100:00100000:1.0:1746144648.404049:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746302208:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144648.412348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.413526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.418501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.421511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.431324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.436950:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.436978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.436994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.437027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.446299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.453123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.453535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.457472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.457517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.465213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.474293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.479577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.486072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.492328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.492588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.498780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.499556:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746306048 00000100:00100000:1.0:1746144648.499565:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746306048 00002000:00100000:1.0:1746144648.499607:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88008c7d0380 x1830964746306048/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.499618:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0380 with x1830964746306048 ext(1048576->2097151) 00002000:00010000:1.0:1746144648.499623:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0380 00000100:00100000:1.0:1746144648.500065:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4019 00000100:00100000:1.0:1746144648.500074:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746306048:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144648.506364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.509835:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746306048:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 9754us (11059us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144648.509846:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4019 00002000:00100000:1.0:1746144648.509858:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88008c7d0380 x1830964746306048/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.509867:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0380 with x1830964746306048 ext(1048576->2097151) 00002000:00010000:1.0:1746144648.509872:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0380 00000100:00100000:0.0:1746144648.515049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.515525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.515614:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746306304 00000100:00100000:1.0:1746144648.515624:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746306304 00000100:00100000:1.0:1746144648.515709:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10941 00000100:00100000:1.0:1746144648.515716:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746306304:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144648.515735:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144648.515754:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152d9ed expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.515778:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144648.515780:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144648.515787:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ed expref: 24 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.515801:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ed expref: 24 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144648.515811:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e3bda00, rc 0) 00000100:00100000:1.0:1746144648.515865:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746306304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 149us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144648.515872:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10941 00000100:00100000:0.0:1746144648.518351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.518379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.518411:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746306816 00000100:00100000:0.0:1746144648.518415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.518419:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746306816 00002000:00100000:1.0:1746144648.518546:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d3800 x1830964746306816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.518553:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3800 with x1830964746306816 ext(2097152->3145727) 00002000:00010000:1.0:1746144648.518557:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d3800 00000100:00100000:1.0:1746144648.519464:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4022 00000100:00100000:1.0:1746144648.519472:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746306816:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144648.524352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.524392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.524426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.524451:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746307712 00000100:00100000:0.0:1746144648.524461:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746307712 00002000:00100000:0.0:1746144648.524510:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d0700 x1830964746307712/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.524521:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0700 with x1830964746307712 ext(3145728->4194303) 00002000:00010000:0.0:1746144648.524527:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0700 00000100:00100000:0.0:1746144648.524552:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746307968 00000100:00100000:0.0:1746144648.524554:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746307968 00002000:00100000:0.0:1746144648.524569:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d2a00 x1830964746307968/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.524575:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2a00 with x1830964746307968 ext(2097152->3145727) 00002000:00010000:0.0:1746144648.524580:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d2a00 00000100:00100000:1.0:1746144648.524584:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746307584 00000100:00100000:0.0:1746144648.524592:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4023 00000100:00100000:1.0:1746144648.524594:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746307584 00000100:00100000:0.0:1746144648.524599:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746307712:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:1.0:1746144648.524616:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fb4ea00 x1830964746307584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.524623:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb4ea00 with x1830964746307584 ext(2097152->3145727) 00002000:00010000:1.0:1746144648.524628:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb4ea00 00000100:00100000:1.0:1746144648.524641:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4024 00000100:00100000:1.0:1746144648.524647:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746307968:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144648.525944:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.551679:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746307968:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27018us (27273us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144648.551693:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4024 00002000:00100000:0.0:1746144648.551707:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d2a00 x1830964746307968/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.551717:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2a00 with x1830964746307968 ext(2097152->3145727) 00002000:00010000:0.0:1746144648.551723:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d2a00 00000100:00100000:1.0:1746144648.551839:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.557946:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.560383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.565632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.567954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.584201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.584399:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746309632 00000100:00100000:1.0:1746144648.584410:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746309632 00000100:00100000:1.0:1746144648.584472:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3944 00000100:00100000:1.0:1746144648.584480:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:28689:x1830964746309632:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144648.584720:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+29:28689:x1830964746309632:12345-192.168.204.23@tcp:35:cat.0 Request processed in 239us (528us total) trans 8589943734 rc 0/0 00000100:00100000:1.0:1746144648.584727:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3944 00000100:00100000:0.0:1746144648.641068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.653094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.653185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.653231:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746309888 00000100:00100000:1.0:1746144648.653241:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746309888 00010000:00010000:1.0:1746144648.653279:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ed expref: 24 pid: 22208 timeout: 727 lvb_type: 1 00000100:00100000:1.0:1746144648.653327:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5398 00000100:00100000:1.0:1746144648.653336:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746309888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144648.653354:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144648.653377:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ed expref: 24 pid: 22208 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1746144648.653388:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ed expref: 24 pid: 22208 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1746144648.653415:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e3bda00/0xa7c849b16e018239 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ed expref: 24 pid: 22208 timeout: 727 lvb_type: 1 00010000:00010000:1.0:1746144648.653438:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144648.653902:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746309888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 566us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144648.653909:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5398 00000100:00100000:1.0:1746144648.662267:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.663507:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4029 00000100:00100000:1.0:1746144648.663518:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746310272:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144648.663690:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746310272:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 175us (1423us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144648.663696:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4029 00002000:00100000:1.0:1746144648.663702:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2519040->2523135) req@ffff88009b813480 x1830964746310272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.663709:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b813480 with x1830964746310272 ext(2519040->2523135) 00002000:00010000:1.0:1746144648.663713:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b813480 00000100:00100000:0.0:1746144648.667869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144648.680041:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144648.719521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.726096:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746311040 00000100:00100000:0.0:1746144648.726106:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746311040 00000100:00100000:0.0:1746144648.726168:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10946 00000100:00100000:0.0:1746144648.726175:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746311040:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.726197:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.726214:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e0182a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da1e expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.726264:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747345024:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144648.726653:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.727848:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747345024:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144648.727873:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e0182a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da1e expref: 24 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.727883:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e0182a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da1e expref: 24 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.727901:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995bae00, rc 0) 00000100:00100000:0.0:1746144648.727921:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746311040:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1747us (1878us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144648.727926:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10946 00000100:00100000:0.0:1746144648.739729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.748203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.755163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.764710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.764738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.764781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.764800:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746311680 00000100:00100000:0.0:1746144648.764802:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746311680 00010000:00010000:0.0:1746144648.764819:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136933c00/0xa7c849b16e0181fa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9ae expref: 23 pid: 29370 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.764843:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746311808 00000100:00100000:0.0:1746144648.764845:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746311808 00010000:00010000:0.0:1746144648.764853:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96be00/0xa7c849b16e0181ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9a0 expref: 26 pid: 7257 timeout: 727 lvb_type: 0 00000100:00100000:0.0:1746144648.769742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.773356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.775512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.775548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.775597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.775685:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746312448 00000100:00100000:1.0:1746144648.775692:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746312448 00002000:00100000:1.0:1746144648.775730:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009b32c700 x1830964746312448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.775739:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32c700 with x1830964746312448 ext(2097152->3145727) 00002000:00010000:1.0:1746144648.775745:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32c700 00000100:00100000:1.0:1746144648.775761:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746312704 00000100:00100000:1.0:1746144648.775763:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746312704 00002000:00100000:1.0:1746144648.775773:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b32f480 x1830964746312704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.775779:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32f480 with x1830964746312704 ext(3145728->4194303) 00002000:00010000:1.0:1746144648.775782:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32f480 00000100:00100000:1.0:1746144648.775793:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4032 00000100:00100000:1.0:1746144648.775798:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746312448:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144648.780725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.788405:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746312448:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 12595us (12888us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144648.788417:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4032 00002000:00100000:1.0:1746144648.788428:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009b32c700 x1830964746312448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.788437:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32c700 with x1830964746312448 ext(2097152->3145727) 00002000:00010000:1.0:1746144648.788443:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32c700 00000100:00100000:0.0:1746144648.792640:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.792744:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746313216 00000100:00100000:1.0:1746144648.792755:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746313216 00002000:00100000:1.0:1746144648.792805:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1925120->1929215) req@ffff88009b32ca80 x1830964746313216/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.792815:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ca80 with x1830964746313216 ext(1925120->1929215) 00002000:00010000:1.0:1746144648.792821:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32ca80 00000100:00100000:1.0:1746144648.792854:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4034 00000100:00100000:1.0:1746144648.792862:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746313216:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144648.793034:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746313216:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 171us (406us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144648.793040:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4034 00002000:00100000:1.0:1746144648.793045:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1925120->1929215) req@ffff88009b32ca80 x1830964746313216/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:289/0 lens 488/4536 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144648.793051:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ca80 with x1830964746313216 ext(1925120->1929215) 00002000:00010000:1.0:1746144648.793053:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32ca80 00000100:00100000:0.0:1746144648.797582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.798209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.803364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.803394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.803417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.813711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.814641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.815420:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746314496 00000100:00100000:1.0:1746144648.815425:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746314496 00000100:00100000:1.0:1746144648.815462:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3946 00000100:00100000:1.0:1746144648.815468:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+31:28704:x1830964746314496:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144648.815650:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:28704:x1830964746314496:12345-192.168.204.23@tcp:35:cat.0 Request processed in 181us (1009us total) trans 8589943737 rc 0/0 00000100:00100000:1.0:1746144648.815656:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3946 00000100:00100000:0.0:1746144648.819063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.827691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.833100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.854894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.858868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.882576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.893804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.896681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.918235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.918299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.927651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.939091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.943582:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746316928 00000100:00100000:0.0:1746144648.943587:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746316928 00000100:00100000:0.0:1746144648.943623:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9893 00000100:00100000:0.0:1746144648.943629:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:28714:x1830964746316928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.944195:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.944213:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23a00/0xa7c849b16e0182e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da64 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.945115:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945127:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945273:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945287:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945294:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945299:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945410:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22400/0xa7c849b16e0182fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945419:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22400/0xa7c849b16e0182fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945425:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22400/0xa7c849b16e0182fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000004:00200000:0.0:1746144648.945433:0:22257:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144648.945504:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945510:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945517:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945521:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b22a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144648.945525:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945530:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945540:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144648.945542:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144648.945545:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945551:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22a00/0xa7c849b16e0182ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945567:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945576:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945581:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945584:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b23400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144648.945586:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945591:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945596:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c3a3500) 00010000:00010000:0.0:1746144648.945597:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144648.945599:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.945603:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23400/0xa7c849b16e0182f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144648.946637:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23a00/0xa7c849b16e0182e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da64 expref: 35 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.946653:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22400/0xa7c849b16e0182fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da64 expref: 34 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.946660:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144648.946662:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144648.946664:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b22400, rc 0) 00000100:00100000:0.0:1746144648.946685:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+34:28714:x1830964746316928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3056us (3170us total) trans 8589943738 rc 0/0 00000100:00100000:0.0:1746144648.946692:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9893 00000100:00100000:1.0:1746144648.946858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.952694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.952736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.952768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.952785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.952812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.953260:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746317952 00000100:00100000:0.0:1746144648.953262:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746317952 00000100:00100000:0.0:1746144648.953280:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10956 00000100:00100000:0.0:1746144648.953284:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746317440:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.953299:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.953320:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da6b expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.953337:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.953339:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.953346:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.953360:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.953369:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b22e00, rc 0) 00000100:00100000:0.0:1746144648.953384:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746317440:12345-192.168.204.23@tcp:101:cat.0 Request processed in 100us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144648.953389:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10956 00000100:00100000:0.0:1746144648.953398:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10957 00000100:00100000:0.0:1746144648.953402:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746317824:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144648.953406:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144648.953412:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b23400/0xa7c849b16e018312 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da72 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.953444:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747347200:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144648.953495:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.953517:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746317696 00000100:00100000:0.0:1746144648.953520:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746317696 00002000:00100000:0.0:1746144648.953541:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012dbb6300 x1830964746317696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/0 e 0 to 0 dl 1746144659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.953549:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb6300 with x1830964746317696 ext(4194304->4935679) 00002000:00010000:0.0:1746144648.953554:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb6300 00000100:00100000:0.0:1746144648.953567:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4042 00000100:00100000:0.0:1746144648.953571:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746317696:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144648.957213:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747347200:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144648.957238:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b23400/0xa7c849b16e018312 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da72 expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.957319:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b23400/0xa7c849b16e018312 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da72 expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144648.957333:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b23400, rc 0) 00000100:00100000:1.0:1746144648.958030:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746317824:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4624us (5242us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144648.958036:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10957 00000100:00100000:0.0:1746144648.963219:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746318080 00000100:00100000:0.0:1746144648.963230:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746318080 00010000:00010000:0.0:1746144648.963269:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008be71800/0xa7c849b16e01822b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9df expref: 24 pid: 4760 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144648.963299:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746318208 00000100:00100000:0.0:1746144648.963301:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746318208 00010000:00010000:0.0:1746144648.963322:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008be71c00/0xa7c849b16e01824e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da02 expref: 40 pid: 4758 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144648.963350:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5409 00000100:00100000:0.0:1746144648.963356:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746318208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144648.963368:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144648.963385:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008be71c00/0xa7c849b16e01824e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da02 expref: 40 pid: 4758 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144648.963398:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008be71c00/0xa7c849b16e01824e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da02 expref: 40 pid: 4758 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144648.963839:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008be71c00/0xa7c849b16e01824e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da02 expref: 40 pid: 4758 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144648.963853:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.963855:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144648.963865:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f08e000/0xa7c849b16e018319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1941503) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da79 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.963873:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f08e000/0xa7c849b16e018319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1941503) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da79 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144648.963909:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f08e000/0xa7c849b16e018319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1941503) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da79 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144648.963921:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747347584:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144648.964010:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144648.964515:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746317696:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10941us (11745us total) trans 0 rc 741376/741376 00000100:00100000:0.0:1746144648.964523:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4042 00002000:00100000:0.0:1746144648.964532:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012dbb6300 x1830964746317696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:289/0 lens 488/440 e 0 to 0 dl 1746144659 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144648.964541:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb6300 with x1830964746317696 ext(4194304->4935679) 00002000:00010000:0.0:1746144648.964545:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb6300 00000100:00100000:0.0:1746144648.969822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.973692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144648.988789:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144648.988902:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746318848 00000100:00100000:1.0:1746144648.988913:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746318848 00000100:00100000:1.0:1746144648.988971:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10959 00000100:00100000:1.0:1746144648.988979:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:28714:x1830964746318848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144648.988999:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144648.989019:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da80 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.989049:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0182e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da5d expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.989057:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144648.989059:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144648.989062:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.989094:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0182e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da5d expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.989106:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0182e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da5d expref: 25 pid: 4758 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144648.989117:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747347712:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144648.989234:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144648.990862:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747347712:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144648.991001:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144648.991016:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f333200, rc 0) 00000100:00100000:1.0:1746144648.991054:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:28714:x1830964746318848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2076us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144648.991061:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10959 00000100:00100000:0.0:1746144648.991478:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.004295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.013426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.029683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.029879:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746319616 00000100:00100000:1.0:1746144649.029889:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746319616 00000100:00100000:1.0:1746144649.029938:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9894 00000100:00100000:1.0:1746144649.029947:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:28720:x1830964746319616:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144649.029971:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.029989:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da87 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.030095:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030107:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030117:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030129:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030164:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030170:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030272:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332600/0xa7c849b16e01833c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030280:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332600/0xa7c849b16e01833c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030286:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332600/0xa7c849b16e01833c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000004:00200000:1.0:1746144649.030294:0:22257:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144649.030383:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030393:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030399:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030404:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f333a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144649.030407:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030414:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030424:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144649.030426:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144649.030430:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030434:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01832e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030460:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030465:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030470:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030473:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f333e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144649.030475:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030483:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030488:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f3c3700) 00010000:00010000:1.0:1746144649.030490:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144649.030492:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030496:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e018335 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.030525:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da87 expref: 36 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.030533:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332600/0xa7c849b16e01833c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da87 expref: 35 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.030538:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.030540:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144649.030542:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f332600, rc 0) 00000100:00100000:1.0:1746144649.030561:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+35:28720:x1830964746319616:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 616us (890us total) trans 8589943739 rc 0/0 00000100:00100000:1.0:1746144649.030566:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9894 00000100:00100000:0.0:1746144649.036647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.036743:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746319744 00000100:00100000:1.0:1746144649.036753:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746319744 00000100:00100000:0.0:1746144649.037748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.037988:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10960 00000100:00100000:1.0:1746144649.037997:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:28714:x1830964746319744:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144649.038018:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.038038:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f332e00/0xa7c849b16e01834a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da8e expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.038068:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f08e000/0xa7c849b16e018319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1941503) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da79 expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.038076:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144649.038077:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144649.038081:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f332e00/0xa7c849b16e01834a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da8e expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.038109:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f08e000/0xa7c849b16e018319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1941503) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da79 expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.038120:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f08e000/0xa7c849b16e018319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1941503) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da79 expref: 36 pid: 4758 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.038148:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747347968:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.038203:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.039952:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747347968:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.039987:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f332e00/0xa7c849b16e01834a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da8e expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.039999:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f332e00, rc 0) 00000100:00100000:1.0:1746144649.040023:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:28714:x1830964746319744:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2027us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.040029:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10960 00000100:00100000:0.0:1746144649.040849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.059448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.059592:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746320128 00000100:00100000:0.0:1746144649.059601:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746320128 00000100:00100000:0.0:1746144649.060812:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10961 00000100:00100000:0.0:1746144649.060823:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:28720:x1830964746320128:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144649.060842:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.060860:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da95 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.060887:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.060895:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008be70600/0xa7c849b16e0182c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da48 expref: 38 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.060901:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.060903:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.060906:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3497984->3887103] (req 3497984->3887103) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.060936:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008be70600/0xa7c849b16e0182c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da48 expref: 38 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.060945:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008be70600/0xa7c849b16e0182c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da48 expref: 38 pid: 7257 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.060956:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747348096:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144649.061056:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.061069:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.061955:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747348224:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.063001:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.064214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.064456:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747348096:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.065091:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747348224:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.065117:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3497984->3887103] (req 3497984->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.065127:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f106400, rc 0) 00000100:00100000:1.0:1746144649.065175:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:28720:x1830964746320128:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4355us (5728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.065182:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10961 00000100:00100000:0.0:1746144649.067630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.068552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.068566:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746320512 00000100:00100000:0.0:1746144649.068569:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746320512 00010000:00010000:0.0:1746144649.068581:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.068597:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5413 00000100:00100000:0.0:1746144649.068602:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746320512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.068609:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.068618:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.068626:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.068636:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd200/0xa7c849b16e0182a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da25 expref: 25 pid: 4760 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.068647:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.068650:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.068655:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.068662:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.068687:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.068699:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130928700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747348480:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144649.068757:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.070960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.070999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.071211:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746320896 00000100:00100000:1.0:1746144649.071217:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746320896 00002000:00100000:1.0:1746144649.071252:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130928700 x1830964746320896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.071261:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928700 with x1830964746320896 ext(1048576->2097151) 00002000:00010000:1.0:1746144649.071266:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928700 00000100:00100000:1.0:1746144649.071278:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746320768 00000100:00100000:1.0:1746144649.071280:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746320768 00002000:00100000:1.0:1746144649.071291:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3497984->3502079) req@ffff88013092b480 x1830964746320768/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.071298:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092b480 with x1830964746320768 ext(3497984->3502079) 00002000:00010000:1.0:1746144649.071301:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092b480 00000100:00100000:1.0:1746144649.071975:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4047 00000100:00100000:1.0:1746144649.071982:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746320768:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144649.072102:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746320768:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 121us (1102us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144649.072107:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4047 00002000:00100000:1.0:1746144649.072112:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3497984->3502079) req@ffff88013092b480 x1830964746320768/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/4536 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.072118:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092b480 with x1830964746320768 ext(3497984->3502079) 00002000:00010000:1.0:1746144649.072121:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092b480 00000100:00100000:0.0:1746144649.078380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.083815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.088234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.088278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.088375:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746321920 00000100:00100000:1.0:1746144649.088385:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746321920 00002000:00100000:1.0:1746144649.088427:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee5c00 x1830964746321920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 504/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.088437:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5c00 with x1830964746321920 ext(3145728->4194303) 00002000:00010000:1.0:1746144649.088442:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee5c00 00000100:00100000:1.0:1746144649.088470:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746321792 00000100:00100000:1.0:1746144649.088473:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746321792 00002000:00100000:1.0:1746144649.088484:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093ee7800 x1830964746321792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.088491:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7800 with x1830964746321792 ext(2097152->3145727) 00002000:00010000:1.0:1746144649.088493:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee7800 00000100:00100000:1.0:1746144649.088505:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4049 00000100:00100000:1.0:1746144649.088513:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746321920:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.098063:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746321920:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9543us (9830us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746144649.098074:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4049 00002000:00100000:1.0:1746144649.098085:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee5c00 x1830964746321920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 504/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.098093:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5c00 with x1830964746321920 ext(3145728->4194303) 00002000:00010000:1.0:1746144649.098097:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee5c00 00000100:00100000:0.0:1746144649.113778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.125276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.138777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.139330:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746322688 00000100:00100000:1.0:1746144649.139340:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746322688 00000100:00100000:1.0:1746144649.139423:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9895 00000100:00100000:1.0:1746144649.139431:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28723:x1830964746322688:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144649.139451:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.139466:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333800/0xa7c849b16e018358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152da9c expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.139515:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139524:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139533:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139543:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139549:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139553:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139641:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.139651:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.139657:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.141372:0:22257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.141386:0:22257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 309 pid: 15388 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.141397:0:22257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747348608:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.141484:0:22257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.145601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.145695:0:22257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747348608:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.145719:0:22257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000100:00100000:0.0:1746144649.149684:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323072 00000100:00100000:0.0:1746144649.149691:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323072 00010000:00010000:0.0:1746144649.149717:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.149748:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5414 00000100:00100000:0.0:1746144649.149754:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1963:x1830964746323072:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.149766:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.149770:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.149780:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.149798:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332000/0xa7c849b16e018095 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d8dc expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.149812:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144649.149816:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144649.149824:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144649.149829:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144649.149939:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.149969:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1963:x1830964746323072:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 214us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.149975:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5414 00010000:00010000:1.0:1746144649.150341:0:22257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150348:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000004:00200000:1.0:1746144649.150381:0:22257:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:1.0:1746144649.150385:0:22257:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144649.150398:0:22257:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150406:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150414:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150419:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150424:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150428:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f332a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144649.150432:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150437:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150444:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144649.150446:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144649.150450:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150454:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332a00/0xa7c849b16e01835f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150475:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150480:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150484:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150487:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f332200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144649.150490:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150494:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150499:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f3c3700) 00010000:00010000:1.0:1746144649.150501:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144649.150503:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150506:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f332200/0xa7c849b16e018366 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.150532:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333800/0xa7c849b16e018358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da9c expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.150542:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da9c expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.150548:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.150550:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144649.150552:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f333e00, rc 0) 00000100:00100000:1.0:1746144649.151318:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28723:x1830964746322688:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 11886us (12548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.151324:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9895 00000100:00100000:0.0:1746144649.154370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.154442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.154471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.154485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.154514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.154531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.154562:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323200 00000100:00100000:0.0:1746144649.154568:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323200 00000100:00100000:0.0:1746144649.154605:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323328 00000100:00100000:0.0:1746144649.154607:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323328 00000100:00100000:0.0:1746144649.154620:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323584 00000100:00100000:0.0:1746144649.154621:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323584 00000100:00100000:0.0:1746144649.154628:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323840 00000100:00100000:0.0:1746144649.154629:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323840 00000100:00100000:0.0:1746144649.154636:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323456 00000100:00100000:0.0:1746144649.154638:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323456 00000100:00100000:0.0:1746144649.154645:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746323712 00000100:00100000:0.0:1746144649.154647:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746323712 00000100:00100000:0.0:1746144649.154659:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10962 00000100:00100000:0.0:1746144649.154665:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746323200:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144649.154679:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.154692:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f107600/0xa7c849b16e018374 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152daa3 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.154711:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154712:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154719:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f107600/0xa7c849b16e018374 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152daa3 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154731:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f107600/0xa7c849b16e018374 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152daa3 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154740:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107600, rc 0) 00000100:00100000:0.0:1746144649.154768:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746323200:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 104us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.154773:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10962 00000100:00100000:0.0:1746144649.154784:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10963 00000100:00100000:0.0:1746144649.154787:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746323328:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144649.154793:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.154799:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152daaa expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.154808:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154809:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154812:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154820:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154825:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107c00, rc 0) 00000100:00100000:0.0:1746144649.154834:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746323328:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.154838:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10963 00000100:00100000:0.0:1746144649.154844:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10964 00000100:00100000:0.0:1746144649.154847:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746323584:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144649.154851:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.154855:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f107a00/0xa7c849b16e018382 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dab8 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.154863:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154864:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154867:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f107a00/0xa7c849b16e018382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab8 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154874:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f107a00/0xa7c849b16e018382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab8 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154879:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107a00, rc 0) 00000100:00100000:0.0:1746144649.154887:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746323584:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.154890:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10964 00000100:00100000:0.0:1746144649.154896:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10965 00000100:00100000:0.0:1746144649.154899:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746323840:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144649.154903:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.154907:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dac6 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.154913:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154914:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154917:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dac6 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154924:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dac6 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154929:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f106800, rc 0) 00000100:00100000:0.0:1746144649.154938:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746323840:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 38us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.154941:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10965 00000100:00100000:0.0:1746144649.154947:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10966 00000100:00100000:0.0:1746144649.154951:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746323456:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144649.154954:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.154958:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e018390 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dab1 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.154964:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154965:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.154968:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e018390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab1 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154974:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e018390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab1 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.154979:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107e00, rc 0) 00000100:00100000:0.0:1746144649.154989:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746323456:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 38us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.154992:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10966 00000100:00100000:0.0:1746144649.154998:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10967 00000100:00100000:0.0:1746144649.155001:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746323712:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144649.155005:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.155008:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f106600/0xa7c849b16e018397 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dabf expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.155042:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747348736:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144649.155086:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746144649.155221:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746144649.155224:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144649.162978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.163020:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746324096 00000100:00100000:1.0:1746144649.163028:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746324096 00000100:00100000:1.0:1746144649.163076:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9896 00000100:00100000:1.0:1746144649.163083:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28723:x1830964746324096:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144649.163101:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.163116:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333a00/0xa7c849b16e01839e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dacd expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.163218:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333c00/0xa7c849b16e0183a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.163231:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da9c expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.163237:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333c00/0xa7c849b16e0183a5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144649.163259:0:22257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da9c expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.163270:0:22257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333e00/0xa7c849b16e01836d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da9c expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.163279:0:22257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747348864:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.163352:0:22257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.166336:0:22257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747348864:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.166359:0:22257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f333c00/0xa7c849b16e0183a5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000100:00100000:0.0:1746144649.168483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.171948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.177556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.183430:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746324736 00000100:00100000:1.0:1746144649.183437:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746324736 00000100:00100000:1.0:1746144649.183466:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746324864 00000100:00100000:1.0:1746144649.183469:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746324864 00000100:00100000:1.0:1746144649.183481:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746324992 00000100:00100000:1.0:1746144649.183483:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746324992 00000100:00100000:1.0:1746144649.183491:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746325120 00000100:00100000:1.0:1746144649.183493:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746325120 00000100:00100000:1.0:1746144649.183501:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746325248 00000100:00100000:1.0:1746144649.183502:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746325248 00000100:00100000:1.0:1746144649.183510:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746325376 00000100:00100000:1.0:1746144649.183512:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746325376 00000100:00100000:1.0:1746144649.183522:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10968 00000100:00100000:1.0:1746144649.183528:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746324736:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144649.183563:0:8388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183578:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 36 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183585:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f107600/0xa7c849b16e018374 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152daa3 expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183592:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e0181bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152d98b expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183598:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.183600:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.183603:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183627:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e0181bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d98b expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183637:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e0181bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d98b expref: 23 pid: 4758 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.183647:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747348992:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.183708:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f107600/0xa7c849b16e018374 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daa3 expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183715:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f107600/0xa7c849b16e018374 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daa3 expref: 12 pid: 22208 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.183721:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747349120:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.183738:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 36 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183745:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 36 pid: 4760 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.183750:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747349248:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.183760:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.183775:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10969 00000100:00100000:1.0:1746144649.183780:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746324864:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144649.183796:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183804:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183809:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183815:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183819:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.183820:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.183821:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183833:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183839:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.183847:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747349376:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.183863:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183873:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.183879:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747349504:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.183893:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183898:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 26 pid: 4758 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.183904:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747349632:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.183913:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.183923:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10970 00000100:00100000:1.0:1746144649.183927:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746324992:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144649.183939:0:8389:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e0183dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183947:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183953:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e018390 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab1 expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183957:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.183959:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.183960:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e0183dd lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.183971:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e018390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab1 expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.183977:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e018390 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab1 expref: 13 pid: 22208 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.183983:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747349760:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.184008:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.184014:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.184020:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747349888:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.184031:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.184042:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10971 00000100:00100000:1.0:1746144649.184046:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746325120:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144649.184056:0:29370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4de400/0xa7c849b16e0183e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.184064:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f332e00/0xa7c849b16e01834a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152da8e expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.184074:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f107a00/0xa7c849b16e018382 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab8 expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.184079:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.184080:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.184082:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4de400/0xa7c849b16e0183e4 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.184095:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f107a00/0xa7c849b16e018382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab8 expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.184101:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f107a00/0xa7c849b16e018382 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dab8 expref: 12 pid: 22208 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.184109:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747350016:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.184127:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f332e00/0xa7c849b16e01834a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da8e expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.184154:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f332e00/0xa7c849b16e01834a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da8e expref: 23 pid: 8453 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.184161:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747350144:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.184186:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.194919:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747348992:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.194929:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747349120:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.194936:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747349248:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.194959:0:8388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144649.196551:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747349376:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.196559:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747349504:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.196566:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747349632:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.196580:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.196655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.197226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.197419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.197515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.197971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.199038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.200562:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746325760 00000100:00100000:1.0:1746144649.200566:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746325760 00010000:00010000:1.0:1746144649.200580:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 25 pid: 8453 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.200593:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5421 00000100:00100000:1.0:1746144649.200596:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746325760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.200602:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.200610:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 25 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.200617:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 25 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.200626:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f333200/0xa7c849b16e018320 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da80 expref: 25 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.200636:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.200638:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.200640:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e0183dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.200645:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e0183dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.200655:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144649.200681:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746325760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 83us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.200685:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5421 00000100:00100000:0.0:1746144649.200743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.200800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.200812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.200823:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746326400 00000100:00100000:0.0:1746144649.200827:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746326400 00010000:00010000:0.0:1746144649.200839:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 27 pid: 4758 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.200850:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746325632 00000100:00100000:0.0:1746144649.200851:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746325632 00010000:00010000:0.0:1746144649.200859:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 37 pid: 4760 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.200869:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746326016 00000100:00100000:0.0:1746144649.200870:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746326016 00010000:00010000:0.0:1746144649.200877:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.200890:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5422 00000100:00100000:0.0:1746144649.200894:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746326400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.200900:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.200908:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 27 pid: 4758 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.200915:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 27 pid: 4758 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.200925:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c222a00/0xa7c849b16e0182d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da4f expref: 27 pid: 4758 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.200935:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.200949:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746326400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.200953:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5422 00000100:00100000:0.0:1746144649.200961:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5423 00000100:00100000:0.0:1746144649.200965:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1962:x1830964746325632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.200970:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.200976:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 37 pid: 4760 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.200983:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 37 pid: 4760 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.200995:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f107200/0xa7c849b16e01818a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d976 expref: 37 pid: 4760 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.201001:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.201002:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.201005:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201010:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201021:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.201033:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746325632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.201037:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5423 00000100:00100000:0.0:1746144649.201057:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5424 00000100:00100000:0.0:1746144649.201061:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746326016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.201067:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.201073:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201080:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201089:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f107c00/0xa7c849b16e01837b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daaa expref: 13 pid: 22208 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201100:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.201111:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746326016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 50us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.201115:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5424 00000100:00100000:0.0:1746144649.201194:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747350400:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144649.201218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.201231:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746326656 00000100:00100000:0.0:1746144649.201233:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746326656 00002000:00100000:0.0:1746144649.201253:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3497984->3887103) req@ffff88012cefbb80 x1830964746326656/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144649.201261:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefbb80 with x1830964746326656 ext(3497984->3887103) 00010000:00010000:0.0:1746144649.201266:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 22 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.201274:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 22 pid: 8453 timeout: 728 lvb_type: 0 00002000:00010000:0.0:1746144649.201279:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cefbb80 00000100:00100000:0.0:1746144649.201289:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 764 00000100:00100000:0.0:1746144649.201293:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746326656:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144649.201631:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747350528:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144649.201660:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747350656:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144649.201676:0:4760:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.201694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.201701:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746326784 00000100:00100000:0.0:1746144649.201703:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746326784 00010000:00010000:0.0:1746144649.201712:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.201722:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5425 00000100:00100000:0.0:1746144649.201726:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746326784:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.201731:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.201737:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201743:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201752:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b22e00/0xa7c849b16e01830b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da6b expref: 24 pid: 8453 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201758:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.201759:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.201762:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201767:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201782:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.201792:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746326784:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 66us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.201796:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5425 00000100:00100000:0.0:1746144649.201828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.201836:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746326912 00000100:00100000:0.0:1746144649.201838:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746326912 00010000:00010000:0.0:1746144649.201846:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dac6 expref: 12 pid: 22208 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.201856:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5426 00000100:00100000:0.0:1746144649.201859:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746326912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.201863:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.201870:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dac6 expref: 12 pid: 22208 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201876:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dac6 expref: 12 pid: 22208 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201885:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f106800/0xa7c849b16e018389 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dac6 expref: 12 pid: 22208 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.201893:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.201903:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746326912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 44us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.201910:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5426 00010000:00010000:0.0:1746144649.201943:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201949:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201962:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201968:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201974:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201978:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1f1800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144649.201982:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201987:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201994:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.201999:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e0183d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.202030:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746324864:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 18249us (18707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.202037:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10969 00010000:00010000:0.0:1746144649.202063:0:8388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202068:0:8388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202079:0:8388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202083:0:8388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202088:0:8388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202093:0:8388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f332000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144649.202095:0:8388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202100:0:8388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202107:0:8388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.202112:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f332000/0xa7c849b16e0183cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.202155:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746324736:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 18627us (18886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.202160:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10968 00000100:00100000:0.0:1746144649.202207:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747350272:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144649.202217:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144649.204021:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746327040 00000100:00100000:1.0:1746144649.204025:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746327040 00010000:00010000:1.0:1746144649.204039:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008be70000/0xa7c849b16e018240 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9f4 expref: 23 pid: 4760 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.204062:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5427 00000100:00100000:1.0:1746144649.204067:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746327040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.204074:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.204082:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008be70000/0xa7c849b16e018240 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9f4 expref: 23 pid: 4760 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.204090:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008be70000/0xa7c849b16e018240 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9f4 expref: 23 pid: 4760 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.204546:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008be70000/0xa7c849b16e018240 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d9f4 expref: 23 pid: 4760 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.204556:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.204557:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.204560:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.204566:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.204578:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144649.204638:0:4760:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204645:0:4760:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204657:0:4760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204665:0:4760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204670:0:4760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204678:0:4760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f541c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144649.204681:0:4760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204685:0:4760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204692:0:4760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.204697:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e0183f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144649.206388:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746327040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1555us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.206394:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5427 00000100:00100000:0.0:1746144649.207452:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746325376:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 22970us (24038us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.207459:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10973 00000100:00100000:1.0:1746144649.209027:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746326656:12345-192.168.204.23@tcp:4:cat.0 Request processed in 7730us (7805us total) trans 17179873071 rc 0/0 00000100:00100000:1.0:1746144649.209034:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 764 00002000:00100000:1.0:1746144649.209042:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3497984->3887103) req@ffff88012cefbb80 x1830964746326656/t17179873071(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/448 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.209051:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefbb80 with x1830964746326656 ext(3497984->3887103) 00010000:00010000:1.0:1746144649.209058:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.209071:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00002000:00010000:1.0:1746144649.209077:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cefbb80 00000100:00100000:1.0:1746144649.213125:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746327296 00000100:00100000:1.0:1746144649.213163:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746327296 00010000:00010000:1.0:1746144649.213189:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.213219:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5429 00000100:00100000:1.0:1746144649.213224:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746327296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.213236:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.213250:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.213259:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.213276:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e018351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152da95 expref: 24 pid: 8453 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.213288:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.213290:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.213293:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.213312:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.213335:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144649.213361:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746327296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 137us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.213366:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5429 00010000:00010000:0.0:1746144649.213509:0:22208:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213517:0:22208:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213532:0:22208:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213537:0:22208:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213544:0:22208:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213549:0:22208:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f541600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144649.213552:0:22208:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213558:0:22208:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213566:0:22208:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.213570:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f541600/0xa7c849b16e0183eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.213628:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746325248:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 29252us (30241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.213638:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10972 00000100:00100000:0.0:1746144649.216898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.220077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.220341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.220369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.220385:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746327936 00000100:00100000:0.0:1746144649.220389:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746327936 00010000:00010000:0.0:1746144649.220411:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62dc00/0xa7c849b16e017e11 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d770 expref: 310 pid: 15388 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.220428:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746328064 00000100:00100000:0.0:1746144649.220430:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746328064 00010000:00010000:0.0:1746144649.220439:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23200/0xa7c849b16e017e1f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d77e expref: 36 pid: 14709 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.220449:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746327808 00000100:00100000:0.0:1746144649.220451:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746327808 00010000:00010000:0.0:1746144649.220457:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e017e2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d78c expref: 311 pid: 20319 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.220468:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5430 00000100:00100000:0.0:1746144649.220474:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1960:x1830964746327936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.220484:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.220488:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62dc00/0xa7c849b16e017e11 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d770 expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.220495:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62dc00/0xa7c849b16e017e11 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d770 expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.220510:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62dc00/0xa7c849b16e017e11 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d770 expref: 311 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.220521:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144649.220524:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541200/0xa7c849b16e0183f9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144649.220531:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.220559:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1960:x1830964746327936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 84us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.220565:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5430 00000100:00100000:0.0:1746144649.220595:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5431 00000100:00100000:0.0:1746144649.220600:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+36:1962:x1830964746328064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144649.220602:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5432 00010000:00010000:0.0:1746144649.220605:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144649.220609:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1960:x1830964746327808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.220609:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23200/0xa7c849b16e017e1f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d77e expref: 36 pid: 14709 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.220614:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.220616:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23200/0xa7c849b16e017e1f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d77e expref: 36 pid: 14709 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.220618:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e017e2d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d78c expref: 309 pid: 20319 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.220625:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b23200/0xa7c849b16e017e1f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d77e expref: 36 pid: 14709 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.220626:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e017e2d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d78c expref: 309 pid: 20319 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.220634:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.220635:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e017e2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d78c expref: 309 pid: 20319 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.220637:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541200/0xa7c849b16e0183f9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144649.220641:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144649.220642:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.220645:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541200/0xa7c849b16e0183f9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144649.220649:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.220652:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746328064:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.220657:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5431 00000100:00100000:1.0:1746144649.220659:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:1960:x1830964746327808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.220664:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5432 00000100:00100000:0.0:1746144649.220687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.220723:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746327680 00000100:00100000:1.0:1746144649.220726:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746327680 00000100:00100000:0.0:1746144649.220771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144649.220964:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993da00/0xa7c849b16e017e9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7e7 expref: 308 pid: 15388 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.220979:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5433 00000100:00100000:1.0:1746144649.220983:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:1962:x1830964746327680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.220989:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.220993:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009993da00/0xa7c849b16e017e9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7e7 expref: 308 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.220999:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009993da00/0xa7c849b16e017e9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7e7 expref: 308 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.221008:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993da00/0xa7c849b16e017e9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152d7e7 expref: 308 pid: 15388 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.221016:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.221019:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541200/0xa7c849b16e0183f9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144649.221024:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144649.221039:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:1962:x1830964746327680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 56us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.221044:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5433 00000001:00080000:0.0:1746144649.255608:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943738 is committed 00000001:00080000:0.0:1746144649.255623:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943722 is committed 00000001:00080000:0.0:1746144649.255628:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943739 is committed 00000001:00080000:0.0:1746144649.255656:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943745 is committed 00000004:00080000:0.0:1746144649.255661:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1905 committed 00000004:00080000:0.0:1746144649.255668:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1967 committed 00000004:00080000:0.0:1746144649.255674:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746144649.255675:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1965 committed 00000004:00080000:0.0:1746144649.255677:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1964 committed 00000004:00080000:0.0:1746144649.255679:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1904 committed 00000004:00080000:0.0:1746144649.255681:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1963 committed 00000004:00080000:0.0:1746144649.255684:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1903 committed 00000004:00080000:0.0:1746144649.255686:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1962 committed 00000004:00080000:0.0:1746144649.255687:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1902 committed 00000004:00080000:0.0:1746144649.255689:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1901 committed 00000004:00080000:0.0:1746144649.255691:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1900 committed 00000004:00080000:0.0:1746144649.255692:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1961 committed 00000004:00080000:0.0:1746144649.255694:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1960 committed 00000004:00080000:0.0:1746144649.255695:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1899 committed 00000004:00080000:0.0:1746144649.255697:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:0.0:1746144649.255698:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1959 committed 00000001:00080000:0.0:1746144649.255736:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943742 is committed 00000001:00080000:0.0:1746144649.255739:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943741 is committed 00000100:00100000:0.0:1746144649.255929:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747351424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.255976:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256002:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747351936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256014:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256027:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746144649.256031:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747351552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256041:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256049:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747352064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256061:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256077:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747351808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256098:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747352320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256108:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256117:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746144649.256120:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747351680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256160:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747352192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256171:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.256188:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747351424 00000100:00100000:0.0:1746144649.256195:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747351424 00000100:00100000:0.0:1746144649.256222:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747351936 00000100:00100000:0.0:1746144649.256224:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747351936 00000100:00100000:0.0:1746144649.256232:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747351552 00000100:00100000:0.0:1746144649.256234:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747351552 00000100:00100000:0.0:1746144649.256241:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747352064 00000100:00100000:0.0:1746144649.256242:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747352064 00000100:00100000:0.0:1746144649.256249:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747351808 00000100:00100000:0.0:1746144649.256251:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747351808 00000100:00100000:0.0:1746144649.256256:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747352320 00000100:00100000:0.0:1746144649.256258:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747352320 00000100:00100000:0.0:1746144649.256263:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747351680 00000100:00100000:0.0:1746144649.256265:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747351680 00000100:00100000:0.0:1746144649.256270:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747352192 00000100:00100000:0.0:1746144649.256271:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747352192 00000100:00100000:0.0:1746144649.256279:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10974 00000100:00100000:0.0:1746144649.256284:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830964747351424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256474:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830964747351424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (497us total) trans 17179873072 rc 0/0 00000100:00100000:0.0:1746144649.256480:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10974 00000100:00100000:0.0:1746144649.256491:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10975 00000100:00100000:0.0:1746144649.256495:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830964747351936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256559:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830964747351936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (544us total) trans 17179873073 rc 0/0 00000100:00100000:0.0:1746144649.256565:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10975 00000100:00100000:0.0:1746144649.256573:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10976 00000100:00100000:0.0:1746144649.256576:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830964747351552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256640:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830964747351552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (597us total) trans 17179873074 rc 0/0 00000100:00100000:0.0:1746144649.256645:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10976 00000100:00100000:0.0:1746144649.256652:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10977 00000100:00100000:0.0:1746144649.256656:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830964747352064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256713:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830964747352064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (650us total) trans 17179873075 rc 0/0 00000100:00100000:0.0:1746144649.256717:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10977 00000100:00100000:0.0:1746144649.256724:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10978 00000100:00100000:0.0:1746144649.256728:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747351808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256786:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747351808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (695us total) trans 17179873076 rc 0/0 00000100:00100000:0.0:1746144649.256791:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10978 00000100:00100000:0.0:1746144649.256798:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10979 00000100:00100000:0.0:1746144649.256802:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747352320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256865:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747352320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (755us total) trans 17179873077 rc 0/0 00000100:00100000:0.0:1746144649.256873:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10979 00000100:00100000:0.0:1746144649.256880:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10980 00000100:00100000:0.0:1746144649.256884:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747351680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.256947:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747351680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (815us total) trans 17179873078 rc 0/0 00000100:00100000:0.0:1746144649.256952:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10980 00000100:00100000:0.0:1746144649.256960:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10981 00000100:00100000:0.0:1746144649.256964:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747352192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.257024:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747352192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (852us total) trans 17179873079 rc 0/0 00000100:00100000:0.0:1746144649.257029:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10981 00000004:00080000:0.0:1746144649.257082:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cef8000/2, rc 0, transno 17179873078 00000100:00100000:0.0:1746144649.257090:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747351680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257097:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cefb480/2, rc 0, transno 17179873079 00000100:00100000:0.0:1746144649.257099:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747352192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257105:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cefaa00/2, rc 0, transno 17179873076 00000100:00100000:0.0:1746144649.257107:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747351808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257114:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cef9180/2, rc 0, transno 17179873077 00000100:00100000:0.0:1746144649.257116:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747352320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.257161:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746144649.257167:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747352448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.257187:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.257206:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747352448 00000100:00100000:0.0:1746144649.257209:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747352448 00000100:00100000:0.0:1746144649.257221:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10982 00000100:00100000:0.0:1746144649.257225:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747352448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.257294:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3296:x1830964747352448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (107us total) trans 17179873080 rc 0/0 00000100:00100000:0.0:1746144649.257311:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10982 00000004:00080000:0.0:1746144649.257330:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f39b480/2, rc 0, transno 17179873080 00000100:00100000:0.0:1746144649.257333:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747352448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257342:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cef8a80/2, rc 0, transno 17179873074 00000100:00100000:0.0:1746144649.257345:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747351552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257349:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cefa680/2, rc 0, transno 17179873075 00000100:00100000:0.0:1746144649.257352:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747352064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257357:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cefad80/2, rc 0, transno 17179873072 00000100:00100000:0.0:1746144649.257360:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747351424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.257364:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cef8380/2, rc 0, transno 17179873073 00000100:00100000:0.0:1746144649.257366:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747351936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.257752:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747352704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.257777:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.257791:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747353216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.257805:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.257815:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746144649.257819:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747352832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.257830:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.257837:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747353344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.257847:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.257860:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747352704 00000100:00100000:1.0:1746144649.257862:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747352704 00000100:00100000:1.0:1746144649.257875:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747353216 00000100:00100000:1.0:1746144649.257877:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747353216 00000100:00100000:1.0:1746144649.257883:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747352832 00000100:00100000:1.0:1746144649.257885:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747352832 00000100:00100000:1.0:1746144649.257891:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747353344 00000100:00100000:1.0:1746144649.257892:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747353344 00000100:00100000:1.0:1746144649.257900:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10983 00000100:00100000:1.0:1746144649.257903:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747352704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.258025:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1830964747352704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (247us total) trans 21474840324 rc 0/0 00000100:00100000:1.0:1746144649.258031:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10983 00000100:00100000:1.0:1746144649.258039:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10984 00000100:00100000:1.0:1746144649.258043:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747353216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.258114:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1830964747353216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (308us total) trans 21474840325 rc 0/0 00000100:00100000:1.0:1746144649.258119:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10984 00000100:00100000:1.0:1746144649.258128:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10985 00000100:00100000:1.0:1746144649.258152:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747352832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.258233:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1830964747352832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (401us total) trans 21474840326 rc 0/0 00000100:00100000:1.0:1746144649.258238:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10985 00000100:00100000:1.0:1746144649.258247:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10986 00000100:00100000:1.0:1746144649.258252:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747353344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.258335:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1830964747353344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (486us total) trans 21474840327 rc 0/0 00000100:00100000:1.0:1746144649.258340:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10986 00000004:00080000:1.0:1746144649.258367:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee0a680/2, rc 0, transno 21474840326 00000100:00100000:1.0:1746144649.258371:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747352832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144649.258378:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee0a300/2, rc 0, transno 21474840327 00000100:00100000:1.0:1746144649.258380:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747353344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144649.258385:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee09500/2, rc 0, transno 21474840324 00000100:00100000:1.0:1746144649.258387:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747352704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144649.258392:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee09c00/2, rc 0, transno 21474840325 00000100:00100000:1.0:1746144649.258395:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747353216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.260245:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747352576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.260293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.261492:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747353088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.261517:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.261882:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144649.261888:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747352960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.261905:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.261964:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747353472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.261980:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144649.262632:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f437800/2, rc 0, transno 21474840328 00000100:00100000:0.0:1746144649.262638:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747352576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144649.262644:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee08000/2, rc 0, transno 21474840329 00000100:00100000:0.0:1746144649.262647:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747353088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144649.262653:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee0b100/2, rc 0, transno 21474840330 00000100:00100000:0.0:1746144649.262656:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747352960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.262669:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747353472 00000100:00100000:0.0:1746144649.262671:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747353472 00000100:00100000:0.0:1746144649.262685:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10990 00000100:00100000:0.0:1746144649.262689:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747353472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.262770:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747353472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (789us total) trans 21474840331 rc 0/0 00000100:00100000:0.0:1746144649.262775:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10990 00000004:00080000:0.0:1746144649.262794:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013129d500/2, rc 0, transno 21474840331 00000100:00100000:0.0:1746144649.262797:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747353472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.274392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.276347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.276438:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746328704 00000100:00100000:1.0:1746144649.276446:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746328704 00000100:00100000:1.0:1746144649.276491:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3950 00000100:00100000:1.0:1746144649.276498:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28723:x1830964746328704:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:1.0:1746144649.276703:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28723:x1830964746328704:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 204us (363us total) trans 8589943746 rc 0/0 00000100:00100000:1.0:1746144649.276709:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3950 00000100:00100000:0.0:1746144649.278328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.306455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.308646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.311659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.312528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.315393:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746329856 00000100:00100000:1.0:1746144649.315405:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746329856 00000100:00100000:1.0:1746144649.315475:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3952 00000100:00100000:1.0:1746144649.315483:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28732:x1830964746329856:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144649.315690:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28732:x1830964746329856:12345-192.168.204.23@tcp:35:cat.0 Request processed in 208us (4035us total) trans 8589943750 rc 0/0 00000100:00100000:1.0:1746144649.315697:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3952 00000100:00100000:1.0:1746144649.316278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.316296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.316320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.316338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.316355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.316368:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746330112 00000100:00100000:1.0:1746144649.316371:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746330112 00000100:00100000:1.0:1746144649.316384:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10993 00000100:00100000:1.0:1746144649.316388:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746330240:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144649.316393:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.316401:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e018454 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db0c expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144649.316413:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d89, atime: 0x68140d89, ctime: 0x68140d89, blocks: 0x821 00010000:00010000:1.0:1746144649.316419:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.316421:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.316425:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e018454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db0c expref: 26 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.316434:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e018454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db0c expref: 26 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.316441:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136932600, rc 0) 00000100:00100000:1.0:1746144649.316455:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746330240:12345-192.168.204.23@tcp:101:cat.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.316460:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10993 00000100:00100000:0.0:1746144649.319529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.319564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.319649:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746330880 00000100:00100000:1.0:1746144649.319656:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746330880 00000100:00100000:1.0:1746144649.319688:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10997 00000100:00100000:1.0:1746144649.319693:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746330880:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144649.319706:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.319717:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f541200/0xa7c849b16e018485 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db28 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.319734:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.319736:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.319742:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f541200/0xa7c849b16e018485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db28 expref: 37 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.319753:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f541200/0xa7c849b16e018485 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db28 expref: 37 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.319761:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f541200, rc 0) 00000100:00100000:0.0:1746144649.320423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.320501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.320517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.320529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.320536:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746330880:12345-192.168.204.23@tcp:101:cat.0 Request processed in 526us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.320539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.320542:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10997 00000100:00100000:1.0:1746144649.320554:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746331008 00000100:00100000:1.0:1746144649.320556:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746331008 00000100:00100000:0.0:1746144649.320568:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.320569:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746331392 00000100:00100000:1.0:1746144649.320571:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746331392 00000100:00100000:1.0:1746144649.320579:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746331520 00000100:00100000:1.0:1746144649.320581:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746331520 00000100:00100000:1.0:1746144649.320589:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746331648 00000100:00100000:1.0:1746144649.320590:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746331648 00000100:00100000:0.0:1746144649.320593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.320598:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746331776 00000100:00100000:1.0:1746144649.320600:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746331776 00000100:00100000:0.0:1746144649.320609:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10998 00000100:00100000:0.0:1746144649.320614:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746331008:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144649.321507:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.321516:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db2f expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.321528:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.321529:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.321535:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.321544:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.321550:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f08f800, rc 0) 00000100:00100000:0.0:1746144649.321570:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746331008:12345-192.168.204.23@tcp:101:cat.0 Request processed in 956us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.321697:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10999 00000100:00100000:1.0:1746144649.321704:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746331392:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144649.321710:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.321717:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e41d000/0xa7c849b16e0184af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db3d expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.321727:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.321729:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.321733:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41d000/0xa7c849b16e0184af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db3d expref: 29 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.321741:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e41d000/0xa7c849b16e0184af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db3d expref: 29 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.321747:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41d000, rc 0) 00000100:00100000:1.0:1746144649.321761:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746331392:12345-192.168.204.23@tcp:101:cat.0 Request processed in 59us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.321766:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10999 00000100:00100000:1.0:1746144649.321775:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11001 00000100:00100000:1.0:1746144649.321779:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746331648:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144649.321784:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.321789:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e41c800/0xa7c849b16e0184bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db4b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.321801:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.321802:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.321805:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41c800/0xa7c849b16e0184bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db4b expref: 39 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.321813:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e41c800/0xa7c849b16e0184bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db4b expref: 39 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144649.321819:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41c800, rc 0) 00000100:00100000:1.0:1746144649.321829:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746331648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 50us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.321834:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11001 00000100:00100000:0.0:1746144649.323232:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10998 00000100:00100000:0.0:1746144649.330790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.330816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.335655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.335689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.335968:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.336028:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746332800 00000100:00100000:1.0:1746144649.336031:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746332800 00000100:00100000:1.0:1746144649.336049:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9909 00000100:00100000:1.0:1746144649.336053:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28734:x1830964746332800:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144649.336060:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.336061:0:15388:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144649.336287:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a000/0xa7c849b16e0184d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db60 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336308:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.336311:0:15388:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144649.336316:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41cc00/0xa7c849b16e0184e7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db75 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336344:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.336351:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336357:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e0184cb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db59 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336363:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336368:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e0184d9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db67 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336372:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 7/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.336392:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e0184d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db67 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.336585:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e0184d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db67 expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.336726:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747353856:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.337397:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.337476:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.337485:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747353984:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.337531:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e0184cb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db59 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.337537:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e0184cb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db59 expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.337544:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747354112:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.337564:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.337570:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 8 pid: 14709 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.337577:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747354240:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.337590:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.343627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.344796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.344926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.344957:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746333312 00000100:00100000:0.0:1746144649.344962:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746333312 00010000:00010000:0.0:1746144649.344991:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 9 pid: 14709 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.345014:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5437 00000100:00100000:0.0:1746144649.345020:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746333312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.345030:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.345035:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 9 pid: 14709 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.345044:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 9 pid: 14709 timeout: 728 lvb_type: 0 00010000:00010000:0.0:1746144649.345060:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144649.345065:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144649.345072:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144649.345076:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.345107:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746333312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 87us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.345113:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5437 00010000:00010000:1.0:1746144649.345267:0:15388:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from blocking AST (req@ffff8800a4ebd500 x1830964747353856) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e0184d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db67 expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.345278:0:15388:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e0184d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db67 expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.345293:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e0184d9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db67 expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.345318:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747353856:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144649.345331:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747353984:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.345337:0:15388:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from blocking AST (req@ffff8800a51ec700 x1830964747354112) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e0184cb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db59 expref: 9 pid: 22257 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.345344:0:15388:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e0184cb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db59 expref: 9 pid: 22257 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.345352:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e0184cb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db59 expref: 10 pid: 22257 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.345358:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747354112:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.345365:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f541600/0xa7c849b16e018400 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dae2 expref: 8 pid: 14709 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.345372:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747354240:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144649.345396:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.345399:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.345404:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.345414:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:1.0:1746144649.348961:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746333568 00000100:00100000:1.0:1746144649.348968:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746333568 00010000:00010000:1.0:1746144649.348995:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.349018:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5438 00000100:00100000:1.0:1746144649.349023:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1960:x1830964746333568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.349033:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.349038:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.349047:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.349065:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec2a200/0xa7c849b16e0184e0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db6e expref: 303 pid: 14708 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.349075:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.349079:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.349086:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.349091:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.349100:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144649.349104:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144649.349118:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.349413:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4054 00000100:00100000:0.0:1746144649.349419:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746334336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.349471:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1960:x1830964746333568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 446us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.349477:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5438 00010000:00010000:1.0:1746144649.349501:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144649.349506:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15388 initiator: MDT0 00000040:00080000:1.0:1746144649.350016:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2785, 88 off232016 00000004:00080000:1.0:1746144649.350021:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628558886438ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351362:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2719, 88 off226200 00000004:00080000:1.0:1746144649.351368:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560232895ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351382:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2720, 88 off226288 00000004:00080000:1.0:1746144649.351385:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560250270ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351392:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2786, 88 off232104 00000004:00080000:1.0:1746144649.351394:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560259705ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351399:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2787, 88 off232192 00000004:00080000:1.0:1746144649.351402:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560267071ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351406:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2721, 88 off226376 00000004:00080000:1.0:1746144649.351409:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560274255ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351414:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2722, 88 off226464 00000004:00080000:1.0:1746144649.351417:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560282079ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351422:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2723, 88 off226552 00000004:00080000:1.0:1746144649.351424:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560289946ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351430:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2788, 88 off232280 00000004:00080000:1.0:1746144649.351432:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560297943ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351438:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2724, 88 off226640 00000004:00080000:1.0:1746144649.351440:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560305665ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351445:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2789, 88 off232368 00000004:00080000:1.0:1746144649.351447:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560312618ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351453:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2725, 88 off226728 00000004:00080000:1.0:1746144649.351455:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560320108ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144649.351459:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2790, 88 off232456 00000004:00080000:1.0:1746144649.351461:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560326753ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351466:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2791, 88 off232544 00000004:00080000:1.0:1746144649.351467:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560333056ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351473:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2792, 88 off232632 00000004:00080000:1.0:1746144649.351474:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560340015ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351479:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2793, 88 off232720 00000004:00080000:1.0:1746144649.351481:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628560346718ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144649.351486:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2726, 88 off226816 00000004:00080000:1.0:1746144649.351488:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628560353280ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144649.353903:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746333440 00000100:00100000:0.0:1746144649.353911:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746333440 00000100:00100000:0.0:1746144649.353944:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9911 00000100:00100000:0.0:1746144649.353951:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28732:x1830964746333440:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144649.353965:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.353977:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db83 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.354017:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144649.354025:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 304 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.354037:0:14710:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144649.354047:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 304 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.354057:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144649.354059:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144649.354061:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144649.354070:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b400, rc 0) 00000100:00100000:0.0:1746144649.354094:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:28732:x1830964746333440:12345-192.168.204.23@tcp:101:cat.0 Request processed in 144us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.354100:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9911 00000100:00100000:0.0:1746144649.377404:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746334336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27977us (28392us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144649.377414:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4054 00002000:00100000:0.0:1746144649.377424:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880099b8ca80 x1830964746334336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144649.377433:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ca80 with x1830964746334336 ext(1048576->2097151) 00002000:00010000:0.0:1746144649.377438:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8ca80 00000100:00100000:1.0:1746144649.382938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144649.395474:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db75 expref: 304 pid: 15388 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144649.395647:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943753 is committed 00000004:00080000:0.0:1746144649.395654:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1913 committed 00000004:00080000:0.0:1746144649.395668:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746144649.395673:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746144649.395674:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:0.0:1746144649.395675:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:0.0:1746144649.395677:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1912 committed 00000004:00080000:0.0:1746144649.395678:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:0.0:1746144649.395679:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1911 committed 00000004:00080000:0.0:1746144649.395681:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:0.0:1746144649.395682:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1910 committed 00000004:00080000:0.0:1746144649.395683:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1909 committed 00000004:00080000:0.0:1746144649.395684:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1908 committed 00000004:00080000:0.0:1746144649.395685:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:0.0:1746144649.395686:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000004:00080000:0.0:1746144649.395687:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1907 committed 00000004:00080000:0.0:1746144649.395690:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1906 committed 00000004:00080000:0.0:1746144649.395691:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1968 committed 00000001:00080000:0.0:1746144649.395698:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943746 is committed 00010000:00010000:1.0:1746144649.395755:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144649.395759:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746144649.395763:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144649.395771:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db75 expref: 302 pid: 15388 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144649.395916:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943751 is committed 00000001:00080000:0.0:1746144649.395923:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943747 is committed 00000100:00100000:0.0:1746144649.396019:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747354368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.396066:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746144649.396105:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00000100:00100000:0.0:1746144649.396110:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747354880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.396125:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746144649.396152:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db75 expref: 300 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.396164:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e41d200/0xa7c849b16e0184ee lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db75 expref: 300 pid: 15388 timeout: 728 lvb_type: 0 00000100:00100000:0.0:1746144649.396164:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144649.396168:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747354752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.396173:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747355392:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144649.396183:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.396221:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.396285:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747355264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.396313:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.396332:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747354496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.396347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.396357:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.396368:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.397779:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747355008 00000100:00100000:1.0:1746144649.397782:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747355008 00000100:00100000:0.0:1746144649.397816:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.397839:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.397852:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747356160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.397866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.397875:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746144649.397880:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747354624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.397894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.397902:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.397913:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.397919:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.397930:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.397935:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747356288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.397946:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.398179:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747355648 00000100:00100000:0.0:1746144649.398183:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747355648 00000100:00100000:1.0:1746144649.398203:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747356160 00000100:00100000:1.0:1746144649.398206:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747356160 00000100:00100000:1.0:1746144649.398214:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747354624 00000100:00100000:1.0:1746144649.398216:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747354624 00000100:00100000:0.0:1746144649.398242:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747355776 00000100:00100000:0.0:1746144649.398274:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747355776 00000100:00100000:1.0:1746144649.398362:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11005 00000100:00100000:1.0:1746144649.398368:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3296:x1830964747354752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.398819:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747354752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 451us (2634us total) trans 17179873083 rc 0/0 00000100:00100000:1.0:1746144649.398824:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11005 00000100:00100000:1.0:1746144649.398834:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11011 00000100:00100000:1.0:1746144649.398838:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747354624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.398901:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11013 00000100:00100000:1.0:1746144649.398906:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747356288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.398980:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3293:x1830964747356288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1033us total) trans 21474840334 rc 0/0 00000100:00100000:1.0:1746144649.398985:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11013 00000100:00100000:1.0:1746144649.398993:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747355904 00000100:00100000:1.0:1746144649.398996:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747355904 00000100:00100000:1.0:1746144649.399004:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747356416 00000100:00100000:1.0:1746144649.399005:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747356416 00000100:00100000:0.0:1746144649.399007:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11014 00000100:00100000:1.0:1746144649.399012:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11015 00000100:00100000:0.0:1746144649.399012:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3293:x1830964747355776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.399015:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3295:x1830964747355904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.399040:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747355520 00000100:00100000:0.0:1746144649.399043:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747355520 00000100:00100000:0.0:1746144649.399054:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11016 00000100:00100000:0.0:1746144649.399058:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3295:x1830964747356416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144649.399380:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144649.399383:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144649 -> 1746144649 00002000:00010000:1.0:1746144649.399385:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144649 -> 1746144649 00002000:00010000:1.0:1746144649.399387:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144649 -> 1746144649 00002000:00010000:1.0:1746144649.399388:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5611 00000100:00100000:1.0:1746144649.399407:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747354624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 568us (1511us total) trans 17179873088 rc 0/0 00000100:00100000:1.0:1746144649.399413:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11011 00000004:00080000:1.0:1746144649.399610:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cea00/2, rc 0, transno 17179873083 00000100:00100000:0.0:1746144649.399611:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3295:x1830964747356416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 552us (620us total) trans 21474840335 rc 0/0 00000100:00100000:0.0:1746144649.399616:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11016 00000100:00100000:1.0:1746144649.399618:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747354752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144649.399627:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cfb80/2, rc 0, transno 17179873084 00000100:00100000:1.0:1746144649.399630:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747355264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.399633:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cf800/2, rc 0, transno 17179873088 00000100:00100000:0.0:1746144649.399635:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747354624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144649.399637:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb4d180/2, rc 0, transno 17179873081 00000100:00100000:1.0:1746144649.399639:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747354368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.399641:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1ced80/2, rc 0, transno 17179873087 00000100:00100000:0.0:1746144649.399644:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144649.399645:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cca80/2, rc 0, transno 17179873082 00000100:00100000:1.0:1746144649.399647:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747354880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.399650:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb4e00/2, rc 0, transno 21474840334 00000100:00100000:0.0:1746144649.399653:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747356288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144649.399661:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32df80/2, rc 0, transno 21474840333 00000100:00100000:0.0:1746144649.399664:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144649.399669:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cd500/2, rc 0, transno 17179873085 00000100:00100000:0.0:1746144649.399672:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747354496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.399677:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cce00/2, rc 0, transno 17179873086 00000100:00100000:0.0:1746144649.399679:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747355008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.399681:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747356544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.399699:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746144649.399751:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144649.399753:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144649 -> 1746144649 00002000:00010000:0.0:1746144649.399755:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144648 -> 1746144648 00002000:00010000:0.0:1746144649.399757:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144649 -> 1746144649 00002000:00010000:0.0:1746144649.399758:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144649.400224:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3293:x1830964747355776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1211us (2292us total) trans 21474840336 rc 0/0 00000100:00100000:0.0:1746144649.400229:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11014 00000004:00080000:1.0:1746144649.400274:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eed80/2, rc 0, transno 17179873089 00000100:00100000:1.0:1746144649.400277:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747356544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.409390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144649.411065:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144649.411072:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00000040:00080000:0.0:1746144649.411689:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2794, 88 off232808 00000004:00080000:0.0:1746144649.411694:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620559289ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411741:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2727, 88 off226904 00000004:00080000:0.0:1746144649.411744:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620609681ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411764:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2728, 88 off226992 00000004:00080000:0.0:1746144649.411768:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620633041ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411774:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2795, 88 off232896 00000004:00080000:0.0:1746144649.411777:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620642470ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411783:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2796, 88 off232984 00000004:00080000:0.0:1746144649.411785:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620650750ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411791:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2729, 88 off227080 00000004:00080000:0.0:1746144649.411794:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620659550ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411800:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2730, 88 off227168 00000004:00080000:0.0:1746144649.411802:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620667893ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411808:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2731, 88 off227256 00000004:00080000:0.0:1746144649.411811:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620676426ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411817:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2797, 88 off233072 00000004:00080000:0.0:1746144649.411819:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620684899ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411825:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2732, 88 off227344 00000004:00080000:0.0:1746144649.411827:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620692973ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411833:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2798, 88 off233160 00000004:00080000:0.0:1746144649.411835:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620700526ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411840:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2733, 88 off227432 00000004:00080000:0.0:1746144649.411843:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620708330ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144649.411849:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2799, 88 off233248 00000004:00080000:0.0:1746144649.411851:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620716689ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411857:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2800, 88 off233336 00000004:00080000:0.0:1746144649.411859:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620724628ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411864:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2801, 88 off233424 00000004:00080000:0.0:1746144649.411866:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620731888ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411871:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2802, 88 off233512 00000004:00080000:0.0:1746144649.411874:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 628620739670ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144649.411880:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2734, 88 off227520 00000004:00080000:0.0:1746144649.411883:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628620748471ns, next at 593480289301ns, rc = 0 00010000:00010000:0.0:1746144649.468678:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db7c expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468690:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144649.468692:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746144649.468696:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 297 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468704:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 297 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468709:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 297 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468715:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468720:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468726:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.468757:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.468767:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747356672:192.168.204.23@tcp:105: 00000001:00080000:0.0:1746144649.478370:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943754 is committed 00000004:00080000:0.0:1746144649.478380:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1921 committed 00000004:00080000:0.0:1746144649.478397:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746144649.478402:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746144649.478405:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746144649.478406:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746144649.478407:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1920 committed 00000004:00080000:0.0:1746144649.478408:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746144649.478409:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1919 committed 00000004:00080000:0.0:1746144649.478411:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746144649.478412:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1918 committed 00000004:00080000:0.0:1746144649.478413:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1917 committed 00000004:00080000:0.0:1746144649.478414:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1916 committed 00000004:00080000:0.0:1746144649.478415:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746144649.478417:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1978 committed 00000004:00080000:0.0:1746144649.478419:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1915 committed 00000004:00080000:0.0:1746144649.478420:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1914 committed 00000004:00080000:0.0:1746144649.478422:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1977 committed 00010000:00010000:0.0:1746144649.478480:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 297 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.478492:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747356800:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144649.478533:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.478551:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747356672:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144649.478654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.479450:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747357312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.479795:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746334976 00000100:00100000:0.0:1746144649.479799:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746334976 00000100:00100000:0.0:1746144649.479825:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3953 00000100:00100000:0.0:1746144649.479831:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:28735:x1830964746334976:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:0.0:1746144649.479900:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:28735:x1830964746334976:12345-192.168.204.23@tcp:49:cat.0 Request processed in 69us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.479905:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3953 00000100:00100000:0.0:1746144649.479922:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747357056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.480116:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.480160:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747357824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.480175:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.480183:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747358336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144649.480195:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.480208:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747358848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.480221:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.480511:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.480524:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747357568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144649.480540:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.480552:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747358080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.480565:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.480575:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747358592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.480586:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144649.480603:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747358592 00000100:00100000:0.0:1746144649.480606:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747358592 00000100:00100000:0.0:1746144649.480614:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11026 00000100:00100000:0.0:1746144649.480617:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3294:x1830964747358080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.480687:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747358080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (119us total) trans 17179873092 rc 0/0 00000100:00100000:0.0:1746144649.480692:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11026 00000004:00080000:0.0:1746144649.480716:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eea00/2, rc 0, transno 17179873091 00000100:00100000:0.0:1746144649.480722:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747357056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.480729:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16aa00/2, rc 0, transno 21474840343 00000100:00100000:0.0:1746144649.480732:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747357568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144649.480738:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebdc00/2, rc 0, transno 17179873092 00000100:00100000:0.0:1746144649.480740:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747358080:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144649.480746:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f272680/2, rc 0, transno 17179873093 00000100:00100000:0.0:1746144649.480748:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747358592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.480757:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747357696 00000100:00100000:0.0:1746144649.480759:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747357696 00000100:00100000:0.0:1746144649.480770:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747358208 00000100:00100000:0.0:1746144649.480772:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747358208 00000100:00100000:0.0:1746144649.480780:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11029 00000100:00100000:0.0:1746144649.480784:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3295:x1830964747357696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.480856:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3295:x1830964747357696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (116us total) trans 17179873095 rc 0/0 00000100:00100000:0.0:1746144649.480861:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11029 00000100:00100000:0.0:1746144649.480890:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746144649.480895:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747358976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.480912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144649.481326:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11034 00000100:00100000:1.0:1746144649.481333:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3293:x1830964747357440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.481408:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11036 00000100:00100000:1.0:1746144649.481411:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3293:x1830964747357440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (469us total) trans 17179873098 rc 0/0 00000100:00100000:0.0:1746144649.481413:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3293:x1830964747358464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144649.481416:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11034 00000004:00080000:1.0:1746144649.481439:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b812d80/2, rc 0, transno 21474840342 00000100:00100000:1.0:1746144649.481443:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747358848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144649.481449:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f168380/2, rc 0, transno 21474840340 00000100:00100000:1.0:1746144649.481452:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747357312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144649.481458:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16bb80/2, rc 0, transno 21474840341 00000100:00100000:1.0:1746144649.481460:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747357824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144649.481467:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebd500/2, rc 0, transno 17179873090 00000100:00100000:1.0:1746144649.481469:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747358336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144649.481499:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3293:x1830964747358464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (512us total) trans 21474840347 rc 0/0 00000100:00100000:0.0:1746144649.481504:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11036 00000100:00100000:0.0:1746144649.481529:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747356800:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144649.481554:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e0184f5 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db7c expref: 10 pid: 14708 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746144649.481567:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db7c expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.481588:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ad200, rc 0) 00000100:00100000:0.0:1746144649.481624:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28730:x1830964746333184:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 136247us (136827us total) trans 8589943754 rc 0/0 00000100:00100000:0.0:1746144649.481630:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9910 00000100:00100000:0.0:1746144649.483576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.483640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.490448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.490495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.495255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.499857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.499907:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746335744 00000100:00100000:0.0:1746144649.499920:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746335744 00000100:00100000:0.0:1746144649.499977:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11038 00000100:00100000:0.0:1746144649.499985:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:28730:x1830964746335744:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144649.500004:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.500022:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fa00/0xa7c849b16e01851f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152db9f expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.500052:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541400/0xa7c849b16e018462 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db1a expref: 26 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.500060:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009984ce00/0xa7c849b16e0184c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db52 expref: 29 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.500066:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.500068:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.500072:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fa00/0xa7c849b16e01851f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3448832->3633151] (req 3448832->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db9f expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.500107:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009984ce00/0xa7c849b16e0184c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db52 expref: 29 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.500118:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009984ce00/0xa7c849b16e0184c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db52 expref: 29 pid: 4760 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.500130:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747359360:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144649.500237:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f541400/0xa7c849b16e018462 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db1a expref: 26 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.500245:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f541400/0xa7c849b16e018462 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db1a expref: 26 pid: 10724 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.500253:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747359488:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144649.500271:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.501243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.503419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.503452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.503476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.503492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.503739:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746336512 00000100:00100000:1.0:1746144649.503745:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746336512 00002000:00100000:1.0:1746144649.503772:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800937a3b80 x1830964746336512/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.503780:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a3b80 with x1830964746336512 ext(1048576->2097151) 00010000:00010000:1.0:1746144649.503788:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 29 pid: 8388 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.503797:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 29 pid: 8388 timeout: 728 lvb_type: 1 00002000:00010000:1.0:1746144649.503803:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a3b80 00000100:00100000:1.0:1746144649.503815:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746336256 00000100:00100000:1.0:1746144649.503817:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746336256 00002000:00100000:1.0:1746144649.503826:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800937a2680 x1830964746336256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.503833:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a2680 with x1830964746336256 ext(0->1048575) 00002000:00010000:1.0:1746144649.503835:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937a2680 00000100:00100000:1.0:1746144649.503842:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746337024 00000100:00100000:1.0:1746144649.503844:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746337024 00002000:00100000:1.0:1746144649.503851:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800937a0e00 x1830964746337024/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.503857:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0e00 with x1830964746337024 ext(1048576->2097151) 00002000:00010000:1.0:1746144649.503860:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937a0e00 00000100:00100000:1.0:1746144649.503871:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746336896 00000100:00100000:1.0:1746144649.503872:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746336896 00002000:00100000:1.0:1746144649.503879:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f01e680 x1830964746336896/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.503885:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01e680 with x1830964746336896 ext(1048576->2097151) 00002000:00010000:1.0:1746144649.503887:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01e680 00000100:00100000:1.0:1746144649.503896:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 766 00000100:00100000:1.0:1746144649.503901:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746336512:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144649.504552:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4056 00000100:00100000:0.0:1746144649.506432:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746336256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144649.507802:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747359360:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144649.507815:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747359488:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144649.507847:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fa00/0xa7c849b16e01851f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3448832->3633151] (req 3448832->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db9f expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.507866:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf5fa00, rc 0) 00000100:00100000:0.0:1746144649.507896:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+28:28730:x1830964746335744:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7912us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.507904:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11038 00000100:00100000:0.0:1746144649.512512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.541805:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746336512:12345-192.168.204.23@tcp:3:cat.0 Request processed in 37902us (38390us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144649.541813:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 766 00002000:00100000:1.0:1746144649.541819:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800937a3b80 x1830964746336512/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.541826:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a3b80 with x1830964746336512 ext(1048576->2097151) 00010000:00010000:1.0:1746144649.541835:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 30 pid: 8388 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.541849:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 30 pid: 8388 timeout: 728 lvb_type: 1 00002000:00010000:1.0:1746144649.541855:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a3b80 00000100:00100000:0.0:1746144649.542432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.542990:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746337792 00000100:00100000:1.0:1746144649.542998:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746337792 00002000:00100000:1.0:1746144649.543030:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f01c000 x1830964746337792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.543037:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01c000 with x1830964746337792 ext(1048576->2097151) 00002000:00010000:1.0:1746144649.543040:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01c000 00000100:00100000:1.0:1746144649.543069:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4060 00000100:00100000:1.0:1746144649.543076:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746337792:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144649.552546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.555775:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746338432 00000100:00100000:0.0:1746144649.555782:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746338432 00010000:00010000:0.0:1746144649.555814:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 28 pid: 8388 timeout: 728 lvb_type: 1 00000100:00100000:0.0:1746144649.555852:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5442 00000100:00100000:0.0:1746144649.555859:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746338432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.555877:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.555901:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 28 pid: 8388 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.555912:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 28 pid: 8388 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.555935:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f08f800/0xa7c849b16e0184a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db2f expref: 28 pid: 8388 timeout: 728 lvb_type: 1 00010000:00010000:0.0:1746144649.555956:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.555998:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746338432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 138us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.556004:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5442 00000100:00100000:0.0:1746144649.558020:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746338560 00000100:00100000:0.0:1746144649.558027:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746338560 00000100:00100000:0.0:1746144649.558077:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11039 00000100:00100000:0.0:1746144649.558084:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:28732:x1830964746338560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144649.558100:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.558118:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dba6 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.558177:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.558184:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1208320->1253375] (req 1208320->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.558190:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144649.558193:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.558228:0:4758:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1208320->1253375] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.558240:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 28 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.558255:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107a00, rc 0) 00000100:00100000:0.0:1746144649.558423:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:28732:x1830964746338560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 339us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.558430:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11039 00000100:00100000:0.0:1746144649.561043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.561224:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746338688 00000100:00100000:1.0:1746144649.561234:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746338688 00010000:00010000:1.0:1746144649.561269:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541000/0xa7c849b16e01845b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dafe expref: 27 pid: 10724 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.561309:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5443 00000100:00100000:1.0:1746144649.561316:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746338688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.561331:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.561355:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f541000/0xa7c849b16e01845b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dafe expref: 27 pid: 10724 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.561368:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f541000/0xa7c849b16e01845b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dafe expref: 27 pid: 10724 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.561391:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f541000/0xa7c849b16e01845b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dafe expref: 27 pid: 10724 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.562251:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.562254:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.562262:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.562269:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.562327:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.562338:0:15951:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 27 pid: 30345 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.562349:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747359872:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144649.562406:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144649.562622:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746337792:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 19546us (20191us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144649.562628:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4060 00002000:00100000:1.0:1746144649.562634:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f01c000 x1830964746337792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.562641:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01c000 with x1830964746337792 ext(1048576->2097151) 00002000:00010000:1.0:1746144649.562644:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01c000 00000100:00100000:1.0:1746144649.564824:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747359872:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144649.564843:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144649.564890:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746338688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3574us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.564905:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5443 00000100:00100000:0.0:1746144649.567240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.567310:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746338944 00000100:00100000:1.0:1746144649.567319:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746338944 00002000:00100000:1.0:1746144649.567431:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1208320->1212415) req@ffff88009f01df80 x1830964746338944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.567446:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01df80 with x1830964746338944 ext(1208320->1212415) 00010000:00010000:1.0:1746144649.567457:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.567470:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 728 lvb_type: 0 00002000:00010000:1.0:1746144649.567476:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f01df80 00000100:00100000:1.0:1746144649.567506:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 767 00000100:00100000:1.0:1746144649.567515:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746338944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.567941:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746338944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 426us (709us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144649.567948:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 767 00002000:00100000:1.0:1746144649.567953:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1208320->1212415) req@ffff88009f01df80 x1830964746338944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/4536 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.567960:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01df80 with x1830964746338944 ext(1208320->1212415) 00010000:00010000:1.0:1746144649.567964:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.567978:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 728 lvb_type: 0 00002000:00010000:1.0:1746144649.567984:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f01df80 00000100:00100000:0.0:1746144649.572070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.574871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.574911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.574960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.574974:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746340096 00000100:00100000:1.0:1746144649.574979:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746340096 00002000:00100000:1.0:1746144649.575001:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1208320->1253375) req@ffff880099b8d180 x1830964746340096/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.575008:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8d180 with x1830964746340096 ext(1208320->1253375) 00010000:00010000:1.0:1746144649.575015:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.575029:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 28 pid: 30345 timeout: 728 lvb_type: 0 00002000:00010000:1.0:1746144649.575035:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099b8d180 00000100:00100000:1.0:1746144649.575068:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 769 00000100:00100000:1.0:1746144649.575076:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746340096:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144649.575350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.575503:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746339840 00000100:00100000:0.0:1746144649.575506:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746339840 00002000:00100000:0.0:1746144649.575525:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136959c00 x1830964746339840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144649.575532:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959c00 with x1830964746339840 ext(3145728->4194303) 00002000:00010000:0.0:1746144649.575535:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959c00 00000100:00100000:0.0:1746144649.575548:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4065 00000100:00100000:0.0:1746144649.575554:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746339840:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.576002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.576022:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746340352 00000100:00100000:1.0:1746144649.576025:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746340352 00002000:00100000:1.0:1746144649.576042:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d0c5180 x1830964746340352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 504/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.576049:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5180 with x1830964746340352 ext(3145728->4194303) 00002000:00010000:1.0:1746144649.576053:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c5180 00000100:00100000:1.0:1746144649.576065:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4066 00000100:00100000:1.0:1746144649.576070:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746340352:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.577422:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746340096:12345-192.168.204.23@tcp:4:cat.0 Request processed in 2340us (2502us total) trans 21474840348 rc 0/0 00000100:00100000:1.0:1746144649.577431:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 769 00002000:00100000:1.0:1746144649.577439:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1208320->1253375) req@ffff880099b8d180 x1830964746340096/t21474840348(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/448 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.577447:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8d180 with x1830964746340096 ext(1208320->1253375) 00010000:00010000:1.0:1746144649.577456:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 30 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.577470:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 30 pid: 30345 timeout: 728 lvb_type: 0 00002000:00010000:1.0:1746144649.577476:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099b8d180 00000100:00100000:0.0:1746144649.587995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.588217:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746340608 00000100:00100000:1.0:1746144649.588226:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746340608 00010000:00010000:1.0:1746144649.588264:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 30 pid: 30345 timeout: 728 lvb_type: 0 00000100:00100000:1.0:1746144649.588309:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5444 00000100:00100000:1.0:1746144649.588318:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746340608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.588332:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144649.588352:0:7309:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144649 -> 1746144650 00002000:00010000:1.0:1746144649.588355:0:7309:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144649 -> 1746144650 00010000:00010000:1.0:1746144649.588361:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 30 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.588373:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 30 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.588395:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d796a00/0xa7c849b16e018518 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1253375) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db98 expref: 30 pid: 30345 timeout: 728 lvb_type: 0 00010000:00010000:1.0:1746144649.588422:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.588424:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.588431:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.588439:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.588476:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144649.588488:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747360000:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144649.588543:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.601809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.610450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.621000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.627689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.638784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.641426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.645576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.655115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.670030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.670070:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.670107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.670330:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746342656 00000100:00100000:1.0:1746144649.670335:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746342656 00002000:00100000:1.0:1746144649.670354:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b1cd180 x1830964746342656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.670370:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cd180 with x1830964746342656 ext(3145728->4194303) 00002000:00010000:1.0:1746144649.670373:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cd180 00000100:00100000:1.0:1746144649.670393:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746342912 00000100:00100000:1.0:1746144649.670395:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746342912 00002000:00100000:1.0:1746144649.670408:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012dbb7b80 x1830964746342912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.670413:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb7b80 with x1830964746342912 ext(3145728->4194303) 00002000:00010000:1.0:1746144649.670416:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb7b80 00000100:00100000:1.0:1746144649.670442:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4070 00000100:00100000:1.0:1746144649.670449:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746342656:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144649.671773:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4072 00000100:00100000:0.0:1746144649.671789:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746342400:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144649.687581:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746342656:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17121us (17499us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144649.687594:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4070 00002000:00100000:0.0:1746144649.687606:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b1cd180 x1830964746342656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144649.687614:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cd180 with x1830964746342656 ext(3145728->4194303) 00002000:00010000:0.0:1746144649.687620:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cd180 00000100:00100000:1.0:1746144649.699038:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746342400:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27242us (29006us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144649.699052:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4072 00002000:00100000:1.0:1746144649.699066:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012b1cf480 x1830964746342400/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.699075:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf480 with x1830964746342400 ext(2097152->3145727) 00002000:00010000:1.0:1746144649.699082:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf480 00000100:00100000:0.0:1746144649.707705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.708849:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746343424 00000100:00100000:1.0:1746144649.708861:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746343424 00002000:00100000:1.0:1746144649.708912:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88008f33f480 x1830964746343424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.708921:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33f480 with x1830964746343424 ext(4194304->4935679) 00002000:00010000:1.0:1746144649.708927:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f33f480 00000100:00100000:1.0:1746144649.708963:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4073 00000100:00100000:1.0:1746144649.708971:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746343424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144649.713888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.717990:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746343424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9005us (10281us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144649.718003:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4073 00002000:00100000:1.0:1746144649.718015:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88008f33f480 x1830964746343424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.718025:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33f480 with x1830964746343424 ext(4194304->4935679) 00002000:00010000:1.0:1746144649.718032:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f33f480 00000100:00100000:0.0:1746144649.785603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.793800:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747360384:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144649.793812:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747360512:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144649.793853:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2129920->2797567] (req 2129920->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.793872:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb79800, rc 0) 00000100:00100000:0.0:1746144649.793915:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:28740:x1830964746344064:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7140us (7213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.793925:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11042 00000100:00100000:0.0:1746144649.797299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.797399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.797455:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746344448 00000100:00100000:1.0:1746144649.797463:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746344448 00010000:00010000:1.0:1746144649.797499:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c99600/0xa7c849b16e018469 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db13 expref: 26 pid: 10724 timeout: 728 lvb_type: 1 00000100:00100000:1.0:1746144649.797540:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5446 00000100:00100000:1.0:1746144649.797547:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746344448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144649.797559:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144649.797581:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c99600/0xa7c849b16e018469 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db13 expref: 26 pid: 10724 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.797591:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c99600/0xa7c849b16e018469 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db13 expref: 26 pid: 10724 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.797633:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c99600/0xa7c849b16e018469 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db13 expref: 26 pid: 10724 timeout: 728 lvb_type: 1 00010000:00010000:1.0:1746144649.798083:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.798085:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144649.798093:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.798102:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144649.798259:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144649.798272:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c947800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747360640:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144649.798341:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.804452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.804540:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c947800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747360640:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144649.804560:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144649.804600:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746344448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7054us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144649.804611:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5446 00000100:00100000:0.0:1746144649.817116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.862806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.869200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.872270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.872328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.872360:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746345984 00000100:00100000:0.0:1746144649.872365:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746345984 00000100:00100000:1.0:1746144649.872830:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746345856 00000100:00100000:1.0:1746144649.872835:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746345856 00000100:00100000:1.0:1746144649.873466:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3959 00000100:00100000:1.0:1746144649.873475:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:28749:x1830964746345856:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144649.873662:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:28749:x1830964746345856:12345-192.168.204.23@tcp:35:cat.0 Request processed in 188us (1394us total) trans 8589943762 rc 0/0 00000100:00100000:1.0:1746144649.873672:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3959 00000100:00100000:0.0:1746144649.876475:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 607 00000100:00100000:0.0:1746144649.876497:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1960:x1830964746345984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.876518:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.876553:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4dfe00/0xa7c849b16e01859d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbd0 expref: 304 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.876585:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144649.876590:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.876646:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1960:x1830964746345984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 156us (4316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.876653:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 607 00000100:00100000:1.0:1746144649.878539:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746346112 00000100:00100000:1.0:1746144649.878548:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746346112 00000100:00100000:1.0:1746144649.878595:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746346240 00000100:00100000:1.0:1746144649.878597:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746346240 00000100:00100000:1.0:1746144649.878613:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11043 00000100:00100000:1.0:1746144649.878619:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746346112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144649.878638:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144649.878656:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f333800/0xa7c849b16e0185ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dbde expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144649.878706:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747360768:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144649.878782:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.879914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144649.885689:0:30345:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144649 -> 1746144650 00002000:00010000:0.0:1746144649.885698:0:30345:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144649 -> 1746144650 00002000:00010000:0.0:1746144649.885700:0:30345:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144649 -> 1746144650 00000100:00100000:0.0:1746144649.885728:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747360768:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144649.885768:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f333800/0xa7c849b16e0185ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbde expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.885783:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f333800/0xa7c849b16e0185ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbde expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.885886:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f333800, rc 0) 00000100:00100000:0.0:1746144649.886663:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746346112:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8037us (8260us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144649.886674:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11043 00000100:00100000:0.0:1746144649.898726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.898782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.899182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.900329:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4077 00000100:00100000:1.0:1746144649.900338:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746346880:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.900861:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4078 00000100:00100000:1.0:1746144649.900868:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746347392:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144649.906686:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.906990:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746347264 00000100:00100000:1.0:1746144649.907000:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746347264 00002000:00100000:1.0:1746144649.907049:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920aea00 x1830964746347264/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.907058:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aea00 with x1830964746347264 ext(0->1048575) 00002000:00010000:1.0:1746144649.907065:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920aea00 00000100:00100000:1.0:1746144649.907387:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4079 00000100:00100000:1.0:1746144649.907396:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746347264:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144649.914307:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746346880:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13953us (15506us total) trans 0 rc 380928/380928 00000100:00100000:1.0:1746144649.914319:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4077 00002000:00100000:1.0:1746144649.914331:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3813376->4194303) req@ffff8800920af100 x1830964746346880/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 380928/380928 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.914341:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af100 with x1830964746346880 ext(3813376->4194303) 00002000:00010000:1.0:1746144649.914347:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920af100 00000100:00100000:0.0:1746144649.915938:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746347392:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15063us (16748us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144649.915949:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4078 00002000:00100000:0.0:1746144649.915958:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ace00 x1830964746347392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144649.915967:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ace00 with x1830964746347392 ext(1048576->2097151) 00002000:00010000:0.0:1746144649.915972:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ace00 00000100:00100000:0.0:1746144649.928789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.929369:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746347264:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21972us (22693us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144649.929767:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4079 00002000:00100000:1.0:1746144649.929778:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920aea00 x1830964746347264/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.929786:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aea00 with x1830964746347264 ext(0->1048575) 00002000:00010000:1.0:1746144649.929790:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920aea00 00000100:00100000:0.0:1746144649.938103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.938209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.938240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.938266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.938319:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746347904 00000100:00100000:0.0:1746144649.938328:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746347904 00010000:00010000:0.0:1746144649.938363:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41d000/0xa7c849b16e0184af lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db3d expref: 30 pid: 7257 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746144649.938387:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746348160 00000100:00100000:0.0:1746144649.938389:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746348160 00010000:00010000:0.0:1746144649.938396:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99200/0xa7c849b16e018470 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db05 expref: 29 pid: 10724 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746144649.938411:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5448 00000100:00100000:0.0:1746144649.938417:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746347904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.938430:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.938452:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e41d000/0xa7c849b16e0184af lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db3d expref: 30 pid: 7257 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144649.938463:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e41d000/0xa7c849b16e0184af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db3d expref: 30 pid: 7257 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144649.938488:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.938535:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746347904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.938541:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5448 00000100:00100000:0.0:1746144649.938555:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5449 00000100:00100000:0.0:1746144649.938560:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746348160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144649.938565:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144649.938571:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99200/0xa7c849b16e018470 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db05 expref: 29 pid: 10724 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144649.938580:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99200/0xa7c849b16e018470 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db05 expref: 29 pid: 10724 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144649.938591:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.938593:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144649.938599:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.938606:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144649.938636:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.938648:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747361152:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144649.938700:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.940050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.941778:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746347776 00000100:00100000:1.0:1746144649.941784:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746347776 00002000:00100000:1.0:1746144649.941818:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800920adf80 x1830964746347776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.941827:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920adf80 with x1830964746347776 ext(4194304->4935679) 00002000:00010000:1.0:1746144649.941831:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920adf80 00000100:00100000:0.0:1746144649.941839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.941894:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746348544 00000100:00100000:1.0:1746144649.941897:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746348544 00000100:00100000:0.0:1746144649.942046:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4080 00000100:00100000:0.0:1746144649.942054:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746347776:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:1.0:1746144649.942191:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1261568->1265663) req@ffff8800920ac000 x1830964746348544/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.942204:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac000 with x1830964746348544 ext(1261568->1265663) 00010000:00010000:1.0:1746144649.942210:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144649.942221:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144649.942227:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920ac000 00000100:00100000:1.0:1746144649.942246:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 771 00000100:00100000:1.0:1746144649.942252:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746348544:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144649.942596:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746348544:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 344us (757us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144649.942602:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 771 00002000:00100000:1.0:1746144649.942607:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1261568->1265663) req@ffff8800920ac000 x1830964746348544/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/4536 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.942614:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac000 with x1830964746348544 ext(1261568->1265663) 00010000:00010000:1.0:1746144649.942618:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144649.942627:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 29 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144649.942632:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920ac000 00000100:00100000:1.0:1746144649.950553:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746347776:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8486us (12447us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144649.950566:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4080 00002000:00100000:1.0:1746144649.950577:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800920adf80 x1830964746347776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.950587:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920adf80 with x1830964746347776 ext(4194304->4935679) 00002000:00010000:1.0:1746144649.950593:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920adf80 00000100:00100000:0.0:1746144649.953965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.954060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.954129:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746348800 00000100:00100000:1.0:1746144649.954159:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746348800 00002000:00100000:1.0:1746144649.954198:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (2027520->2031615) req@ffff8800920afb80 x1830964746348800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.954208:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920afb80 with x1830964746348800 ext(2027520->2031615) 00010000:00010000:1.0:1746144649.954216:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 28 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144649.954229:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 28 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144649.954236:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920afb80 00000100:00100000:1.0:1746144649.954748:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 772 00000100:00100000:1.0:1746144649.954755:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746348800:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144649.954935:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746348800:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 179us (980us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144649.954941:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 772 00002000:00100000:1.0:1746144649.954946:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (2027520->2031615) req@ffff8800920afb80 x1830964746348800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/4536 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.954959:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920afb80 with x1830964746348800 ext(2027520->2031615) 00010000:00010000:1.0:1746144649.954962:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 28 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144649.954972:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800939e9000/0xa7c849b16e0185dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbec expref: 28 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144649.954977:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920afb80 00000100:00100000:0.0:1746144649.964695:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11049 00000100:00100000:0.0:1746144649.964706:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746349312:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144649.964729:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144649.964747:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b579400/0xa7c849b16e0185f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dc08 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144649.964800:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747361664:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144649.964880:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144649.966774:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747361664:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144649.966800:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b579400/0xa7c849b16e0185f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc08 expref: 30 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.966812:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b579400/0xa7c849b16e0185f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc08 expref: 30 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144649.966826:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b579400, rc 0) 00000100:00100000:0.0:1746144649.966855:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746349312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2151us (2407us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144649.966861:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11049 00000100:00100000:0.0:1746144649.974346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.979022:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747361792:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144649.979046:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144649.979103:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746349440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4566us (4766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144649.979113:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5450 00000100:00100000:0.0:1746144649.981031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.981416:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4081 00000100:00100000:1.0:1746144649.981427:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746349824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144649.987934:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746349824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 6496us (6895us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144649.987947:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4081 00002000:00100000:1.0:1746144649.987958:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cef8700 x1830964746349824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:290/0 lens 488/440 e 0 to 0 dl 1746144660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.987968:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8700 with x1830964746349824 ext(1048576->2097151) 00002000:00010000:1.0:1746144649.987974:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8700 00000100:00100000:0.0:1746144649.993345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144649.997296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144649.997559:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746350080 00000100:00100000:1.0:1746144649.997566:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746350080 00002000:00100000:1.0:1746144649.998059:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2129920->2797567) req@ffff88012cef9f80 x1830964746350080/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/0 e 0 to 0 dl 1746144660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144649.998070:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9f80 with x1830964746350080 ext(2129920->2797567) 00010000:00010000:1.0:1746144649.998079:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 39 pid: 4758 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144649.998093:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 39 pid: 4758 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144649.998099:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cef9f80 00000100:00100000:1.0:1746144649.998129:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 774 00000100:00100000:1.0:1746144649.998247:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746350080:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144650.009502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.010988:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746350080:12345-192.168.204.23@tcp:4:cat.0 Request processed in 12851us (13698us total) trans 17179873099 rc 0/0 00000100:00100000:1.0:1746144650.010998:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 774 00002000:00100000:1.0:1746144650.011008:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2129920->2797567) req@ffff88012cef9f80 x1830964746350080/t17179873099(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:290/0 lens 488/448 e 0 to 0 dl 1746144660 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.011017:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9f80 with x1830964746350080 ext(2129920->2797567) 00010000:00010000:1.0:1746144650.011024:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 41 pid: 4758 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.011034:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bb79800/0xa7c849b16e018581 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2129920->2797567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc9 expref: 41 pid: 4758 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144650.011040:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cef9f80 00000100:00100000:0.0:1746144650.013027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.013243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.015374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.015795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144650.016369:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144650.017943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.021536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.021578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.021601:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.021616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.021642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.023222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.031608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.031685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.031845:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746352640 00000100:00100000:0.0:1746144650.031855:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746352640 00002000:00100000:0.0:1746144650.031899:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c945500 x1830964746352640/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.031909:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945500 with x1830964746352640 ext(2097152->3145727) 00002000:00010000:0.0:1746144650.031915:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c945500 00000100:00100000:0.0:1746144650.031933:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4084 00000100:00100000:0.0:1746144650.031941:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746352640:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.034742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.044236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.047159:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746352640:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15218us (15561us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144650.047166:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4084 00002000:00100000:0.0:1746144650.047172:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c945500 x1830964746352640/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.047179:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945500 with x1830964746352640 ext(2097152->3145727) 00002000:00010000:0.0:1746144650.047182:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c945500 00000100:00100000:0.0:1746144650.052560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.057379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.057441:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746353664 00000100:00100000:1.0:1746144650.057452:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746353664 00000100:00100000:1.0:1746144650.057497:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9921 00000100:00100000:1.0:1746144650.057504:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28756:x1830964746353664:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144650.057533:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144650.057552:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56e00/0xa7c849b16e01866f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dc55 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.057664:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057677:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057687:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057699:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057704:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057710:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057809:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57400/0xa7c849b16e018684 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057817:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57400/0xa7c849b16e018684 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057823:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57400/0xa7c849b16e018684 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144650.057832:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144650.057916:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057923:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057929:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057934:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090f57000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144650.057937:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057944:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057955:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144650.057957:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144650.057961:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057966:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e018676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057992:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.057997:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.058002:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.058006:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090f57200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144650.058008:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.058013:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.058019:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e9ac800) 00010000:00010000:1.0:1746144650.058022:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144650.058023:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.058028:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57200/0xa7c849b16e01867d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.058061:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56e00/0xa7c849b16e01866f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc55 expref: 306 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.058072:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57400/0xa7c849b16e018684 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc55 expref: 305 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.058078:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.058080:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144650.058083:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec9ee00/0xa7c849b16e018668 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144650.058088:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec9ee00/0xa7c849b16e018668 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144650.058093:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090f57400, rc 0) 00000100:00100000:1.0:1746144650.059781:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:28756:x1830964746353664:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2270us (2404us total) trans 8589943766 rc 0/0 00000100:00100000:1.0:1746144650.059791:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9921 00000100:00100000:0.0:1746144650.061871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.061920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.064910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.068688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.077882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.088569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.091211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.091262:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746355200 00000100:00100000:1.0:1746144650.091272:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746355200 00000100:00100000:1.0:1746144650.091332:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9923 00000100:00100000:1.0:1746144650.091340:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:28758:x1830964746355200:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144650.091359:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144650.091378:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56a00/0xa7c849b16e0186a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dc63 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.091489:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091502:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091513:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091525:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091530:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091534:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091638:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091647:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091653:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144650.091666:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144650.091744:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091750:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091755:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091761:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090f57600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144650.091765:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091771:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091781:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144650.091783:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144650.091787:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091791:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57600/0xa7c849b16e0186a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091816:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091822:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091826:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091833:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090f57800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144650.091835:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091840:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091846:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e9ac200) 00010000:00010000:1.0:1746144650.091848:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144650.091850:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091854:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57800/0xa7c849b16e0186ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.091886:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56a00/0xa7c849b16e0186a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc63 expref: 18 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.091903:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc63 expref: 17 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.091909:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.091911:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144650.091913:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090f57a00, rc 0) 00000100:00100000:1.0:1746144650.091966:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:28758:x1830964746355200:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 627us (761us total) trans 8589943769 rc 0/0 00000100:00100000:1.0:1746144650.091972:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9923 00000100:00100000:0.0:1746144650.214911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.215031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.215055:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746355584 00000100:00100000:1.0:1746144650.215062:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746355584 00000100:00100000:1.0:1746144650.215096:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11057 00000100:00100000:1.0:1746144650.215102:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:28756:x1830964746355584:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144650.215116:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144650.215129:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dc71 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.215739:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf5e400/0xa7c849b16e018534 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbb4 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.215748:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.215754:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 28 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.215760:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.215761:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.215765:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3489792->4194303] (req 3489792->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.215794:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 28 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.215805:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 28 pid: 8389 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1746144650.215815:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747362688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.215875:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.215883:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 10 pid: 10724 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1746144650.215890:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747362816:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.215908:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf5e400/0xa7c849b16e018534 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbb4 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.215915:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cf5e400/0xa7c849b16e018534 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbb4 expref: 30 pid: 4758 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1746144650.215922:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747362944:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.215934:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e300 going to sleep for 11 seconds 00000100:00080000:1.0:1746144650.215945:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144650.215958:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746355456 00000100:00100000:1.0:1746144650.215961:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746355456 00000100:00100000:1.0:1746144650.215981:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9924 00000100:00100000:1.0:1746144650.215986:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:28763:x1830964746355456:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144650.215996:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144650.216005:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56400/0xa7c849b16e0186ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dc6a expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.216076:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216089:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216098:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216113:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216118:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216123:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216216:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216224:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216229:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144650.216236:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144650.216306:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216312:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216317:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216325:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3f3600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144650.216328:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216333:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216342:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144650.216345:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144650.216348:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216352:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3600/0xa7c849b16e0186d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216374:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216378:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216383:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216386:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3f2800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144650.216388:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216392:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216397:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090bc6d00) 00010000:00010000:1.0:1746144650.216399:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144650.216401:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216406:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2800/0xa7c849b16e0186d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.216433:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56400/0xa7c849b16e0186ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc6a expref: 307 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.216443:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc6a expref: 306 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.216449:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.216451:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144650.216452:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f2600, rc 0) 00000100:00100000:1.0:1746144650.216485:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:28763:x1830964746355456:12345-192.168.204.23@tcp:101:cat.0 Request processed in 498us (1579us total) trans 8589943770 rc 0/0 00000100:00100000:1.0:1746144650.216490:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9924 00000100:00100000:0.0:1746144650.223397:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746355712 00000100:00100000:0.0:1746144650.223403:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746355712 00010000:00010000:0.0:1746144650.223428:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 11 pid: 10724 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746144650.223458:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5456 00000100:00100000:0.0:1746144650.223464:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746355712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.223474:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.223491:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 11 pid: 10724 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144650.223501:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 11 pid: 10724 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144650.223530:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.223558:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746355712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.223564:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5456 00000100:00100000:1.0:1746144650.223946:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747362688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.223958:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c99600/0xa7c849b16e018645 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc40 expref: 10 pid: 10724 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1746144650.223969:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747362816:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.223977:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747362944:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.224005:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3489792->4194303] (req 3489792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.224014:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090f57200, rc 0) 00000100:00100000:1.0:1746144650.224056:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:28756:x1830964746355584:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8953us (9024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.224061:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11057 00000100:00100000:0.0:1746144650.224465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.224538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.224554:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746356224 00000100:00100000:0.0:1746144650.224557:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746356224 00010000:00010000:0.0:1746144650.224569:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 29 pid: 8389 timeout: 729 lvb_type: 1 00000100:00100000:0.0:1746144650.224596:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5458 00000100:00100000:0.0:1746144650.224601:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746356224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.224608:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.224617:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 29 pid: 8389 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144650.224626:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 29 pid: 8389 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144650.224636:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb78400/0xa7c849b16e0185d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbe5 expref: 29 pid: 8389 timeout: 729 lvb_type: 1 00010000:00010000:0.0:1746144650.224645:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144650.224647:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144650.224651:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.224659:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.224679:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144650.224687:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093760380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747363072:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144650.224730:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.230520:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093760380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747363072:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144650.230539:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.230588:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746356224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5985us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.230599:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5458 00000100:00100000:1.0:1746144650.231221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.231244:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746356864 00000100:00100000:0.0:1746144650.231250:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746356864 00002000:00100000:0.0:1746144650.231280:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3489792->3493887) req@ffff8800943fa680 x1830964746356864/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.231299:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fa680 with x1830964746356864 ext(3489792->3493887) 00002000:00010000:0.0:1746144650.231303:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943fa680 00000100:00100000:0.0:1746144650.231447:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4087 00000100:00100000:0.0:1746144650.231454:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746356864:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144650.231592:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746356864:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 138us (371us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144650.231601:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4087 00002000:00100000:0.0:1746144650.231607:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3489792->3493887) req@ffff8800943fa680 x1830964746356864/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.231614:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fa680 with x1830964746356864 ext(3489792->3493887) 00002000:00010000:0.0:1746144650.231617:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943fa680 00000100:00100000:0.0:1746144650.234978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.235006:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746357120 00000100:00100000:0.0:1746144650.235012:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746357120 00000100:00100000:0.0:1746144650.235051:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9925 00000100:00100000:0.0:1746144650.235058:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:28766:x1830964746357120:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144650.235080:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.235098:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579e00/0xa7c849b16e018702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dc8d expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.235210:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.235225:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.235236:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144650.235248:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144650.235596:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579e00/0xa7c849b16e018702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 20 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.235609:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 19 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.235617:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.235620:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746144650.235622:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b579200, rc 0) 00000100:00100000:1.0:1746144650.235644:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:28766:x1830964746357120:12345-192.168.204.23@tcp:101:cat.0 Request processed in 587us (672us total) trans 8589943772 rc 0/0 00000100:00100000:1.0:1746144650.235649:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9925 00000100:00100000:0.0:1746144650.242403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.247501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.247537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.247559:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746357632 00000100:00100000:1.0:1746144650.247873:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746357632 00002000:00100000:1.0:1746144650.247906:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800943f9180 x1830964746357632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.247915:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9180 with x1830964746357632 ext(1048576->2097151) 00002000:00010000:1.0:1746144650.247919:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943f9180 00000100:00100000:1.0:1746144650.247934:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4088 00000100:00100000:1.0:1746144650.247939:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746357632:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144650.254737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.254761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.254817:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746357760 00000100:00100000:1.0:1746144650.254825:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746357760 00010000:00010000:1.0:1746144650.254863:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e22a600/0xa7c849b16e01863e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc39 expref: 11 pid: 4758 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1746144650.254893:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5459 00000100:00100000:1.0:1746144650.254902:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746357760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.254918:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144650.254940:0:16008:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5613 00010000:00010000:1.0:1746144650.254946:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e22a600/0xa7c849b16e01863e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc39 expref: 11 pid: 4758 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1746144650.254957:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e22a600/0xa7c849b16e01863e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc39 expref: 11 pid: 4758 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1746144650.255754:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e22a600/0xa7c849b16e01863e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc39 expref: 11 pid: 4758 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1746144650.256127:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.256172:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746357760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1271us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.256179:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5459 00000100:00100000:0.0:1746144650.257606:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746357632:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9662us (10064us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144650.257616:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4088 00002000:00100000:0.0:1746144650.257628:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800943f9180 x1830964746357632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.257638:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9180 with x1830964746357632 ext(1048576->2097151) 00002000:00010000:0.0:1746144650.257642:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943f9180 00000100:00100000:1.0:1746144650.257849:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746358016 00000100:00100000:1.0:1746144650.257856:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746358016 00010000:00010000:1.0:1746144650.257878:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5112600/0xa7c849b16e0185ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc0f expref: 26 pid: 8451 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1746144650.257902:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5461 00000100:00100000:1.0:1746144650.257908:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746358016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.257918:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.257934:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5112600/0xa7c849b16e0185ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc0f expref: 26 pid: 8451 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.257944:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5112600/0xa7c849b16e0185ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc0f expref: 26 pid: 8451 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.257961:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5112600/0xa7c849b16e0185ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc0f expref: 26 pid: 8451 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.257972:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.257974:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.257981:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 40 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.257989:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 40 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.258018:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 40 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144650.258029:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747363840:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144650.258088:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.268684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.268778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.269310:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11064 00000100:00100000:0.0:1746144650.269317:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746358272:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144650.269325:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.269336:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f14ec00/0xa7c849b16e01872c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dca9 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144650.269366:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093760000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747364096:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144650.269389:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.279597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.279661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.279698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.279712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.279725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.279763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.279789:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746358528 00000100:00100000:0.0:1746144650.279797:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746358528 00002000:00100000:0.0:1746144650.279842:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4333568->4337663) req@ffff88009f444000 x1830964746358528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.279852:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444000 with x1830964746358528 ext(4333568->4337663) 00002000:00010000:0.0:1746144650.279857:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f444000 00000100:00100000:0.0:1746144650.279873:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746358784 00000100:00100000:0.0:1746144650.279875:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746358784 00002000:00100000:0.0:1746144650.279888:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f444380 x1830964746358784/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.279894:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444380 with x1830964746358784 ext(2097152->3145727) 00002000:00010000:0.0:1746144650.279897:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f444380 00000100:00100000:0.0:1746144650.279904:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746359168 00000100:00100000:0.0:1746144650.279905:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746359168 00002000:00100000:0.0:1746144650.279913:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f444700 x1830964746359168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.279919:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444700 with x1830964746359168 ext(3145728->4194303) 00002000:00010000:0.0:1746144650.279921:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f444700 00000100:00100000:0.0:1746144650.279927:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746359424 00000100:00100000:0.0:1746144650.279929:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746359424 00002000:00100000:0.0:1746144650.279938:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3489791) req@ffff88009f444a80 x1830964746359424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.279945:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444a80 with x1830964746359424 ext(3145728->3489791) 00002000:00010000:0.0:1746144650.279948:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f444a80 00000100:00100000:0.0:1746144650.279954:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746359296 00000100:00100000:0.0:1746144650.279956:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746359296 00002000:00100000:0.0:1746144650.279965:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f444e00 x1830964746359296/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.279971:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444e00 with x1830964746359296 ext(2097152->3145727) 00002000:00010000:0.0:1746144650.279973:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f444e00 00000100:00100000:0.0:1746144650.279983:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4089 00000100:00100000:0.0:1746144650.279990:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746358528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.280216:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746358528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 225us (628us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144650.280222:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4089 00002000:00100000:0.0:1746144650.280228:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4333568->4337663) req@ffff88009f444000 x1830964746358528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.280234:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444000 with x1830964746358528 ext(4333568->4337663) 00002000:00010000:0.0:1746144650.280237:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f444000 00000100:00100000:0.0:1746144650.280251:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4090 00000100:00100000:1.0:1746144650.280253:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747363840:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144650.280257:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746358784:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:1.0:1746144650.280272:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.280331:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746358016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 22422us (24030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.280339:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5461 00000100:00100000:0.0:1746144650.290852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.298537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.316122:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746360448 00000100:00100000:0.0:1746144650.316129:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746360320 00000100:00100000:1.0:1746144650.316131:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746360448 00000100:00100000:0.0:1746144650.316143:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746360320 00010000:00010000:1.0:1746144650.316170:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 32 pid: 4760 timeout: 729 lvb_type: 0 00002000:00100000:0.0:1746144650.316175:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4337663) req@ffff8800a4ebd880 x1830964746360320/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.316181:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebd880 with x1830964746360320 ext(4194304->4337663) 00010000:00010000:0.0:1746144650.316185:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 21 pid: 10724 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1746144650.316191:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5462 00010000:00010000:0.0:1746144650.316192:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 21 pid: 10724 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1746144650.316197:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746360448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1746144650.316198:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ebd880 00000100:00100000:0.0:1746144650.316207:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 777 00010000:00010000:1.0:1746144650.316210:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144650.316211:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746360320:12345-192.168.204.23@tcp:4:cat.0 00002000:00010000:1.0:1746144650.316229:0:15951:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144650 -> 1746144651 00010000:00010000:1.0:1746144650.316233:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 32 pid: 4760 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.316243:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 32 pid: 4760 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.316263:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090f57200/0xa7c849b16e0186c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc71 expref: 32 pid: 4760 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.316301:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.316304:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.316311:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8ce800/0xa7c849b16e018733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->3125247) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb0 expref: 28 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.316325:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8ce800/0xa7c849b16e018733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->3125247) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb0 expref: 28 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.316356:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8ce800/0xa7c849b16e018733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb0 expref: 28 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144650.316367:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747364480:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144650.316424:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144650.321528:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746360320:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5314us (5476us total) trans 17179873100 rc 0/0 00000100:00100000:1.0:1746144650.321536:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 777 00002000:00100000:1.0:1746144650.321542:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4337663) req@ffff8800a4ebd880 x1830964746360320/t17179873100(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/448 e 0 to 0 dl 1746144661 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.321549:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebd880 with x1830964746360320 ext(4194304->4337663) 00010000:00010000:1.0:1746144650.321556:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 23 pid: 10724 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.321570:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8cec00/0xa7c849b16e018717 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc94 expref: 23 pid: 10724 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144650.321577:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ebd880 00000100:00100000:0.0:1746144650.321863:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747364480:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144650.321886:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.321907:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746360448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5710us (5822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.321915:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5462 00000100:00100000:0.0:1746144650.321963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.328723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.335830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.345870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.346945:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.347097:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746361984 00000100:00100000:1.0:1746144650.347106:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746361984 00002000:00100000:1.0:1746144650.347161:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2269184->3125247) req@ffff88009f446680 x1830964746361984/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.347169:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f446680 with x1830964746361984 ext(2269184->3125247) 00010000:00010000:1.0:1746144650.347174:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8ce800/0xa7c849b16e018733 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2269184->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb0 expref: 30 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.347189:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8ce800/0xa7c849b16e018733 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2269184->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb0 expref: 30 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144650.347196:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f446680 00000100:00100000:0.0:1746144650.347843:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746362240 00000100:00100000:0.0:1746144650.347847:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746362240 00000100:00100000:0.0:1746144650.347883:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3966 00000100:00100000:0.0:1746144650.347889:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:28758:x1830964746362240:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:0.0:1746144650.348179:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:28758:x1830964746362240:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 289us (1236us total) trans 8589943774 rc 0/0 00000100:00100000:0.0:1746144650.348185:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3966 00000100:00100000:1.0:1746144650.379338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.390012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.392155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.393030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.393130:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746363264 00000100:00100000:0.0:1746144650.393152:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746363264 00002000:00100000:0.0:1746144650.393172:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f447480 x1830964746363264/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.393179:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f447480 with x1830964746363264 ext(3145728->4194303) 00002000:00010000:0.0:1746144650.393184:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f447480 00000100:00100000:0.0:1746144650.393199:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4098 00000100:00100000:0.0:1746144650.393204:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746363264:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.394374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.394398:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746363520 00000100:00100000:0.0:1746144650.394401:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746363520 00002000:00100000:0.0:1746144650.394422:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f447800 x1830964746363520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.394429:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f447800 with x1830964746363520 ext(3145728->4194303) 00002000:00010000:0.0:1746144650.394433:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f447800 00000100:00100000:0.0:1746144650.394455:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4099 00000100:00100000:0.0:1746144650.394461:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746363520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.419747:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746363520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25283us (25372us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144650.419756:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4099 00002000:00100000:0.0:1746144650.419766:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f447800 x1830964746363520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.419775:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f447800 with x1830964746363520 ext(3145728->4194303) 00002000:00010000:0.0:1746144650.419780:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f447800 00000100:00100000:0.0:1746144650.420931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.424587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.424619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.424648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.424684:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746364160 00000100:00100000:0.0:1746144650.424693:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746364160 00010000:00010000:0.0:1746144650.424729:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc63 expref: 20 pid: 15388 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746144650.424754:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746364288 00000100:00100000:0.0:1746144650.424756:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746364288 00010000:00010000:0.0:1746144650.424765:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec9ee00/0xa7c849b16e018668 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc4e expref: 9 pid: 14708 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746144650.424789:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746364032 00000100:00100000:0.0:1746144650.424791:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746364032 00010000:00010000:0.0:1746144650.424801:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc6a expref: 310 pid: 15388 timeout: 729 lvb_type: 0 00000100:00100000:0.0:1746144650.424815:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5465 00000100:00100000:0.0:1746144650.424822:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746364160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.424835:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.424841:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc63 expref: 20 pid: 15388 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.424850:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57a00/0xa7c849b16e0186b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc63 expref: 20 pid: 15388 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.424873:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.424878:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.424887:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.424892:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.424928:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746364160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.424934:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5465 00000100:00100000:0.0:1746144650.424949:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5466 00000100:00100000:0.0:1746144650.424953:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746364288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.424960:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.424964:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec9ee00/0xa7c849b16e018668 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc4e expref: 9 pid: 14708 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.424972:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ec9ee00/0xa7c849b16e018668 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc4e expref: 9 pid: 14708 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.424982:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.424984:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.424990:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.424994:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.425007:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746364288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 53us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.425013:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5466 00000100:00100000:0.0:1746144650.425025:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5467 00000100:00100000:0.0:1746144650.425029:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1960:x1830964746364032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.425035:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.425039:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc6a expref: 310 pid: 15388 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.425050:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e0186df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc6a expref: 310 pid: 15388 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.425060:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.425062:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.425069:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.425076:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133c67600/0xa7c849b16e018756 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.425090:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.425104:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1960:x1830964746364032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.425109:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5467 00000100:00100000:1.0:1746144650.428524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.428564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.428655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.428786:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4102 00000100:00100000:0.0:1746144650.428794:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:1963:x1830964746365056:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144650.438025:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:1963:x1830964746365056:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9220us (9358us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144650.438038:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4102 00002000:00100000:1.0:1746144650.438050:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800943fb100 x1830964746365056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.438059:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fb100 with x1830964746365056 ext(4194304->4935679) 00002000:00010000:1.0:1746144650.438066:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943fb100 00000100:00100000:0.0:1746144650.446734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.474773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.485207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.488457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.488652:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746365824 00000100:00100000:1.0:1746144650.488660:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746365824 00010000:00010000:1.0:1746144650.488696:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5113000/0xa7c849b16e018630 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc2b expref: 10 pid: 8451 timeout: 729 lvb_type: 1 00000100:00100000:1.0:1746144650.488739:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5468 00000100:00100000:1.0:1746144650.488747:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746365824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.488759:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.488784:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5113000/0xa7c849b16e018630 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc2b expref: 10 pid: 8451 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1746144650.488795:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5113000/0xa7c849b16e018630 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc2b expref: 10 pid: 8451 timeout: 729 lvb_type: 1 00010000:00010000:1.0:1746144650.488818:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.488850:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746365824:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.488856:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5468 00000100:00100000:0.0:1746144650.490015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.490971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.492688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.497684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.544513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.549586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.551167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.551350:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746366976 00000100:00100000:1.0:1746144650.551356:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746366976 00010000:00010000:1.0:1746144650.551376:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133c67a00/0xa7c849b16e01873a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb7 expref: 8 pid: 30345 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1746144650.551407:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5472 00000100:00100000:1.0:1746144650.551412:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746366976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.551424:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.551440:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133c67a00/0xa7c849b16e01873a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb7 expref: 8 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.551451:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133c67a00/0xa7c849b16e01873a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb7 expref: 8 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.551466:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133c67a00/0xa7c849b16e01873a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcb7 expref: 8 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.551480:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.551482:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.551490:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b20cc00/0xa7c849b16e018787 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce8 expref: 22 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.551498:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b20cc00/0xa7c849b16e018787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce8 expref: 22 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.551692:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b20cc00/0xa7c849b16e018787 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce8 expref: 22 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144650.551705:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747366272:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144650.551776:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.556438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.556553:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747366272:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144650.556573:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.556619:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:1960:x1830964746366976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5206us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.556629:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5472 00000100:00100000:0.0:1746144650.563930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.573311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.573338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.573362:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746367616 00000100:00100000:0.0:1746144650.573371:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746367616 00000100:00100000:0.0:1746144650.573428:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11073 00000100:00100000:0.0:1746144650.573435:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:1960:x1830964746367616:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144650.573456:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.573475:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f332c00/0xa7c849b16e018795 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dcf6 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144650.573529:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747366656:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144650.573605:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.573635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.573714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.573750:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746367488 00000100:00100000:1.0:1746144650.573754:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746367488 00000100:00100000:0.0:1746144650.573756:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746367872 00000100:00100000:0.0:1746144650.573759:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746367872 00010000:00010000:1.0:1746144650.573775:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133c66800/0xa7c849b16e018748 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcc5 expref: 31 pid: 8451 timeout: 729 lvb_type: 0 00010000:00010000:0.0:1746144650.573775:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133c66e00/0xa7c849b16e018741 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcbe expref: 33 pid: 8451 timeout: 729 lvb_type: 0 00000100:00100000:1.0:1746144650.573965:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5473 00000100:00100000:1.0:1746144650.573972:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746367872:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.573984:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.574010:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133c66e00/0xa7c849b16e018741 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcbe expref: 33 pid: 8451 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.574020:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133c66e00/0xa7c849b16e018741 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dcbe expref: 33 pid: 8451 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.574507:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.574831:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746367872:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 858us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.574838:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5473 00000100:00100000:0.0:1746144650.578288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.581584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.596517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.596568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.600411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.603410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.639436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.639480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.646234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.646618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.652532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.668036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.674691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144650.685066:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144650.688005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.692057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.692097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.692247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144650.692364:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144650 -> 1746144651 00002000:00010000:0.0:1746144650.692367:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144650 -> 1746144651 00002000:00010000:0.0:1746144650.692369:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144650 -> 1746144651 00000100:00100000:0.0:1746144650.692390:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747367680:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144650.692424:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920c7200/0xa7c849b16e0187c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd27 expref: 34 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144650.692438:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920c7200/0xa7c849b16e0187c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd27 expref: 34 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144650.692453:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920c7200, rc 0) 00000100:00100000:0.0:1746144650.692491:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746370304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4280us (4486us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144650.692500:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11080 00000100:00100000:0.0:1746144650.692524:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746370432 00000100:00100000:0.0:1746144650.692529:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746370432 00000100:00100000:0.0:1746144650.692554:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746370560 00000100:00100000:0.0:1746144650.692557:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746370560 00000100:00100000:0.0:1746144650.692578:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11081 00000100:00100000:0.0:1746144650.692585:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746370432:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144650.692600:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.692613:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f333e00/0xa7c849b16e0187cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd2e expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144650.692659:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747367808:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144650.692712:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.692729:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11082 00000100:00100000:0.0:1746144650.692734:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746370560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144650.692740:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.692747:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f332e00/0xa7c849b16e0187d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd35 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144650.692767:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747367936:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144650.692787:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144650.697554:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f445180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747367808:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144650.697574:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f333e00/0xa7c849b16e0187cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd2e expref: 25 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.697583:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f333e00/0xa7c849b16e0187cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd2e expref: 25 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.697598:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f333e00, rc 0) 00000100:00100000:1.0:1746144650.698503:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746370432:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5917us (6456us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144650.698516:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11081 00000100:00100000:0.0:1746144650.704539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.708566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.709426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.709475:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746371200 00000100:00100000:1.0:1746144650.709479:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746371200 00002000:00100000:1.0:1746144650.709496:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1572864->1802239) req@ffff88009f445f80 x1830964746371200/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.709503:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445f80 with x1830964746371200 ext(1572864->1802239) 00010000:00010000:1.0:1746144650.709509:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xa7c849b16e018780 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce1 expref: 32 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.709521:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xa7c849b16e018780 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce1 expref: 32 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144650.709527:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f445f80 00000100:00100000:1.0:1746144650.709546:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 783 00000100:00100000:1.0:1746144650.709552:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746371200:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144650.715837:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746371200:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 6272us (6398us total) trans 21474840354 rc 0/0 00000100:00100000:1.0:1746144650.715849:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 783 00002000:00100000:1.0:1746144650.715862:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1572864->1802239) req@ffff88009f445f80 x1830964746371200/t21474840354(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/448 e 0 to 0 dl 1746144661 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.715871:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445f80 with x1830964746371200 ext(1572864->1802239) 00010000:00010000:1.0:1746144650.715882:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xa7c849b16e018780 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce1 expref: 35 pid: 30345 timeout: 729 lvb_type: 0 00010000:00010000:1.0:1746144650.715901:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xa7c849b16e018780 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1572864->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dce1 expref: 35 pid: 30345 timeout: 729 lvb_type: 0 00002000:00010000:1.0:1746144650.715907:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f445f80 00000100:00100000:0.0:1746144650.719319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.723777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.726828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.729856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.730238:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746371840 00000100:00100000:1.0:1746144650.730247:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746371840 00002000:00100000:1.0:1746144650.730300:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b480a80 x1830964746371840/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.730309:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480a80 with x1830964746371840 ext(1048576->2097151) 00002000:00010000:1.0:1746144650.730315:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b480a80 00000100:00100000:1.0:1746144650.730337:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4113 00000100:00100000:1.0:1746144650.730345:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746371840:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.737909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.739722:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746371840:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9377us (9873us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144650.739735:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4113 00002000:00100000:0.0:1746144650.739744:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b480a80 x1830964746371840/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.739753:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480a80 with x1830964746371840 ext(1048576->2097151) 00002000:00010000:0.0:1746144650.739758:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b480a80 00000100:00100000:0.0:1746144650.750304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.750622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.756409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.777779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.777817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.777847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.777876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.777925:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746373248 00000100:00100000:0.0:1746144650.777925:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746372992 00000100:00100000:1.0:1746144650.777934:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746373248 00000100:00100000:0.0:1746144650.777934:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746372992 00002000:00100000:1.0:1746144650.777977:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b5f7100 x1830964746373248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.777977:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008f33fb80 x1830964746372992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.777986:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7100 with x1830964746373248 ext(3145728->4194303) 00002000:00100000:0.0:1746144650.777986:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33fb80 with x1830964746372992 ext(2097152->3145727) 00002000:00010000:1.0:1746144650.777991:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7100 00002000:00010000:0.0:1746144650.777991:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f33fb80 00000100:00100000:0.0:1746144650.778006:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746373504 00000100:00100000:0.0:1746144650.778008:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746373504 00000100:00100000:1.0:1746144650.778013:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746373760 00000100:00100000:1.0:1746144650.778016:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746373760 00002000:00100000:0.0:1746144650.778021:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012b5f4a80 x1830964746373504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.778027:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b5f6a00 x1830964746373760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.778027:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4a80 with x1830964746373504 ext(2097152->3145727) 00002000:00010000:0.0:1746144650.778030:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f4a80 00002000:00100000:1.0:1746144650.778033:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6a00 with x1830964746373760 ext(3145728->4194303) 00002000:00010000:1.0:1746144650.778036:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f6a00 00000100:00100000:0.0:1746144650.778050:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4118 00000100:00100000:1.0:1746144650.778055:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4119 00000100:00100000:0.0:1746144650.778057:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746373504:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144650.778060:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746373760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.795401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.795845:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746372992:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17809us (18077us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144650.795852:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4116 00002000:00100000:0.0:1746144650.795857:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008f33fb80 x1830964746372992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.795864:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33fb80 with x1830964746372992 ext(2097152->3145727) 00002000:00010000:0.0:1746144650.795867:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f33fb80 00000100:00100000:0.0:1746144650.795880:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4120 00000100:00100000:0.0:1746144650.795887:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746374144:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144650.800841:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746373760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22768us (22952us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144650.800853:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4119 00002000:00100000:1.0:1746144650.800866:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b5f6a00 x1830964746373760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.800875:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6a00 with x1830964746373760 ext(3145728->4194303) 00002000:00010000:1.0:1746144650.800881:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f6a00 00000100:00100000:1.0:1746144650.812984:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746374144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17086us (17584us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144650.812996:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4120 00002000:00100000:1.0:1746144650.813008:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093989c00 x1830964746374144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.813017:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989c00 with x1830964746374144 ext(4194304->4935679) 00002000:00010000:1.0:1746144650.813023:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093989c00 00000100:00100000:0.0:1746144650.829063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.843321:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746374400:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14013us (14260us total) trans 0 rc 741376/741376 00000100:00100000:0.0:1746144650.843333:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4121 00002000:00100000:0.0:1746144650.843510:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093988e00 x1830964746374400/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/440 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.843520:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988e00 with x1830964746374400 ext(4194304->4935679) 00002000:00010000:0.0:1746144650.843526:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093988e00 00000100:00100000:0.0:1746144650.844251:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5480 00000100:00100000:0.0:1746144650.844259:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746374912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.844266:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.844291:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b79c00/0xa7c849b16e01844d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daf7 expref: 11 pid: 8450 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.844301:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b79c00/0xa7c849b16e01844d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152daf7 expref: 11 pid: 8450 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.844315:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.844331:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746374912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.844337:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5480 00000100:00100000:1.0:1746144650.844513:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746374656 00000100:00100000:1.0:1746144650.844517:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746374656 00000100:00100000:1.0:1746144650.844546:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11089 00000100:00100000:1.0:1746144650.844551:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:28788:x1830964746374656:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144650.844563:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144650.844576:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1bca600/0xa7c849b16e018805 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd66 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.844593:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d499000/0xa7c849b16e0187b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd12 expref: 12 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.844601:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9600/0xa7c849b16e0187e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd43 expref: 12 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.844608:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 26 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.844613:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144650.844615:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144650.844618:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bca600/0xa7c849b16e018805 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2207744->2678783] (req 2207744->2678783) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd66 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.845344:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 26 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.845357:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 26 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.845366:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747369216:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.845496:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9600/0xa7c849b16e0187e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd43 expref: 11 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.845505:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9600/0xa7c849b16e0187e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd43 expref: 11 pid: 29370 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.845512:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747369344:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.846214:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d499000/0xa7c849b16e0187b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd12 expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.846223:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d499000/0xa7c849b16e0187b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd12 expref: 11 pid: 30345 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.846232:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747369472:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.846253:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144650.848547:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747369216:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.850403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.850434:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747369344:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.850447:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747369472:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.850484:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bca600/0xa7c849b16e018805 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2207744->2678783] (req 2207744->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd66 expref: 11 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.850499:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bca600, rc 0) 00000100:00100000:1.0:1746144650.850554:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:28788:x1830964746374656:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6001us (6623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.850561:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11089 00000100:00100000:0.0:1746144650.851046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.851090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.851587:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746375552 00000100:00100000:1.0:1746144650.851594:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746375552 00002000:00100000:1.0:1746144650.851623:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (835584->839679) req@ffff880092936300 x1830964746375552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.851630:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936300 with x1830964746375552 ext(835584->839679) 00002000:00010000:1.0:1746144650.851634:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092936300 00000100:00100000:1.0:1746144650.851660:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4122 00000100:00100000:1.0:1746144650.851666:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746375552:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144650.851795:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746375552:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 129us (703us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144650.851801:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4122 00002000:00100000:1.0:1746144650.851811:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (835584->839679) req@ffff880092936300 x1830964746375552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.851818:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936300 with x1830964746375552 ext(835584->839679) 00002000:00010000:1.0:1746144650.851821:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092936300 00000100:00100000:0.0:1746144650.853871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.853907:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746375680 00000100:00100000:1.0:1746144650.853915:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746375680 00000100:00100000:1.0:1746144650.853958:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11090 00000100:00100000:1.0:1746144650.853965:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746375680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144650.853980:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144650.853995:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01880c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd6d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.854012:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.854020:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01880c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd6d expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.854029:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01880c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd6d expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.854049:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00000100:00100000:1.0:1746144650.854083:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746375680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 118us (219us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144650.854088:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11090 00000100:00100000:0.0:1746144650.855937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.856068:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746375936 00000100:00100000:1.0:1746144650.856079:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746375936 00000100:00100000:0.0:1746144650.856232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.856252:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746375808 00000100:00100000:0.0:1746144650.856257:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746375808 00010000:00010000:0.0:1746144650.856295:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 25 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746144650.856334:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5484 00000100:00100000:0.0:1746144650.856341:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746375808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.856353:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.856375:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 25 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.856381:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11091 00010000:00010000:0.0:1746144650.856387:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 25 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.856389:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:28791:x1830964746375936:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144650.856400:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.856409:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d450a00/0xa7c849b16e0187f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd4a expref: 25 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:1.0:1746144650.856414:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd74 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.856426:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144650.856428:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.856434:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.856434:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1bca600/0xa7c849b16e018805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2678783) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd66 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.856442:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e018629 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc24 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144650.856443:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bca600/0xa7c849b16e018805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2678783) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd66 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.856448:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fe00/0xa7c849b16e01852d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbad expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.856453:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.856454:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.856457:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1294335] (req 1048576->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd74 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.856474:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1bca600/0xa7c849b16e018805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2207744->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd66 expref: 8 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.856480:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fe00/0xa7c849b16e01852d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbad expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144650.856485:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747369600:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144650.856491:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fe00/0xa7c849b16e01852d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbad expref: 32 pid: 4758 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.856501:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747369728:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.856551:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144650.857035:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e018629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc24 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.857043:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5113a00/0xa7c849b16e018629 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc24 expref: 8 pid: 8451 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.857050:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747369856:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.857092:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.857100:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f107a00/0xa7c849b16e018526 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dba6 expref: 35 pid: 4758 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.857107:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747369984:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.857123:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.859421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144650.860516:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cf5fe00/0xa7c849b16e01852d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbad expref: 32 pid: 4758 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.860535:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747369728:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.860548:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747369856:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.860555:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747369984:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.860580:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1294335] (req 1048576->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd74 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.860589:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bcb600, rc 0) 00000100:00100000:1.0:1746144650.860610:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:28791:x1830964746375936:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4222us (4679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.860616:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11091 00000100:00100000:0.0:1746144650.861515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.861549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.865613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.867031:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746377216 00000100:00100000:0.0:1746144650.867035:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746377216 00002000:00100000:0.0:1746144650.867052:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1290240->1294335) req@ffff880093761f80 x1830964746377216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.867059:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761f80 with x1830964746377216 ext(1290240->1294335) 00002000:00010000:0.0:1746144650.867062:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761f80 00000100:00100000:0.0:1746144650.867196:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4123 00000100:00100000:0.0:1746144650.867201:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746377216:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.867436:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746377216:12345-192.168.204.23@tcp:3:cat.0 Request processed in 233us (702us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144650.867441:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4123 00002000:00100000:0.0:1746144650.867446:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1290240->1294335) req@ffff880093761f80 x1830964746377216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.867453:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761f80 with x1830964746377216 ext(1290240->1294335) 00002000:00010000:0.0:1746144650.867455:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761f80 00000100:00100000:0.0:1746144650.869224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.882507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.888752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.889617:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4124 00000100:00100000:0.0:1746144650.889626:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746377856:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144650.890860:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746377856:12345-192.168.204.23@tcp:3:cat.0 Request processed in 1230us (2113us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144650.890868:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4124 00002000:00100000:0.0:1746144650.890876:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4931584->4935679) req@ffff8800a4e14700 x1830964746377856/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/4536 e 0 to 0 dl 1746144661 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.890884:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e14700 with x1830964746377856 ext(4931584->4935679) 00002000:00010000:0.0:1746144650.890888:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e14700 00000100:00100000:0.0:1746144650.906022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.909302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.909340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.912547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.912805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.916493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.917323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.917354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.917377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.917605:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746378880 00000100:00100000:1.0:1746144650.917615:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746378880 00000100:00100000:0.0:1746144650.917660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.917858:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746379264 00000100:00100000:1.0:1746144650.917862:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746379264 00000100:00100000:0.0:1746144650.918252:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11095 00000100:00100000:0.0:1746144650.918260:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746379136:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144650.918266:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.918284:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd97 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144650.918294:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11096 00010000:00010000:0.0:1746144650.918295:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144650.918296:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144650.918299:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746379264:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144650.918305:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.918306:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 12 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.918312:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135e85600/0xa7c849b16e018852 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dd9e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.918319:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 12 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.918322:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.918324:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.918328:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135e85600/0xa7c849b16e018852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd9e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144650.918329:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd2600, rc 0) 00010000:00010000:1.0:1746144650.918338:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135e85600/0xa7c849b16e018852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd9e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.918345:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135e85600, rc 0) 00000100:00100000:0.0:1746144650.918972:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746379136:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 712us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.918978:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11095 00000100:00100000:1.0:1746144650.919091:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746379264:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 791us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.919097:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11096 00000100:00100000:0.0:1746144650.931128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.931181:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746379648 00000100:00100000:0.0:1746144650.931190:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746379648 00000100:00100000:0.0:1746144650.931245:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9929 00000100:00100000:0.0:1746144650.931254:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28796:x1830964746379648:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144650.931282:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.931300:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e018860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ddac expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.931396:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.931410:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.931417:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.931447:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.931459:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 10 pid: 15388 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.931472:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747371008:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.931556:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144650.940992:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746379776 00000100:00100000:0.0:1746144650.941002:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746379776 00010000:00010000:0.0:1746144650.941041:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 11 pid: 15388 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.941145:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5491 00000100:00100000:0.0:1746144650.941155:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746379776:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.941170:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.941175:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 11 pid: 15388 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746144650.941187:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 11 pid: 15388 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746144650.941208:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.941213:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.941223:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.941230:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.941247:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.941310:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746379776:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 155us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.941316:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5491 00010000:00010000:0.0:1746144650.941357:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4079000/0xa7c849b16e018836 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd82 expref: 10 pid: 15388 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.942906:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747371008:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.942929:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.942938:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.942944:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144650.942963:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144650.943109:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e018860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddac expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.943122:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e018867 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddac expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.943128:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.943130:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746144650.943246:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3600, rc 0) 00000100:00100000:0.0:1746144650.943388:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:28796:x1830964746379648:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 12134us (12270us total) trans 8589943779 rc 0/0 00000100:00100000:0.0:1746144650.943395:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9929 00000100:00100000:0.0:1746144650.945289:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.948485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.949426:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746380160 00000100:00100000:0.0:1746144650.949435:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746380160 00000100:00100000:0.0:1746144650.949488:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9931 00000100:00100000:0.0:1746144650.949495:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:28796:x1830964746380160:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144650.949517:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144650.949534:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2400/0xa7c849b16e01888a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ddba expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.949591:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2400/0xa7c849b16e01888a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddba expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.949605:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2400/0xa7c849b16e01888a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddba expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.949620:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.949623:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144650.949626:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd2400, rc 0) 00000100:00100000:0.0:1746144650.949667:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:28796:x1830964746380160:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 172us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.949673:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9931 00000100:00100000:0.0:1746144650.952101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.952165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.953735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.953772:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746380544 00000100:00100000:1.0:1746144650.953777:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746380544 00000100:00100000:0.0:1746144650.953782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.953800:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746380800 00000100:00100000:1.0:1746144650.953802:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746380800 00000100:00100000:1.0:1746144650.953830:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11100 00000100:00100000:1.0:1746144650.953835:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746380544:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144650.953853:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135e85000/0xa7c849b16e01889f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.953865:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0xa7c849b16e0187db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd3c expref: 33 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.953872:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.953879:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 31 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.953884:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.953886:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.953887:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135e85000/0xa7c849b16e01889f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.953903:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 31 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.953915:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 31 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746144650.953923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.953924:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747371392:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.953949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144650.953958:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.953965:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 11 pid: 10724 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.953972:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747371520:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.953992:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0xa7c849b16e0187db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd3c expref: 33 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.953999:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0xa7c849b16e0187db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd3c expref: 33 pid: 29370 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.954006:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747371648:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.954021:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144650.954031:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746380672 00000100:00100000:1.0:1746144650.954033:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746380672 00000100:00100000:1.0:1746144650.954050:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746380928 00000100:00100000:1.0:1746144650.954052:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746380928 00000100:00100000:1.0:1746144650.954064:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11101 00000100:00100000:1.0:1746144650.954068:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746380800:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144650.954083:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.954093:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.954099:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135e85600/0xa7c849b16e018852 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd9e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.954104:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.954106:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.954108:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.954123:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135e85600/0xa7c849b16e018852 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd9e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144650.954130:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135e85600/0xa7c849b16e018852 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd9e expref: 9 pid: 8450 timeout: 730 lvb_type: 1 00000100:00100000:1.0:1746144650.954154:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747371776:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144650.954185:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.954193:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 24 pid: 29370 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.954205:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747371904:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.954228:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144650.958257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.958836:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747371392:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.958846:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747371520:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.958865:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746381056 00000100:00100000:0.0:1746144650.958871:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746381056 00002000:00100000:0.0:1746144650.958911:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (835584->1048575) req@ffff8800920aca80 x1830964746381056/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/0 e 0 to 0 dl 1746144661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144650.958919:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aca80 with x1830964746381056 ext(835584->1048575) 00010000:00010000:0.0:1746144650.958926:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d450400/0xa7c849b16e0187fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 835584->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd5f expref: 25 pid: 29370 timeout: 730 lvb_type: 0 00010000:00010000:0.0:1746144650.958942:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d450400/0xa7c849b16e0187fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 835584->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd5f expref: 25 pid: 29370 timeout: 730 lvb_type: 0 00002000:00010000:0.0:1746144650.958948:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800920aca80 00000100:00100000:0.0:1746144650.958977:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 788 00000100:00100000:0.0:1746144650.958983:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746381056:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144650.959345:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746381184 00000100:00100000:0.0:1746144650.959348:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746381184 00010000:00010000:0.0:1746144650.959364:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 13 pid: 10724 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746144650.959387:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746381440 00000100:00100000:0.0:1746144650.959388:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746381440 00010000:00010000:0.0:1746144650.959396:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 32 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746144650.959412:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5492 00000100:00100000:0.0:1746144650.959417:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746381184:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.959425:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.959443:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 13 pid: 10724 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.959452:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 13 pid: 10724 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.959474:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e01884b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd97 expref: 13 pid: 10724 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.959489:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.959521:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746381184:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.959527:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5492 00000100:00100000:0.0:1746144650.959538:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5493 00000100:00100000:0.0:1746144650.959542:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746381440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.959547:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.959552:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 32 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.959560:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 32 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.959568:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d450800/0xa7c849b16e0187f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd58 expref: 32 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.959573:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.959582:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746381440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 40us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.959587:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5493 00000100:00100000:0.0:1746144650.960317:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747371648:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.960335:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747371776:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144650.960344:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747371904:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.960344:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135e85000/0xa7c849b16e01889f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.960359:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144650.963022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.963062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.965364:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746381696 00000100:00100000:1.0:1746144650.965370:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746381696 00010000:00010000:1.0:1746144650.965398:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 27 pid: 29370 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.965498:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5496 00000100:00100000:1.0:1746144650.965504:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746381696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.965511:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.965523:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 27 pid: 29370 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.965533:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 27 pid: 29370 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.965555:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d451200/0xa7c849b16e01881a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4931584->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd7b expref: 27 pid: 29370 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.965571:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.965603:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746381696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.965608:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5496 00000100:00100000:1.0:1746144650.965656:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5497 00000100:00100000:1.0:1746144650.965661:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746382336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.965667:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.965674:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e018454 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db0c expref: 10 pid: 7257 timeout: 730 lvb_type: 1 00010000:00010000:1.0:1746144650.965683:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e018454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db0c expref: 10 pid: 7257 timeout: 730 lvb_type: 1 00010000:00010000:1.0:1746144650.965695:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136932600/0xa7c849b16e018454 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db0c expref: 10 pid: 7257 timeout: 730 lvb_type: 1 00010000:00010000:1.0:1746144650.965703:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.965727:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746382336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.965732:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5497 00000100:00100000:0.0:1746144650.966932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.967077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.967089:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746381824 00000100:00100000:0.0:1746144650.967092:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746381824 00010000:00010000:0.0:1746144650.967107:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0xa7c849b16e0187db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd3c expref: 36 pid: 29370 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.967780:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967795:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967809:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967815:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967821:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967827:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1bcb200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144650.967829:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967835:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967844:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.967854:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1bcb200/0xa7c849b16e0188a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144650.967895:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746380800:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 13825us (14111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.967901:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11101 00000100:00100000:0.0:1746144650.967971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.967984:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746382464 00000100:00100000:0.0:1746144650.967987:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746382464 00010000:00010000:0.0:1746144650.968001:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f125800/0xa7c849b16e0187e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd51 expref: 35 pid: 29370 timeout: 730 lvb_type: 1 00000100:00100000:0.0:1746144650.968017:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5501 00000100:00100000:0.0:1746144650.968022:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746382464:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144650.968031:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.968042:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f125800/0xa7c849b16e0187e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd51 expref: 35 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.968050:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f125800/0xa7c849b16e0187e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd51 expref: 35 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.968061:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f125800/0xa7c849b16e0187e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd51 expref: 35 pid: 29370 timeout: 730 lvb_type: 1 00010000:00010000:0.0:1746144650.968084:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144650.968106:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746382464:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144650.968112:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5501 00000100:00100000:1.0:1746144650.969284:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746381056:12345-192.168.204.23@tcp:4:cat.0 Request processed in 10300us (11037us total) trans 17179873104 rc 0/0 00000100:00100000:1.0:1746144650.969291:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 788 00002000:00100000:1.0:1746144650.969296:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (835584->1048575) req@ffff8800920aca80 x1830964746381056/t17179873104(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:291/0 lens 488/448 e 0 to 0 dl 1746144661 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144650.969304:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aca80 with x1830964746381056 ext(835584->1048575) 00010000:00010000:1.0:1746144650.969310:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d450400/0xa7c849b16e0187fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 835584->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd5f expref: 25 pid: 29370 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.969318:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d450400/0xa7c849b16e0187fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 835584->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd5f expref: 25 pid: 29370 timeout: 730 lvb_type: 0 00002000:00010000:1.0:1746144650.969323:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800920aca80 00000100:00100000:0.0:1746144650.971694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144650.971742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.971860:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746382720 00000100:00100000:1.0:1746144650.971864:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746382720 00010000:00010000:1.0:1746144650.971878:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd74 expref: 34 pid: 8451 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.971910:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5504 00000100:00100000:1.0:1746144650.971915:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746382720:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.971922:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.971935:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd74 expref: 34 pid: 8451 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.971948:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd74 expref: 34 pid: 8451 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.971959:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb600/0xa7c849b16e018813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dd74 expref: 34 pid: 8451 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.971971:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.971973:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144650.971977:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e018898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.971986:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e018898 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144650.972005:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.972328:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746382720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 412us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.972334:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5504 00000100:00100000:0.0:1746144650.977722:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746383104 00000100:00100000:0.0:1746144650.977732:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746383104 00000100:00100000:0.0:1746144650.977789:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9932 00000100:00100000:0.0:1746144650.977797:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:28796:x1830964746383104:12345-192.168.204.23@tcp:36:mirror_io.0 00010000:00010000:0.0:1746144650.977847:0:15388:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144650.977873:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2400/0xa7c849b16e01888a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddba expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977901:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144650.977906:0:15388:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144650.977934:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.977946:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db7c expref: 20 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977954:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 308 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977960:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 20 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977967:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 20 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977973:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 308 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977978:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79600/0xa7c849b16e018573 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc2 expref: 20 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.977984:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 9/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.978013:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79600/0xa7c849b16e018573 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc2 expref: 20 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.978025:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79600/0xa7c849b16e018573 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc2 expref: 20 pid: 14708 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.978037:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee01880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747372800:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.978130:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 308 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.978156:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 308 pid: 14708 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.978164:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747372928:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.978199:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 20 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.978206:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 20 pid: 15388 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.978213:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373056:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.978231:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 20 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.978238:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 20 pid: 14709 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.978244:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee02300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373184:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.978264:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 308 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.978280:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e018503 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db83 expref: 308 pid: 14710 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.978288:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee02680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373312:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.978307:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db7c expref: 20 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144650.978313:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad200/0xa7c849b16e0184fc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db7c expref: 20 pid: 14708 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.978319:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373440:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.978335:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144650.981628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.981666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.981695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.981710:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746383232 00000100:00100000:1.0:1746144650.981713:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746383232 00010000:00010000:1.0:1746144650.981734:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 309 pid: 14708 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.981752:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746383616 00000100:00100000:1.0:1746144650.981754:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746383616 00010000:00010000:1.0:1746144650.981762:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 22 pid: 14709 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.981774:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5505 00000100:00100000:1.0:1746144650.981779:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1963:x1830964746383232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.981789:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.981795:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 309 pid: 14708 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.981805:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 309 pid: 14708 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.981825:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.981830:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.981839:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.981876:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1963:x1830964746383232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.981883:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5505 00000100:00100000:1.0:1746144650.981896:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5506 00000100:00100000:1.0:1746144650.981901:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746383616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.981907:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.981910:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 23 pid: 14709 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.981918:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 23 pid: 14709 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.981928:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.981931:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.981936:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.981948:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746383616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 47us (252us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144650.982385:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79600/0xa7c849b16e018573 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbc2 expref: 23 pid: 14708 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.982401:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee01880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747372800:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.982412:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb78e00/0xa7c849b16e018550 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dbbb expref: 309 pid: 14708 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.982419:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747372928:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.982427:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373056:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.982433:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796c00/0xa7c849b16e01850a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152db8a expref: 22 pid: 14709 timeout: 730 lvb_type: 0 00000100:00100000:0.0:1746144650.982442:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee02300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373184:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.982448:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee02680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373312:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144650.982454:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747373440:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144650.982480:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:1.0:1746144650.983163:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5506 00000100:00100000:0.0:1746144650.985558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144650.985703:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746384128 00000100:00100000:1.0:1746144650.985709:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746384128 00010000:00010000:1.0:1746144650.985746:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 19 pid: 15388 timeout: 730 lvb_type: 0 00000100:00100000:1.0:1746144650.985898:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5510 00000100:00100000:1.0:1746144650.985906:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746384128:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144650.985918:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144650.985923:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 19 pid: 15388 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.985934:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 19 pid: 15388 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.985952:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b579200/0xa7c849b16e018709 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dc8d expref: 19 pid: 15388 timeout: 730 lvb_type: 0 00010000:00010000:1.0:1746144650.985964:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144650.985968:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.985977:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.985983:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144650.986012:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144650.986044:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746384128:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 140us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144650.986050:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5510 00010000:00010000:0.0:1746144650.986100:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144650.986107:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000040:00080000:0.0:1746144650.986784:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2803, 88 off233600 00000004:00080000:0.0:1746144650.986793:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630195657335ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.986832:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2735, 88 off227608 00000004:00080000:0.0:1746144650.986838:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630195703023ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.986866:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2736, 88 off227696 00000004:00080000:0.0:1746144650.986870:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630195735173ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.986877:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2804, 88 off233688 00000004:00080000:0.0:1746144650.986879:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630195744921ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.986886:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2805, 88 off233776 00000004:00080000:0.0:1746144650.986888:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630195753398ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.986894:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2737, 88 off227784 00000004:00080000:0.0:1746144650.986898:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630195763336ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.986904:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2738, 88 off227872 00000004:00080000:0.0:1746144650.986907:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630195772731ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.986914:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2739, 88 off227960 00000004:00080000:0.0:1746144650.986916:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630195781696ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.986922:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2806, 88 off233864 00000004:00080000:0.0:1746144650.986925:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630195790466ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.986935:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2740, 88 off228048 00000004:00080000:0.0:1746144650.986937:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630195802871ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.986945:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2807, 88 off233952 00000004:00080000:0.0:1746144650.986948:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630195813143ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.987128:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2741, 88 off228136 00000004:00080000:0.0:1746144650.987309:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630196173756ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144650.987331:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2808, 88 off234040 00000004:00080000:0.0:1746144650.987335:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630196199966ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.987887:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2809, 88 off234128 00000004:00080000:0.0:1746144650.987891:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630196756616ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.987898:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2810, 88 off234216 00000004:00080000:0.0:1746144650.987901:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630196766189ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.987907:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2811, 88 off234304 00000004:00080000:0.0:1746144650.987909:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 630196774796ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144650.987917:0:15388:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2742, 88 off228224 00000004:00080000:0.0:1746144650.987920:0:15388:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630196785645ns, next at 593480289301ns, rc = 0 00000004:00010000:0.0:1746144651.012038:0:15388:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b812a00 reply state ffff88009a2e3400 transno 8589943782 ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:0.0:1746144651.012049:0:15388:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746144651.012166:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+13:28796:x1830964746383104:12345-192.168.204.23@tcp:36:mirror_io.0 Request processed in 34365us (34527us total) trans 8589943782 rc 0/0 00000100:00100000:0.0:1746144651.012174:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9932 00000001:00080000:0.0:1746144651.012206:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943782 is committed 00000004:00080000:0.0:1746144651.012210:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1929 committed 00000004:00080000:0.0:1746144651.012489:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746144651.012497:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746144651.012499:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746144651.012500:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746144651.012501:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1928 committed 00000004:00080000:0.0:1746144651.012503:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746144651.012504:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1927 committed 00000004:00080000:0.0:1746144651.012505:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1989 committed 00010000:00010000:1.0:1746144651.012506:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00000004:00080000:0.0:1746144651.012507:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1926 committed 00000004:00080000:0.0:1746144651.012508:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1925 committed 00000004:00080000:0.0:1746144651.012510:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1924 committed 00000004:00080000:0.0:1746144651.012511:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1988 committed 00010000:00010000:1.0:1746144651.012513:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00000004:00080000:0.0:1746144651.012514:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746144651.012515:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1923 committed 00000004:00080000:0.0:1746144651.012517:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1922 committed 00010000:00010000:1.0:1746144651.012518:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00000004:00080000:0.0:1746144651.012519:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1986 committed 00010000:00010000:1.0:1746144651.012523:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edd3800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144651.012526:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00000001:00080000:0.0:1746144651.012527:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943774 is committed 00010000:00010000:1.0:1746144651.012532:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00000001:00080000:0.0:1746144651.012535:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943770 is committed 00010000:00010000:1.0:1746144651.012545:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000001:00080000:0.0:1746144651.012546:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943778 is committed 00010000:00010000:1.0:1746144651.012548:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000001:00080000:0.0:1746144651.012549:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943777 is committed 00010000:00010000:1.0:1746144651.012552:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144651.012557:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e0188bb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00000001:00080000:0.0:1746144651.012571:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943781 is committed 00000100:00100000:0.0:1746144651.012615:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747373568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144651.012652:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144651.012681:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747374080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144651.012695:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.012697:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747373952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.012719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.012734:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747374464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.012747:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.012764:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747373824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.012777:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.012785:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747374336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.012797:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.012819:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747373568 00000100:00100000:1.0:1746144651.012825:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747373568 00000100:00100000:1.0:1746144651.012859:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747374080 00000100:00100000:1.0:1746144651.012861:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747374080 00000100:00100000:1.0:1746144651.012871:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747374464 00000100:00100000:1.0:1746144651.012873:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747374464 00000100:00100000:1.0:1746144651.012882:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747373824 00000100:00100000:1.0:1746144651.012883:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747373824 00000100:00100000:1.0:1746144651.012890:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747373696 00000100:00100000:1.0:1746144651.012891:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747373696 00000100:00100000:1.0:1746144651.012899:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11104 00000100:00100000:1.0:1746144651.012905:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747373568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.013057:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747373568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (404us total) trans 17179873105 rc 0/0 00000100:00100000:1.0:1746144651.013062:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11104 00000100:00100000:1.0:1746144651.013072:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11107 00000100:00100000:1.0:1746144651.013077:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747373952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.013179:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747373952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (458us total) trans 17179873108 rc 0/0 00000100:00100000:1.0:1746144651.013184:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11107 00000100:00100000:1.0:1746144651.013193:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11109 00000100:00100000:1.0:1746144651.013197:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1830964747374336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.013265:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3296:x1830964747374336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (466us total) trans 17179873109 rc 0/0 00000100:00100000:1.0:1746144651.013281:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11109 00000100:00100000:1.0:1746144651.013290:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11110 00000100:00100000:1.0:1746144651.013293:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747373696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.013366:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747373696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (553us total) trans 17179873110 rc 0/0 00000100:00100000:1.0:1746144651.013370:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11110 00000100:00100000:1.0:1746144651.013377:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11111 00000100:00100000:1.0:1746144651.013380:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747374208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.013447:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747374208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (608us total) trans 17179873111 rc 0/0 00000100:00100000:1.0:1746144651.013453:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11111 00000100:00080000:1.0:1746144651.013467:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746144651.013483:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747374848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144651.013499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.013515:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747375360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144651.013527:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.013545:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873098 gen 2 00000004:00080000:1.0:1746144651.013549:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ce00, transno 17179873033 00000004:00080000:1.0:1746144651.013553:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092936d80, transno 17179873034 00000004:00080000:1.0:1746144651.013556:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c4380, transno 17179873035 00000004:00080000:1.0:1746144651.013558:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c7b80, transno 17179873036 00000004:00080000:1.0:1746144651.013560:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33d500, transno 17179873037 00000004:00080000:1.0:1746144651.013562:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33e680, transno 17179873038 00000004:00080000:1.0:1746144651.013564:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092935f80, transno 17179873039 00000004:00080000:1.0:1746144651.013565:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ca80, transno 17179873040 00000004:00080000:1.0:1746144651.013567:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f437480, transno 17179873041 00000004:00080000:1.0:1746144651.013569:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f800, transno 17179873045 00000004:00080000:1.0:1746144651.013571:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33c000, transno 17179873046 00000004:00080000:1.0:1746144651.013573:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c4a80, transno 17179873047 00000004:00080000:1.0:1746144651.013575:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33df80, transno 17179873048 00000004:00080000:1.0:1746144651.013578:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c4000, transno 17179873049 00000004:00080000:1.0:1746144651.013579:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33e300, transno 17179873050 00000004:00080000:1.0:1746144651.013581:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c7480, transno 17179873051 00000004:00080000:1.0:1746144651.013583:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c6680, transno 17179873052 00000004:00080000:1.0:1746144651.013585:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644b480, transno 17179873053 00000004:00080000:1.0:1746144651.013587:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f270380, transno 17179873054 00000004:00080000:1.0:1746144651.013589:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092934000, transno 17179873055 00000004:00080000:1.0:1746144651.013591:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f271180, transno 17179873056 00000004:00080000:1.0:1746144651.013592:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092935c00, transno 17179873057 00000004:00080000:1.0:1746144651.013594:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f271f80, transno 17179873058 00000004:00080000:1.0:1746144651.013596:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33dc00, transno 17179873059 00000004:00080000:1.0:1746144651.013598:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092937480, transno 17179873060 00000004:00080000:1.0:1746144651.013600:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f270000, transno 17179873061 00000004:00080000:1.0:1746144651.013602:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f436d80, transno 17179873062 00000004:00080000:1.0:1746144651.013603:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefad80, transno 17179873072 00000004:00080000:1.0:1746144651.013605:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cef8380, transno 17179873073 00000004:00080000:1.0:1746144651.013607:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cef8a80, transno 17179873074 00000004:00080000:1.0:1746144651.013609:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefa680, transno 17179873075 00000004:00080000:1.0:1746144651.013610:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefaa00, transno 17179873076 00000004:00080000:1.0:1746144651.013613:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cef9180, transno 17179873077 00000004:00080000:1.0:1746144651.013614:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cef8000, transno 17179873078 00000004:00080000:1.0:1746144651.013616:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefb480, transno 17179873079 00000004:00080000:1.0:1746144651.013618:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39b480, transno 17179873080 00000004:00080000:1.0:1746144651.013620:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb4d180, transno 17179873081 00000004:00080000:1.0:1746144651.013622:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cca80, transno 17179873082 00000004:00080000:1.0:1746144651.013624:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cea00, transno 17179873083 00000004:00080000:1.0:1746144651.013626:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cfb80, transno 17179873084 00000004:00080000:1.0:1746144651.013628:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cd500, transno 17179873085 00000004:00080000:1.0:1746144651.013630:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cce00, transno 17179873086 00000004:00080000:1.0:1746144651.013632:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1ced80, transno 17179873087 00000004:00080000:1.0:1746144651.013634:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cf800, transno 17179873088 00000004:00080000:1.0:1746144651.013636:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eed80, transno 17179873089 00000004:00080000:1.0:1746144651.013638:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebd500, transno 17179873090 00000004:00080000:1.0:1746144651.013640:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eea00, transno 17179873091 00000004:00080000:1.0:1746144651.013641:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebdc00, transno 17179873092 00000004:00080000:1.0:1746144651.013643:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f272680, transno 17179873093 00000004:00080000:1.0:1746144651.013645:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51edc00, transno 17179873094 00000004:00080000:1.0:1746144651.013647:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ec700, transno 17179873095 00000004:00080000:1.0:1746144651.013649:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093988a80, transno 17179873096 00000004:00080000:1.0:1746144651.013650:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ef480, transno 17179873097 00000004:00080000:1.0:1746144651.013652:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ee300, transno 17179873098 00000100:00100000:1.0:1746144651.013657:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880093762680 x1830964747374336/t17179873109(17179873109) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144667 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746144651.013665:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093762680/2, rc 0, transno 17179873109 00000100:00100000:1.0:1746144651.013668:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747374336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.013675:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746144651.013679:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747374720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144651.013707:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.013720:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747375232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144651.013735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.013750:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747374848 00000100:00100000:1.0:1746144651.013753:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747374848 00000100:00100000:1.0:1746144651.013770:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747375360 00000100:00100000:1.0:1746144651.013772:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747375360 00000100:00100000:1.0:1746144651.013779:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747374720 00000100:00100000:1.0:1746144651.013781:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747374720 00000100:00100000:1.0:1746144651.013787:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747375232 00000100:00100000:1.0:1746144651.013788:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747375232 00000100:00100000:1.0:1746144651.013795:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11112 00000100:00100000:1.0:1746144651.013799:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3296:x1830964747374848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.013854:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11113 00000100:00100000:0.0:1746144651.013861:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3296:x1830964747375360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144651.013902:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3296:x1830964747374848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (401us total) trans 21474840356 rc 0/0 00000100:00100000:1.0:1746144651.013907:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11112 00000100:00100000:1.0:1746144651.013916:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11114 00000100:00100000:1.0:1746144651.013919:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3296:x1830964747374720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.013958:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3296:x1830964747375360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (428us total) trans 21474840357 rc 0/0 00000100:00100000:0.0:1746144651.013963:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11113 00000100:00100000:0.0:1746144651.013974:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11115 00000100:00100000:0.0:1746144651.013978:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3296:x1830964747375232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014068:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3296:x1830964747375232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (331us total) trans 21474840358 rc 0/0 00000100:00100000:0.0:1746144651.014073:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11115 00000100:00100000:0.0:1746144651.014088:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747374592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014115:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144651.014156:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747375104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014179:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144651.014195:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920adc00/2, rc 0, transno 17179873105 00000100:00100000:0.0:1746144651.014204:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747373568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144651.014211:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746144651.014215:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747374976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014236:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144651.014244:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747375488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014264:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144651.014292:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747374592 00000100:00100000:0.0:1746144651.014295:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747374592 00000100:00100000:0.0:1746144651.014305:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747375104 00000100:00100000:0.0:1746144651.014306:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747375104 00000100:00100000:0.0:1746144651.014311:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747374976 00000100:00100000:0.0:1746144651.014312:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747374976 00000100:00100000:0.0:1746144651.014326:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747375488 00000100:00100000:0.0:1746144651.014327:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747375488 00000100:00100000:0.0:1746144651.014334:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11116 00000100:00100000:0.0:1746144651.014338:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3294:x1830964747374592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014439:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3294:x1830964747374592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (323us total) trans 21474840359 rc 0/0 00000100:00100000:0.0:1746144651.014451:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11116 00000100:00100000:0.0:1746144651.014460:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11117 00000100:00100000:0.0:1746144651.014463:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3294:x1830964747375104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014550:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3294:x1830964747375104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (378us total) trans 21474840360 rc 0/0 00000100:00100000:0.0:1746144651.014555:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11117 00000100:00100000:0.0:1746144651.014568:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11118 00000100:00100000:0.0:1746144651.014573:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3294:x1830964747374976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144651.014642:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746144651.014645:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144651.014648:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144651.014649:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144651.014651:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144651.014673:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3294:x1830964747374976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (430us total) trans 21474840361 rc 0/0 00000100:00100000:0.0:1746144651.014678:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11118 00000100:00100000:0.0:1746144651.014685:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11119 00000100:00100000:0.0:1746144651.014689:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3294:x1830964747375488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144651.014769:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3294:x1830964747375488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (504us total) trans 21474840362 rc 0/0 00000100:00100000:0.0:1746144651.014773:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11119 00000004:00080000:0.0:1746144651.014798:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943f8000/2, rc 0, transno 21474840361 00000100:00100000:0.0:1746144651.014801:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747374976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144651.014807:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e31500/2, rc 0, transno 21474840362 00000100:00100000:0.0:1746144651.014809:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747375488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144651.014820:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093989f80/2, rc 0, transno 21474840359 00000100:00100000:0.0:1746144651.014822:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747374592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144651.014827:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb4700/2, rc 0, transno 21474840360 00000100:00100000:0.0:1746144651.014830:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747375104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144651.014926:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3296:x1830964747374720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1005us (1218us total) trans 21474840363 rc 0/0 00000100:00100000:1.0:1746144651.014932:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11114 00000100:00080000:1.0:1746144651.014962:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746144651.014992:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e15500/2, rc 0, transno 17179873108 00000100:00100000:1.0:1746144651.014996:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747373952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144651.015023:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ee4700/2, rc 0, transno 17179873107 00000100:00100000:1.0:1746144651.015026:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747374464:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144651.015437:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e15180/2, rc 0, transno 17179873106 00000100:00100000:0.0:1746144651.015440:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747374080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144651.015505:0:14755:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 1 in flight, 54 done 00000100:00100000:0.0:1746144651.015539:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747375616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144651.015609:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943fb480/2, rc 0, transno 21474840363 00000100:00100000:1.0:1746144651.015614:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747374720:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144651.015639:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cefb100/2, rc 0, transno 21474840358 00000100:00100000:1.0:1746144651.015642:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747375232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144651.015659:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943f9880/2, rc 0, transno 21474840356 00000100:00100000:1.0:1746144651.015662:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747374848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144651.015678:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e31f80/2, rc 0, transno 21474840357 00000100:00100000:1.0:1746144651.015681:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747375360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144651.015687:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920aed80/2, rc 0, transno 17179873112 00000100:00100000:1.0:1746144651.015689:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747373824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144651.015726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144651.015742:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747375616 00000100:00100000:1.0:1746144651.015745:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747375616 00000100:00100000:1.0:1746144651.015787:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11120 00000100:00100000:1.0:1746144651.015803:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747375616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.015944:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747375616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (209us total) trans 17179873113 rc 0/0 00000100:00100000:1.0:1746144651.015949:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11120 00000004:00080000:0.0:1746144651.017287:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801309d4380/2, rc 0, transno 17179873113 00000100:00100000:0.0:1746144651.017293:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747375616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144651.017423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144651.017669:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746384256 00000100:00100000:0.0:1746144651.017673:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746384256 00000100:00100000:0.0:1746144651.017711:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9933 00000100:00100000:0.0:1746144651.017717:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28796:x1830964746384256:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144651.017732:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144651.017745:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e0188c2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ddc1 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746144651.017823:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746144651.017877:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e0188c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc1 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144651.017889:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e0188c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc1 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144651.017904:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144651.017907:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144651.017910:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3000, rc 0) 00000100:00100000:0.0:1746144651.017951:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28796:x1830964746384256:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 233us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144651.017956:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9933 00000100:00100000:0.0:1746144651.021785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144651.027667:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11122 00000100:00100000:1.0:1746144651.027683:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746384640:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144651.027692:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144651.027703:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136932c00/0xa7c849b16e0188de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ddd6 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144651.027722:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d8b, atime: 0x68140d88, ctime: 0x68140d8b, blocks: 0x81d 00010000:00010000:1.0:1746144651.027731:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144651.027733:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144651.027737:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136932c00/0xa7c849b16e0188de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddd6 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144651.027747:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136932c00/0xa7c849b16e0188de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddd6 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144651.027753:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136932c00, rc 0) 00000100:00100000:1.0:1746144651.027776:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746384640:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 96us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144651.027780:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11122 00000100:00100000:1.0:1746144651.027794:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11124 00000100:00100000:1.0:1746144651.027798:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746384896:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144651.027804:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144651.027811:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dde4 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144651.027821:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d89, atime: 0x68140d89, ctime: 0x68140d89, blocks: 0x821 00010000:00010000:1.0:1746144651.027828:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144651.027829:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144651.027833:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144651.027846:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144651.027852:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136933c00, rc 0) 00000100:00100000:1.0:1746144651.027864:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746384896:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 66us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144651.027869:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11124 00000100:00080000:1.0:1746144651.027885:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746144651.027888:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746144651.685798:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144652.039828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.041316:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746385408 00000100:00100000:1.0:1746144652.041324:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746385408 00000100:00100000:1.0:1746144652.041390:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4125 00000100:00100000:1.0:1746144652.041397:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746385408:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:1.0:1746144652.041424:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.041436:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.041438:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.041441:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.041454:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.044195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.044757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.044800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.044833:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746385664 00000100:00100000:0.0:1746144652.044839:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746385664 00000100:00100000:0.0:1746144652.044877:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746385920 00000100:00100000:0.0:1746144652.044879:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746385920 00000100:00100000:0.0:1746144652.044891:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746386176 00000100:00100000:0.0:1746144652.044893:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746386176 00000100:00100000:0.0:1746144652.044908:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4126 00000100:00100000:0.0:1746144652.044914:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746385664:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:0.0:1746144652.044938:0:31509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f2df200/0xa7c849b16e018908 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.044949:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.044950:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.044955:0:31509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2df200/0xa7c849b16e018908 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.044967:0:31509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2df200/0xa7c849b16e018908 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.046420:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4127 00000100:00100000:0.0:1746144652.046428:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746385920:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:0.0:1746144652.046449:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.046457:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.046459:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.046462:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.046471:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.052748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.052777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.052799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.052825:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746386688 00000100:00100000:0.0:1746144652.052828:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746386688 00000100:00100000:0.0:1746144652.052854:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4129 00000100:00100000:0.0:1746144652.052861:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746386432:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:0.0:1746144652.052890:0:21596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d796600/0xa7c849b16e01891d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.052902:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.052904:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.052907:0:21596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d796600/0xa7c849b16e01891d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.052917:0:21596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d796600/0xa7c849b16e01891d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.054067:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4131 00000100:00100000:1.0:1746144652.054361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.055109:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746386944:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:0.0:1746144652.055128:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.055150:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.055151:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.055154:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.055721:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065171:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065186:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065193:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065199:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e46d600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144652.065203:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065209:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065225:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.065231:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e46d600/0xa7c849b16e018901 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.065316:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746385408:12345-192.168.204.23@tcp:3:mirror_io.0 Request processed in 23916us (25490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.065324:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4125 00010000:00010000:1.0:1746144652.074458:0:8457:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.074474:0:8457:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.074485:0:8457:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.074491:0:8457:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2df000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144652.074495:0:8457:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.074501:0:8457:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.074517:0:8457:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.074523:0:8457:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2df000/0xa7c849b16e01890f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.074586:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746385920:12345-192.168.204.23@tcp:3:mirror_io.0 Request processed in 28156us (29825us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.074596:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4127 00010000:00010000:1.0:1746144652.092587:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.092600:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.092607:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.092613:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d796000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144652.092616:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.092622:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.092633:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.092638:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d796000/0xa7c849b16e018932 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.092702:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746386944:12345-192.168.204.23@tcp:3:mirror_io.0 Request processed in 38625us (39898us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.092708:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4131 00000100:00100000:0.0:1746144652.098370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.101195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.105601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.137259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:1.0:1746144652.138201:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144652.139856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:1.0:1746144652.141507:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144652.147356:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746388608 00000100:00100000:0.0:1746144652.147363:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746388608 00000100:00100000:0.0:1746144652.147410:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3972 00000100:00100000:0.0:1746144652.147417:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28811:x1830964746388608:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144652.147567:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28811:x1830964746388608:12345-192.168.204.23@tcp:35:cat.0 Request processed in 150us (277us total) trans 8589943787 rc 0/0 00000100:00100000:0.0:1746144652.147573:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3972 00000100:00100000:0.0:1746144652.147591:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746388864 00000100:00100000:0.0:1746144652.147593:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746388864 00000100:00100000:0.0:1746144652.147622:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9937 00000100:00100000:0.0:1746144652.147627:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:28810:x1830964746388864:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.147638:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.147651:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01897f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de07 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.147702:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e018986 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144652.147717:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e018986 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144652.147726:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e018986 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:0.0:1746144652.147735:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144652.147786:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01897f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de07 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.147797:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e018986 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de07 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.147804:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144652.147807:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746144652.147810:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177a00, rc 0) 00000100:00100000:0.0:1746144652.147830:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+10:28810:x1830964746388864:12345-192.168.204.23@tcp:101:cat.0 Request processed in 202us (539us total) trans 8589943788 rc 0/0 00000100:00100000:0.0:1746144652.147835:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9937 00000100:00100000:0.0:1746144652.152006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.152767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.152781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.152790:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746389376 00000100:00100000:0.0:1746144652.152793:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746389376 00000100:00100000:0.0:1746144652.152812:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11128 00000100:00100000:0.0:1746144652.152818:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+13:1963:x1830964746389376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.152825:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.152834:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f177800/0xa7c849b16e01899b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de1c expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.152845:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.152846:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.152850:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f177800/0xa7c849b16e01899b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de1c expref: 14 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.152859:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f177800/0xa7c849b16e01899b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de1c expref: 14 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.152866:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177800, rc 0) 00000100:00100000:0.0:1746144652.152884:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+14:1963:x1830964746389376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 66us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.152889:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11128 00000100:00100000:0.0:1746144652.152941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.152952:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746389504 00000100:00100000:0.0:1746144652.152954:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746389504 00000100:00100000:0.0:1746144652.152971:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11129 00000100:00100000:0.0:1746144652.152975:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746389504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.152982:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.152987:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de23 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.152997:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.152998:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153002:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de23 expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153010:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de23 expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153017:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177400, rc 0) 00000100:00100000:0.0:1746144652.153030:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746389504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 55us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.153035:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11129 00000100:00100000:0.0:1746144652.153057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.153067:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746389632 00000100:00100000:0.0:1746144652.153069:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746389632 00000100:00100000:0.0:1746144652.153084:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11130 00000100:00100000:0.0:1746144652.153089:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+6:1963:x1830964746389632:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.153095:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.153100:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f176200/0xa7c849b16e0189a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de2a expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153111:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153112:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153115:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f176200/0xa7c849b16e0189a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de2a expref: 7 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153123:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f176200/0xa7c849b16e0189a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de2a expref: 7 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153129:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f176200, rc 0) 00000100:00100000:0.0:1746144652.153159:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+7:1963:x1830964746389632:12345-192.168.204.23@tcp:101:cat.0 Request processed in 70us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.153164:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11130 00000100:00100000:0.0:1746144652.153193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.153203:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746389760 00000100:00100000:0.0:1746144652.153205:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746389760 00000100:00100000:0.0:1746144652.153218:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11131 00000100:00100000:0.0:1746144652.153222:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+7:1962:x1830964746389760:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.153228:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.153234:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f177600/0xa7c849b16e0189b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de31 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153242:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153244:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153257:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f177600/0xa7c849b16e0189b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de31 expref: 8 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153264:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f177600/0xa7c849b16e0189b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de31 expref: 8 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153270:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177600, rc 0) 00000100:00100000:0.0:1746144652.153282:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+8:1962:x1830964746389760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 60us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.153286:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11131 00000100:00100000:0.0:1746144652.153311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.153320:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746389888 00000100:00100000:0.0:1746144652.153322:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746389888 00000100:00100000:0.0:1746144652.153335:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11132 00000100:00100000:0.0:1746144652.153339:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746389888:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.153344:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.153350:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e0189b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de38 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153358:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153359:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153362:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e0189b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de38 expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153370:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e0189b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de38 expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153376:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177000, rc 0) 00000100:00100000:0.0:1746144652.153389:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746389888:12345-192.168.204.23@tcp:101:cat.0 Request processed in 49us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.153393:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11132 00000100:00100000:0.0:1746144652.153423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.153434:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746390016 00000100:00100000:0.0:1746144652.153436:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746390016 00000100:00100000:0.0:1746144652.153448:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11133 00000100:00100000:0.0:1746144652.153452:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746390016:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.153457:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.153464:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de3f expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153473:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153474:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153478:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de3f expref: 12 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153489:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de3f expref: 12 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153495:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1252000, rc 0) 00000100:00100000:0.0:1746144652.153507:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746390016:12345-192.168.204.23@tcp:101:cat.0 Request processed in 55us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.153511:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11133 00000100:00100000:0.0:1746144652.153549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.153560:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746390144 00000100:00100000:0.0:1746144652.153563:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746390144 00000100:00100000:0.0:1746144652.153575:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11134 00000100:00100000:0.0:1746144652.153579:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+8:1963:x1830964746390144:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.153585:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.153590:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de46 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153599:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153601:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.153604:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de46 expref: 9 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153612:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de46 expref: 9 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.153618:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1253e00, rc 0) 00000100:00100000:0.0:1746144652.153630:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746390144:12345-192.168.204.23@tcp:101:cat.0 Request processed in 51us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.153635:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11134 00000100:00100000:0.0:1746144652.153693:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746389248 00000100:00100000:0.0:1746144652.153697:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746389248 00000100:00100000:0.0:1746144652.153716:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9938 00000100:00100000:0.0:1746144652.153720:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28809:x1830964746389248:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144652.153731:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.153739:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176e00/0xa7c849b16e0189cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de15 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153805:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e0189d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144652.153815:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79200/0xa7c849b16e0188d0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc8 expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153822:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4df000/0xa7c849b16e01894e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddf9 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153827:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79000/0xa7c849b16e018971 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de00 expref: 300 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153832:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090f57000/0xa7c849b16e0189d3 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144652.153853:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79000/0xa7c849b16e018971 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de00 expref: 300 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153862:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79000/0xa7c849b16e018971 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de00 expref: 300 pid: 15388 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746144652.153877:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747375744:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144652.153938:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4df000/0xa7c849b16e01894e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddf9 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153945:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4df000/0xa7c849b16e01894e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddf9 expref: 9 pid: 14708 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746144652.153951:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093763800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747375872:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144652.153972:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79200/0xa7c849b16e0188d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc8 expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.153979:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb79200/0xa7c849b16e0188d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc8 expref: 9 pid: 15388 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746144652.153985:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747376000:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144652.153999:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ed80 going to sleep for 11 seconds 00000100:00080000:1.0:1746144652.154155:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746144652.154158:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144652.155885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.155910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.155928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.155941:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746390400 00000100:00100000:0.0:1746144652.155945:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746390400 00000100:00100000:0.0:1746144652.155962:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746390656 00000100:00100000:0.0:1746144652.155964:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746390656 00000100:00100000:0.0:1746144652.155971:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746390272 00000100:00100000:0.0:1746144652.155972:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746390272 00000100:00100000:0.0:1746144652.155981:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11135 00000100:00100000:0.0:1746144652.155986:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746390400:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.155995:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.156004:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de54 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.156017:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156018:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156023:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de54 expref: 26 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156033:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de54 expref: 26 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156039:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d796800, rc 0) 00000100:00100000:0.0:1746144652.156060:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746390400:12345-192.168.204.23@tcp:101:cat.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.156065:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11135 00000100:00100000:0.0:1746144652.156075:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11136 00000100:00100000:0.0:1746144652.156078:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1963:x1830964746390656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.156083:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.156088:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de62 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.156096:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156097:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156101:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de62 expref: 16 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156112:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de62 expref: 16 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156117:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d796200, rc 0) 00000100:00100000:0.0:1746144652.156126:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746390656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.156130:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11136 00000100:00100000:0.0:1746144652.156154:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11137 00000100:00100000:0.0:1746144652.156158:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1963:x1830964746390272:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.156162:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.156167:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d796600/0xa7c849b16e0189e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de4d expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.156174:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156175:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156178:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d796600/0xa7c849b16e0189e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de4d expref: 16 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156185:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d796600/0xa7c849b16e0189e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de4d expref: 16 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156190:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d796600, rc 0) 00000100:00100000:0.0:1746144652.156199:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746390272:12345-192.168.204.23@tcp:101:cat.0 Request processed in 42us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.156203:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11137 00000100:00100000:0.0:1746144652.156240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.156266:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746390528 00000100:00100000:0.0:1746144652.156269:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746390528 00000100:00100000:0.0:1746144652.156282:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11138 00000100:00100000:0.0:1746144652.156286:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746390528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.156292:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.156297:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d797000/0xa7c849b16e0189ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de5b expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.156306:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156307:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.156311:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d797000/0xa7c849b16e0189ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de5b expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156319:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d797000/0xa7c849b16e0189ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de5b expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.156325:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d797000, rc 0) 00000100:00100000:0.0:1746144652.156337:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746390528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.156342:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11138 00000100:00100000:0.0:1746144652.164982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.165065:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746391168 00000100:00100000:1.0:1746144652.165070:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746391168 00000100:00100000:1.0:1746144652.165113:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9939 00000100:00100000:1.0:1746144652.165120:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28811:x1830964746391168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.165158:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.165171:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de69 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.165219:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de69 expref: 302 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.165230:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de69 expref: 302 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.165256:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144652.165259:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144652.165261:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b060400, rc 0) 00000100:00100000:1.0:1746144652.165307:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28811:x1830964746391168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 187us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.165313:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9939 00000100:00100000:0.0:1746144652.171219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.171277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.173811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.174042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.174183:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746391424 00000100:00100000:1.0:1746144652.174186:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746391424 00000100:00100000:1.0:1746144652.174205:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9940 00000100:00100000:1.0:1746144652.174209:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:28808:x1830964746391424:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144652.174225:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.174226:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144652.174608:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e018986 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de07 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.174679:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144652.174683:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144652.174693:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060a00/0xa7c849b16e0189fd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de70 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.174730:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144652.174740:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e0188c2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc1 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.174746:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de69 expref: 300 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.174751:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144652.174775:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de69 expref: 300 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.174785:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de69 expref: 300 pid: 14708 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.174795:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747376128:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144652.175218:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e0188c2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc1 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.175225:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e0188c2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddc1 expref: 8 pid: 15388 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.175232:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747376256:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144652.175260:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c194600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.176775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144652.176978:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060400/0xa7c849b16e0189f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de69 expref: 300 pid: 14708 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.176988:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747376128:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144652.176997:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747376256:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144652.177011:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144652.177113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144652.177962:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144652.177967:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000040:00080000:1.0:1746144652.179676:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2812, 88 off234392 00000004:00080000:1.0:1746144652.179685:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631388549928ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.179740:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2743, 88 off228312 00000004:00080000:1.0:1746144652.179744:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631388609765ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.179764:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2744, 88 off228400 00000004:00080000:1.0:1746144652.179767:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631388632281ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.179773:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2813, 88 off234480 00000004:00080000:1.0:1746144652.179775:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631388640738ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.179781:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2814, 88 off234568 00000004:00080000:1.0:1746144652.179783:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631388648618ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.179789:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2745, 88 off228488 00000004:00080000:1.0:1746144652.179791:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631388656998ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.179800:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2746, 88 off228576 00000004:00080000:1.0:1746144652.179802:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631388667555ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.180270:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2747, 88 off228664 00000004:00080000:1.0:1746144652.180275:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631389140863ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.180298:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2815, 88 off234656 00000004:00080000:1.0:1746144652.180301:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631389165966ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.180311:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2748, 88 off228752 00000004:00080000:1.0:1746144652.180313:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631389178455ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.180319:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2816, 88 off234744 00000004:00080000:1.0:1746144652.180321:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631389186858ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.180328:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2749, 88 off228840 00000004:00080000:1.0:1746144652.180331:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631389196010ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144652.180336:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2817, 88 off234832 00000004:00080000:1.0:1746144652.180339:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631389204228ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.180344:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2818, 88 off234920 00000004:00080000:1.0:1746144652.180346:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631389211328ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.180351:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2819, 88 off235008 00000004:00080000:1.0:1746144652.180357:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631389222815ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.180363:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2820, 88 off235096 00000004:00080000:1.0:1746144652.180365:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 631389230191ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144652.180370:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2750, 88 off228928 00000004:00080000:1.0:1746144652.180372:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 631389237260ns, next at 593480289301ns, rc = 0 00000100:00100000:1.0:1746144652.184792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.184818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.184848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.186945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.187078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.187109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.187179:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746392960 00000100:00100000:1.0:1746144652.187183:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746392960 00002000:00100000:1.0:1746144652.187199:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4e15c00 x1830964746392960/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.187206:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e15c00 with x1830964746392960 ext(0->1048575) 00002000:00010000:1.0:1746144652.187209:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e15c00 00000100:00100000:1.0:1746144652.187225:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4136 00000100:00100000:1.0:1746144652.187231:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746392704:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144652.187774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.188415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.188687:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746393472 00000100:00100000:1.0:1746144652.188692:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746393472 00002000:00100000:1.0:1746144652.188713:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a4e17800 x1830964746393472/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.188721:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e17800 with x1830964746393472 ext(1048576->2097151) 00002000:00010000:1.0:1746144652.188724:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e17800 00000100:00100000:1.0:1746144652.188732:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746393728 00000100:00100000:1.0:1746144652.188734:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746393728 00002000:00100000:1.0:1746144652.188744:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012c946680 x1830964746393728/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.188751:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946680 with x1830964746393728 ext(1048576->2097151) 00002000:00010000:1.0:1746144652.188753:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c946680 00000100:00100000:1.0:1746144652.188760:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4139 00000100:00100000:1.0:1746144652.188765:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746393472:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:0.0:1746144652.225555:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de70 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.225568:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144652.225571:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746144652.225585:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b060a00/0xa7c849b16e0189fd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de70 expref: 11 pid: 14710 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746144652.225599:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de70 expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.225625:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144652.225627:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746144652.225628:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b061600, rc 0) 00000100:00100000:0.0:1746144652.225679:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:28808:x1830964746391424:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 51467us (51636us total) trans 8589943790 rc 0/0 00000100:00100000:0.0:1746144652.225687:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9940 00000001:00080000:0.0:1746144652.225712:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943788 is committed 00000001:00080000:0.0:1746144652.225720:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943787 is committed 00000001:00080000:0.0:1746144652.225724:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943790 is committed 00000004:00080000:0.0:1746144652.225727:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1937 committed 00000004:00080000:0.0:1746144652.225733:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2003 committed 00000004:00080000:0.0:1746144652.225738:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2002 committed 00000004:00080000:0.0:1746144652.225740:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2001 committed 00000004:00080000:0.0:1746144652.225742:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2000 committed 00000004:00080000:0.0:1746144652.225743:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1936 committed 00000004:00080000:0.0:1746144652.225745:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1999 committed 00000004:00080000:0.0:1746144652.225746:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1935 committed 00000004:00080000:0.0:1746144652.225747:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1998 committed 00000004:00080000:0.0:1746144652.225749:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1934 committed 00000004:00080000:0.0:1746144652.225750:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1933 committed 00000004:00080000:0.0:1746144652.225752:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1932 committed 00000004:00080000:0.0:1746144652.225753:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1997 committed 00000004:00080000:0.0:1746144652.225754:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1996 committed 00000004:00080000:0.0:1746144652.225755:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1931 committed 00000004:00080000:0.0:1746144652.225756:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1930 committed 00000004:00080000:0.0:1746144652.225757:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1995 committed 00000001:00080000:0.0:1746144652.225765:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943783 is committed 00000001:00080000:0.0:1746144652.225769:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943789 is committed 00000001:00080000:0.0:1746144652.225776:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943784 is committed 00000100:00100000:0.0:1746144652.225971:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747376384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226007:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226053:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747376896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226068:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226080:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226102:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226112:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226124:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746144652.226128:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747376512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226193:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226206:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226215:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226225:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226234:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747378048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226258:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226275:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747376640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226290:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226298:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226310:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226319:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226330:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226339:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747378176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226351:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226361:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746144652.226364:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747376768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226376:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226382:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226406:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226417:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226423:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747378304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.226433:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144652.226451:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747376384 00000100:00100000:0.0:1746144652.226456:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747376384 00000100:00100000:0.0:1746144652.226476:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747376896 00000100:00100000:0.0:1746144652.226478:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747376896 00000100:00100000:0.0:1746144652.226483:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377408 00000100:00100000:0.0:1746144652.226484:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377408 00000100:00100000:0.0:1746144652.226491:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377920 00000100:00100000:0.0:1746144652.226493:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377920 00000100:00100000:0.0:1746144652.226499:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747376512 00000100:00100000:0.0:1746144652.226500:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747376512 00000100:00100000:0.0:1746144652.226506:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377024 00000100:00100000:0.0:1746144652.226507:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377024 00000100:00100000:0.0:1746144652.226512:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377536 00000100:00100000:0.0:1746144652.226513:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377536 00000100:00100000:0.0:1746144652.226518:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747378048 00000100:00100000:0.0:1746144652.226519:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747378048 00000100:00100000:0.0:1746144652.226524:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747376640 00000100:00100000:0.0:1746144652.226525:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747376640 00000100:00100000:0.0:1746144652.226530:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377152 00000100:00100000:0.0:1746144652.226531:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377152 00000100:00100000:0.0:1746144652.226536:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377664 00000100:00100000:0.0:1746144652.226538:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377664 00000100:00100000:0.0:1746144652.226543:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747378176 00000100:00100000:0.0:1746144652.226544:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747378176 00000100:00100000:0.0:1746144652.226549:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747376768 00000100:00100000:0.0:1746144652.226551:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747376768 00000100:00100000:0.0:1746144652.226556:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377280 00000100:00100000:0.0:1746144652.226557:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377280 00000100:00100000:0.0:1746144652.226563:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747377792 00000100:00100000:0.0:1746144652.226564:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747377792 00000100:00100000:0.0:1746144652.226569:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747378304 00000100:00100000:0.0:1746144652.226570:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747378304 00000100:00100000:0.0:1746144652.226577:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11139 00000100:00100000:0.0:1746144652.226582:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747376384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144652.226791:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144652.226794:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.226796:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144648 -> 1746144648 00002000:00010000:0.0:1746144652.226798:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.226799:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2077 -> 2081 00000100:00100000:0.0:1746144652.226823:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747376384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 240us (815us total) trans 21474840364 rc 0/0 00000100:00100000:0.0:1746144652.226828:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11139 00000100:00100000:0.0:1746144652.226839:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11140 00000100:00100000:0.0:1746144652.226843:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747376896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.226918:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747376896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (848us total) trans 21474840365 rc 0/0 00000100:00100000:0.0:1746144652.226923:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11140 00000100:00100000:0.0:1746144652.226932:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11141 00000100:00100000:0.0:1746144652.226936:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747377408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144652.227019:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144652.227021:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.227023:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144648 -> 1746144648 00002000:00010000:0.0:1746144652.227025:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.227027:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:0.0:1746144652.227044:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747377408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (951us total) trans 17179873114 rc 0/0 00000100:00100000:0.0:1746144652.227049:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11141 00000100:00100000:0.0:1746144652.227058:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11142 00000100:00100000:0.0:1746144652.227062:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747377920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.227158:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747377920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1016us total) trans 17179873115 rc 0/0 00000100:00100000:0.0:1746144652.227166:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11142 00000100:00100000:0.0:1746144652.227176:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11143 00000100:00100000:0.0:1746144652.227179:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747376512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144652.227275:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144652.227278:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.227279:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.227281:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.227283:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144652.227300:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747376512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (1127us total) trans 21474840366 rc 0/0 00000100:00100000:0.0:1746144652.227305:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11143 00000100:00100000:0.0:1746144652.227313:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11144 00000100:00100000:0.0:1746144652.227318:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747377024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.227386:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747377024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1179us total) trans 21474840367 rc 0/0 00000100:00100000:0.0:1746144652.227391:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11144 00000100:00100000:0.0:1746144652.227401:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11145 00000100:00100000:0.0:1746144652.227405:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747377536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144652.227463:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144652.227465:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144649 -> 1746144649 00002000:00010000:0.0:1746144652.227467:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144649 -> 1746144649 00002000:00010000:0.0:1746144652.227468:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144649 -> 1746144649 00002000:00010000:0.0:1746144652.227470:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144652.227846:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747377536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 440us (1619us total) trans 17179873116 rc 0/0 00000100:00100000:0.0:1746144652.227851:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11145 00000100:00100000:0.0:1746144652.227860:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11146 00000100:00100000:0.0:1746144652.227863:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747378048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.227924:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747378048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1679us total) trans 17179873117 rc 0/0 00000100:00100000:0.0:1746144652.227928:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11146 00000100:00100000:0.0:1746144652.227935:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11147 00000100:00100000:0.0:1746144652.227938:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1830964747376640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144652.228005:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144652.228008:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.228009:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144650 -> 1746144650 00002000:00010000:0.0:1746144652.228011:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.228012:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144652.228029:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747376640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (1739us total) trans 21474840368 rc 0/0 00000100:00100000:0.0:1746144652.228033:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11147 00000100:00100000:0.0:1746144652.228041:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11148 00000100:00100000:0.0:1746144652.228045:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1830964747377152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.228113:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747377152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1802us total) trans 21474840369 rc 0/0 00000100:00100000:0.0:1746144652.228118:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11148 00000100:00100000:0.0:1746144652.228126:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11149 00000100:00100000:0.0:1746144652.228130:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747377664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144652.228208:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:0.0:1746144652.228211:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.228213:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.228214:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144651 -> 1746144651 00002000:00010000:0.0:1746144652.228215:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5613 -> 5613 00000100:00100000:0.0:1746144652.228233:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747377664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (1901us total) trans 17179873118 rc 0/0 00000100:00100000:0.0:1746144652.228237:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11149 00000100:00100000:0.0:1746144652.228256:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11150 00000100:00100000:0.0:1746144652.228260:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747378176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.228328:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747378176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1975us total) trans 17179873119 rc 0/0 00000100:00100000:0.0:1746144652.228332:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11150 00000100:00100000:0.0:1746144652.228341:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11151 00000100:00100000:0.0:1746144652.228345:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1830964747376768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144652.228403:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746144652.228405:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144652.228407:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144652.228409:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144652.228410:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144652.228427:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747376768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (2050us total) trans 21474840370 rc 0/0 00000100:00100000:0.0:1746144652.228432:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11151 00000100:00100000:0.0:1746144652.228440:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11152 00000100:00100000:0.0:1746144652.228444:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3293:x1830964747377280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144652.228511:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747377280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (2112us total) trans 21474840371 rc 0/0 00000100:00100000:0.0:1746144652.228517:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11152 00000100:00100000:0.0:1746144652.228526:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11153 00000100:00100000:0.0:1746144652.228529:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747377792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.228648:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747377792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (2229us total) trans 17179873120 rc 0/0 00000100:00100000:0.0:1746144652.228652:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11153 00000100:00100000:0.0:1746144652.228661:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11154 00000100:00100000:0.0:1746144652.228665:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747378304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.228730:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747378304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (2295us total) trans 17179873121 rc 0/0 00000100:00100000:0.0:1746144652.228734:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11154 00000100:00100000:0.0:1746144652.228884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.228915:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840363 gen 2 00000004:00080000:0.0:1746144652.228920:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644a680, transno 21474840286 00000004:00080000:0.0:1746144652.228925:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644aa00, transno 21474840287 00000004:00080000:0.0:1746144652.228928:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c5f80, transno 21474840288 00000004:00080000:0.0:1746144652.228930:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644ad80, transno 21474840289 00000004:00080000:0.0:1746144652.228932:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136449880, transno 21474840290 00000004:00080000:0.0:1746144652.228934:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644b800, transno 21474840291 00000004:00080000:0.0:1746144652.228936:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644bb80, transno 21474840292 00000004:00080000:0.0:1746144652.228938:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c5880, transno 21474840293 00000004:00080000:0.0:1746144652.228940:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136958a80, transno 21474840297 00000004:00080000:0.0:1746144652.228942:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013695b100, transno 21474840298 00000004:00080000:0.0:1746144652.228944:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136959f80, transno 21474840299 00000004:00080000:0.0:1746144652.228946:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136958000, transno 21474840300 00000004:00080000:0.0:1746144652.228948:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013695bb80, transno 21474840301 00000004:00080000:0.0:1746144652.228950:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013695a680, transno 21474840302 00000004:00080000:0.0:1746144652.228952:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013695aa00, transno 21474840303 00000004:00080000:0.0:1746144652.228954:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136958e00, transno 21474840304 00000004:00080000:0.0:1746144652.228957:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b60700, transno 21474840305 00000004:00080000:0.0:1746144652.228959:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b60e00, transno 21474840306 00000004:00080000:0.0:1746144652.228961:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b63800, transno 21474840307 00000004:00080000:0.0:1746144652.228962:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b61500, transno 21474840308 00000004:00080000:0.0:1746144652.228964:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b61c00, transno 21474840309 00000004:00080000:0.0:1746144652.228966:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b61180, transno 21474840310 00000004:00080000:0.0:1746144652.228968:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b63b80, transno 21474840311 00000004:00080000:0.0:1746144652.228969:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b62d80, transno 21474840312 00000004:00080000:0.0:1746144652.228971:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee09500, transno 21474840324 00000004:00080000:0.0:1746144652.228973:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee09c00, transno 21474840325 00000004:00080000:0.0:1746144652.228974:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee0a680, transno 21474840326 00000004:00080000:0.0:1746144652.228976:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee0a300, transno 21474840327 00000004:00080000:0.0:1746144652.228978:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f437800, transno 21474840328 00000004:00080000:0.0:1746144652.228980:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee08000, transno 21474840329 00000004:00080000:0.0:1746144652.228982:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee0b100, transno 21474840330 00000004:00080000:0.0:1746144652.228984:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013129d500, transno 21474840331 00000004:00080000:0.0:1746144652.228986:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb4380, transno 21474840332 00000004:00080000:0.0:1746144652.228988:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32df80, transno 21474840333 00000004:00080000:0.0:1746144652.228990:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb4e00, transno 21474840334 00000004:00080000:0.0:1746144652.228992:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb5c00, transno 21474840335 00000004:00080000:0.0:1746144652.228994:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32fb80, transno 21474840336 00000004:00080000:0.0:1746144652.228995:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32dc00, transno 21474840337 00000004:00080000:0.0:1746144652.228998:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefdf80, transno 21474840338 00000004:00080000:0.0:1746144652.229000:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefd880, transno 21474840339 00000004:00080000:0.0:1746144652.229002:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f168380, transno 21474840340 00000004:00080000:0.0:1746144652.229003:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16bb80, transno 21474840341 00000004:00080000:0.0:1746144652.229006:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b812d80, transno 21474840342 00000004:00080000:0.0:1746144652.229008:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16aa00, transno 21474840343 00000004:00080000:0.0:1746144652.229010:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16a680, transno 21474840344 00000004:00080000:0.0:1746144652.229011:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a0380, transno 21474840345 00000004:00080000:0.0:1746144652.229013:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f169880, transno 21474840346 00000004:00080000:0.0:1746144652.229015:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16b100, transno 21474840347 00000004:00080000:0.0:1746144652.229017:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943f9880, transno 21474840356 00000004:00080000:0.0:1746144652.229019:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e31f80, transno 21474840357 00000004:00080000:0.0:1746144652.229020:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cefb100, transno 21474840358 00000004:00080000:0.0:1746144652.229022:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093989f80, transno 21474840359 00000004:00080000:0.0:1746144652.229024:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb4700, transno 21474840360 00000004:00080000:0.0:1746144652.229026:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943f8000, transno 21474840361 00000004:00080000:0.0:1746144652.229028:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e31500, transno 21474840362 00000004:00080000:0.0:1746144652.229029:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943fb480, transno 21474840363 00000100:00100000:0.0:1746144652.229034:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88013092a300 x1830964747376768/t21474840370(21474840370) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144668 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746144652.229042:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092a300/2, rc 0, transno 21474840370 00000100:00100000:0.0:1746144652.229046:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747376768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229056:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092a680/2, rc 0, transno 21474840371 00000100:00100000:0.0:1746144652.229058:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229066:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e0000/2, rc 0, transno 17179873120 00000100:00100000:0.0:1746144652.229071:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229077:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e0e00/2, rc 0, transno 17179873121 00000100:00100000:0.0:1746144652.229080:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747378304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229085:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092aa00/2, rc 0, transno 21474840368 00000100:00100000:0.0:1746144652.229088:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747376640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229093:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130928380/2, rc 0, transno 21474840369 00000100:00100000:0.0:1746144652.229096:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229101:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ee7480/2, rc 0, transno 17179873118 00000100:00100000:0.0:1746144652.229103:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747377664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229108:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e0a80/2, rc 0, transno 17179873119 00000100:00100000:0.0:1746144652.229111:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747378176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229418:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 56 done 00000100:00100000:0.0:1746144652.229432:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747378432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.229455:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144652.229493:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c944e00/2, rc 0, transno 21474840366 00000100:00100000:0.0:1746144652.229496:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747376512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229502:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092bb80/2, rc 0, transno 21474840367 00000100:00100000:0.0:1746144652.229505:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229510:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ee5180/2, rc 0, transno 17179873116 00000100:00100000:0.0:1746144652.229512:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377536:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229517:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e0700/2, rc 0, transno 17179873117 00000100:00100000:0.0:1746144652.229519:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747378048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229526:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c946a00/2, rc 0, transno 21474840364 00000100:00100000:0.0:1746144652.229528:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747376384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229534:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013092b100/2, rc 0, transno 21474840365 00000100:00100000:0.0:1746144652.229536:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747376896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144652.229542:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ee5500/2, rc 0, transno 17179873114 00000100:00100000:0.0:1746144652.229545:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144652.229553:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e0380/2, rc 0, transno 17179873115 00000100:00100000:0.0:1746144652.229555:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747377920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.229568:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747378432 00000100:00100000:0.0:1746144652.229572:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747378432 00000100:00100000:0.0:1746144652.229591:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11155 00000100:00100000:0.0:1746144652.229595:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747378432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.229674:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3295:x1830964747378432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (217us total) trans 17179873122 rc 0/0 00000100:00100000:0.0:1746144652.229679:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11155 00000100:00100000:0.0:1746144652.229763:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746393856 00000100:00100000:0.0:1746144652.229765:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746393856 00000100:00100000:0.0:1746144652.229786:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9941 00000100:00100000:0.0:1746144652.229791:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+7:28810:x1830964746393856:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.229799:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.229812:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e018a12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152de77 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.229849:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e018a12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de77 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.229860:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e018a12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de77 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.229874:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144652.229876:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144652.229879:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4587a00, rc 0) 00000100:00100000:0.0:1746144652.229904:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:28810:x1830964746393856:12345-192.168.204.23@tcp:101:cat.0 Request processed in 112us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.229910:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9941 00000004:00080000:0.0:1746144652.229933:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1fce00/2, rc 0, transno 17179873122 00000100:00100000:0.0:1746144652.229936:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747378432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144652.233109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.241435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.241510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.247041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.247077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.248102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.248397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.249894:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746395008 00000100:00100000:1.0:1746144652.249901:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746395008 00010000:00010000:1.0:1746144652.249934:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de62 expref: 18 pid: 29370 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1746144652.249960:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746394880 00000100:00100000:1.0:1746144652.249963:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746394880 00010000:00010000:1.0:1746144652.249972:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de46 expref: 13 pid: 8389 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1746144652.249987:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5516 00000100:00100000:1.0:1746144652.249993:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746395008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.250009:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144652.250028:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de62 expref: 18 pid: 29370 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.250039:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de62 expref: 18 pid: 29370 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.250056:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d796200/0xa7c849b16e0189e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de62 expref: 18 pid: 29370 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.250078:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.250106:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746395008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 113us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.250112:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5516 00000100:00100000:1.0:1746144652.250126:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5517 00000100:00100000:1.0:1746144652.250130:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746394880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.250155:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144652.250162:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de46 expref: 13 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.250170:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de46 expref: 13 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.250180:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e0189c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de46 expref: 13 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.250193:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.250208:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746394880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 77us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.250213:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5517 00000100:00100000:0.0:1746144652.262862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.264583:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1962:x1830964746394752:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17348us (17504us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144652.264590:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4142 00002000:00100000:0.0:1746144652.264595:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f1fd500 x1830964746394752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144652.264602:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1fd500 with x1830964746394752 ext(1048576->2097151) 00002000:00010000:0.0:1746144652.264605:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1fd500 00000100:00100000:0.0:1746144652.265525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.265623:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746395520 00000100:00100000:1.0:1746144652.265633:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746395520 00002000:00100000:1.0:1746144652.265671:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (4067328->4071423) req@ffff88009f1fe300 x1830964746395520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.265680:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1fe300 with x1830964746395520 ext(4067328->4071423) 00002000:00010000:1.0:1746144652.265685:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1fe300 00000100:00100000:1.0:1746144652.265716:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4143 00000100:00100000:1.0:1746144652.265722:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746395520:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144652.265861:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746395520:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 138us (338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144652.265868:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4143 00002000:00100000:1.0:1746144652.265873:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (4067328->4071423) req@ffff88009f1fe300 x1830964746395520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/4536 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.265879:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1fe300 with x1830964746395520 ext(4067328->4071423) 00002000:00010000:1.0:1746144652.265882:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1fe300 00000100:00100000:0.0:1746144652.268494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.268520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.268591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.268651:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746395904 00000100:00100000:1.0:1746144652.268659:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746395904 00010000:00010000:1.0:1746144652.268688:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d451a00/0xa7c849b16e0188f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddeb expref: 8 pid: 4760 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1746144652.268713:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746395776 00000100:00100000:1.0:1746144652.268715:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746395776 00010000:00010000:1.0:1746144652.268723:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d797000/0xa7c849b16e0189ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de5b expref: 29 pid: 8389 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1746144652.268737:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746395648 00000100:00100000:1.0:1746144652.268739:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746395648 00010000:00010000:1.0:1746144652.268747:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de3f expref: 12 pid: 4760 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1746144652.268760:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5519 00000100:00100000:1.0:1746144652.268765:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746395904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.268781:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144652.269469:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5521 00000100:00100000:0.0:1746144652.269537:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746395648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.269550:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.269566:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de3f expref: 12 pid: 4760 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.269576:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de3f expref: 12 pid: 4760 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.269592:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e0189be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de3f expref: 12 pid: 4760 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.269617:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144652.269650:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746395648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 175us (1058us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144652.269698:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d451a00/0xa7c849b16e0188f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddeb expref: 8 pid: 4760 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.269706:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d451a00/0xa7c849b16e0188f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddeb expref: 8 pid: 4760 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.269715:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d451a00/0xa7c849b16e0188f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddeb expref: 8 pid: 4760 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.269734:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.269735:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.269741:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.269752:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.269779:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.269789:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747379456:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144652.269834:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.270079:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5521 00000100:00100000:0.0:1746144652.271583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.271626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.271719:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747379456:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144652.271730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144652.271736:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.272192:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746395904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3425us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.272201:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5519 00000100:00100000:1.0:1746144652.272537:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746396544 00000100:00100000:1.0:1746144652.272542:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746396544 00002000:00100000:1.0:1746144652.272568:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4001792->4005887) req@ffff88009f1ff480 x1830964746396544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.272576:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ff480 with x1830964746396544 ext(4001792->4005887) 00010000:00010000:1.0:1746144652.272582:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.272592:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 731 lvb_type: 0 00002000:00010000:1.0:1746144652.272601:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f1ff480 00000100:00100000:1.0:1746144652.272614:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 790 00000100:00100000:1.0:1746144652.272620:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746396544:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144652.272746:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746396544:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 126us (1017us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144652.272752:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 790 00002000:00100000:1.0:1746144652.272756:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4001792->4005887) req@ffff88009f1ff480 x1830964746396544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/4536 e 0 to 0 dl 1746144663 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.272763:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ff480 with x1830964746396544 ext(4001792->4005887) 00010000:00010000:1.0:1746144652.272767:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.272774:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 27 pid: 8388 timeout: 731 lvb_type: 0 00002000:00010000:1.0:1746144652.272779:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f1ff480 00000100:00100000:1.0:1746144652.272788:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4144 00000100:00100000:1.0:1746144652.272793:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746396288:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144652.273663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.274285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.279397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.282619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.287573:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746396288:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14767us (15934us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.287586:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4144 00002000:00100000:1.0:1746144652.287599:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f1ff100 x1830964746396288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.287614:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ff100 with x1830964746396288 ext(1048576->2097151) 00002000:00010000:1.0:1746144652.287621:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1ff100 00000100:00100000:0.0:1746144652.288972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.293085:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.293764:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747379712:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144652.293794:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e018a35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3624959] (req 3145728->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de9a expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.293817:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1253e00, rc 0) 00000100:00100000:0.0:1746144652.293856:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:28809:x1830964746397696:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4139us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.293864:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11159 00000100:00100000:1.0:1746144652.294538:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746397312:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14980us (15149us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.294546:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4147 00002000:00100000:1.0:1746144652.294555:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f1fc700 x1830964746397312/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.294564:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1fc700 with x1830964746397312 ext(1048576->2097151) 00002000:00010000:1.0:1746144652.294570:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f1fc700 00000100:00100000:0.0:1746144652.294589:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746397056:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 19041us (20303us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144652.294595:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4146 00002000:00100000:0.0:1746144652.294601:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f1ffb80 x1830964746397056/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144652.294608:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f1ffb80 with x1830964746397056 ext(1048576->2097151) 00002000:00010000:0.0:1746144652.294612:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f1ffb80 00000100:00100000:1.0:1746144652.300555:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746397952 00000100:00100000:1.0:1746144652.300565:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746397952 00000100:00100000:0.0:1746144652.300621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.300739:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11160 00000100:00100000:1.0:1746144652.300747:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+12:28810:x1830964746397952:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.300765:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.300783:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e018a3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dea1 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.300808:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144652.300810:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144652.300812:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e018a3c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea1 expref: 13 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.300821:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e018a3c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea1 expref: 13 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.300832:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044a00, rc 0) 00000100:00100000:1.0:1746144652.301001:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:28810:x1830964746397952:12345-192.168.204.23@tcp:101:cat.0 Request processed in 253us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.301007:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11160 00000100:00100000:1.0:1746144652.301029:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746398080 00000100:00100000:1.0:1746144652.301032:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746398080 00010000:00010000:1.0:1746144652.301047:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 29 pid: 8388 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.301063:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5522 00000100:00100000:1.0:1746144652.301067:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746398080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.301074:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144652.301130:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144651 -> 1746144653 00002000:00010000:1.0:1746144652.301157:0:16008:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144651 -> 1746144653 00010000:00010000:1.0:1746144652.301164:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 29 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.301175:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 29 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.301194:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f540a00/0xa7c849b16e018a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4001792->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de8c expref: 29 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.301218:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.301219:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.301226:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4587a00/0xa7c849b16e018a2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4472831) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de93 expref: 12 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.301234:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4587a00/0xa7c849b16e018a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4472831) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de93 expref: 12 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.301250:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.301251:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.301255:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e018a3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea1 expref: 12 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.301261:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e018a3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea1 expref: 12 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.301291:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e018a3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea1 expref: 12 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.301303:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747379840:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144652.301361:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4587a00/0xa7c849b16e018a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4472831) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de93 expref: 12 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.301368:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747379968:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144652.301383:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.301558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.301609:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746398336 00000100:00100000:1.0:1746144652.301612:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746398336 00000100:00100000:0.0:1746144652.301626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.301668:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746398208 00000100:00100000:1.0:1746144652.301671:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746398208 00000100:00100000:1.0:1746144652.301682:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11161 00000100:00100000:1.0:1746144652.301753:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1962:x1830964746398336:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.301763:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.301772:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5045800/0xa7c849b16e018a43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152deaf expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.301799:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747380096:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144652.301833:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800998526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144652.301852:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11162 00000100:00100000:1.0:1746144652.301856:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746398208:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.301861:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.301866:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e018a4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dea8 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.301980:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747380224:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144652.302035:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144652.304922:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747379840:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144652.305507:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747379968:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144652.305530:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.305715:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746398080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4645us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.305726:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5522 00000100:00100000:0.0:1746144652.306032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.306910:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746398464 00000100:00100000:1.0:1746144652.306917:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746398464 00000100:00100000:1.0:1746144652.306952:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 612 00000100:00100000:1.0:1746144652.306959:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746398464:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.306970:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144652.306972:0:16008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a7c849b16e018a20) 00010000:00010000:1.0:1746144652.306973:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.306991:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746398464:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 32us (966us total) trans 0 rc 116/116 00000100:00100000:1.0:1746144652.306996:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 612 00002000:00010000:1.0:1746144652.307027:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144651 -> 1746144653 00000100:00100000:1.0:1746144652.307040:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747380224:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144652.307058:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e018a4a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea8 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144652.307067:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e018a4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dea8 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144652.307080:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5045200, rc 0) 00000100:00100000:1.0:1746144652.307099:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746398208:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5242us (5472us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144652.307105:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11162 00000100:00100000:0.0:1746144652.310837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.312222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.312314:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746398720 00000100:00100000:1.0:1746144652.312319:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746398720 00002000:00100000:1.0:1746144652.312342:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4468736->4472831) req@ffff8800a4dd4380 x1830964746398720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.312350:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4380 with x1830964746398720 ext(4468736->4472831) 00002000:00010000:1.0:1746144652.312353:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd4380 00000100:00100000:1.0:1746144652.312367:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4149 00000100:00100000:1.0:1746144652.312372:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746398720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144652.312542:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746398720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 168us (320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144652.312548:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4149 00002000:00100000:1.0:1746144652.312554:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4468736->4472831) req@ffff8800a4dd4380 x1830964746398720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/4536 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.312559:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4380 with x1830964746398720 ext(4468736->4472831) 00002000:00010000:1.0:1746144652.312562:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd4380 00000100:00100000:0.0:1746144652.315219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.315360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.319760:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746399616 00000100:00100000:0.0:1746144652.319772:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746399616 00000100:00100000:0.0:1746144652.319835:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11163 00000100:00100000:0.0:1746144652.319843:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:28811:x1830964746399616:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.319860:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.319881:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993d000/0xa7c849b16e018a51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152deb6 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.319908:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.319910:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.319918:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993d000/0xa7c849b16e018a51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152deb6 expref: 29 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.319933:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993d000/0xa7c849b16e018a51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152deb6 expref: 29 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.319942:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993d000, rc 0) 00000100:00100000:0.0:1746144652.320002:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:28811:x1830964746399616:12345-192.168.204.23@tcp:101:cat.0 Request processed in 159us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.320007:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11163 00000100:00100000:0.0:1746144652.327464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.328094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.329948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.330831:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746400256 00000100:00100000:1.0:1746144652.330838:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746400256 00000100:00100000:1.0:1746144652.331773:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11164 00000100:00100000:1.0:1746144652.331781:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+10:28810:x1830964746400256:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.331794:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.331809:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152debd expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.331834:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e018a35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de9a expref: 17 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.331841:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144652.331842:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144652.331845:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152debd expref: 11 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.331867:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e018a35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de9a expref: 17 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.331881:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e018a35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de9a expref: 17 pid: 8388 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.331891:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747380480:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144652.332131:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144652.338374:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747380480:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144652.338400:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152debd expref: 11 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.338414:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044800, rc 0) 00000100:00100000:1.0:1746144652.338477:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+11:28810:x1830964746400256:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6696us (8530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.338487:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11164 00000100:00100000:0.0:1746144652.339747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.346852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.355513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.364003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.369542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.369577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.369609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.369632:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746401280 00000100:00100000:1.0:1746144652.369661:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746401408 00000100:00100000:1.0:1746144652.369672:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746401408 00000100:00100000:0.0:1746144652.369718:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746401280 00002000:00100000:1.0:1746144652.369722:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f5e2a00 x1830964746401408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.369732:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e2a00 with x1830964746401408 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.369737:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f5e2a00 00000100:00100000:1.0:1746144652.369761:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746401664 00000100:00100000:1.0:1746144652.369763:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746401664 00002000:00100000:1.0:1746144652.369776:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f5e2d80 x1830964746401664/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.369783:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e2d80 with x1830964746401664 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.369787:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f5e2d80 00002000:00100000:0.0:1746144652.370060:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f5e2680 x1830964746401280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144652.370074:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e2680 with x1830964746401280 ext(2097152->3145727) 00002000:00010000:0.0:1746144652.370078:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f5e2680 00000100:00100000:1.0:1746144652.370254:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4154 00000100:00100000:1.0:1746144652.370262:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746401408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144652.383614:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746401408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13345us (14027us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.383625:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4154 00002000:00100000:1.0:1746144652.383634:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f5e2a00 x1830964746401408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.383641:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e2a00 with x1830964746401408 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.383646:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f5e2a00 00000100:00100000:0.0:1746144652.385961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.388752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.391910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.394466:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746401920:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5511us (5716us total) trans 17179873124 rc 0/0 00000100:00100000:0.0:1746144652.394477:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 794 00002000:00100000:0.0:1746144652.394488:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4472831) req@ffff88009f5e3480 x1830964746401920/t17179873124(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/448 e 0 to 0 dl 1746144663 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144652.394498:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e3480 with x1830964746401920 ext(4194304->4472831) 00010000:00010000:0.0:1746144652.394506:0:21334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4587a00/0xa7c849b16e018a2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->4472831) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de93 expref: 17 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.394519:0:21334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4587a00/0xa7c849b16e018a2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->4472831) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de93 expref: 17 pid: 8388 timeout: 731 lvb_type: 0 00002000:00010000:0.0:1746144652.394526:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f5e3480 00000100:00100000:0.0:1746144652.397570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.398635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.403389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.403602:0:21334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746402560 00000100:00100000:0.0:1746144652.403609:0:21334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746402560 00002000:00100000:0.0:1746144652.403648:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88013695b100 x1830964746402560/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144652.403664:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b100 with x1830964746402560 ext(4194304->4935679) 00002000:00010000:0.0:1746144652.403669:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695b100 00000100:00100000:0.0:1746144652.403685:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4157 00000100:00100000:0.0:1746144652.403691:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746402560:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144652.428303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.431259:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746403328 00000100:00100000:1.0:1746144652.431282:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746403328 00000100:00100000:1.0:1746144652.431353:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3974 00000100:00100000:1.0:1746144652.431361:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28810:x1830964746403328:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144652.431606:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:28810:x1830964746403328:12345-192.168.204.23@tcp:35:cat.0 Request processed in 245us (3313us total) trans 8589943792 rc 0/0 00000100:00100000:1.0:1746144652.431613:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3974 00000100:00100000:0.0:1746144652.433637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.441713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.444097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.444160:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746403968 00000100:00100000:1.0:1746144652.444167:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746403968 00000100:00100000:0.0:1746144652.448233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.451726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.452691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.452735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.452777:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746404480 00000100:00100000:1.0:1746144652.452781:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746404480 00000100:00100000:1.0:1746144652.452813:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11169 00000100:00100000:1.0:1746144652.452819:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746404480:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144652.452828:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.452841:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e018aba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152deee expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.452859:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.452861:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.452869:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e018aba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152deee expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144652.452880:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e018aba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152deee expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144652.452889:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044400, rc 0) 00000100:00100000:1.0:1746144652.452993:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746404480:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 173us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.452999:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11169 00000100:00100000:0.0:1746144652.457917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.465428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.465469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.465543:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746405120 00000100:00100000:1.0:1746144652.465546:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746405120 00010000:00010000:1.0:1746144652.465570:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e800/0xa7c849b16e018a90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dee0 expref: 9 pid: 14710 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.465600:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5526 00000100:00100000:1.0:1746144652.465606:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746405120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.465622:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144652.465627:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e800/0xa7c849b16e018a90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dee0 expref: 9 pid: 14710 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.465636:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e800/0xa7c849b16e018a90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dee0 expref: 9 pid: 14710 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.465694:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e800/0xa7c849b16e018a90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dee0 expref: 9 pid: 14710 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.465761:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144652.465764:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.465801:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746405120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 194us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.466088:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5526 00000100:00100000:0.0:1746144652.468929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.472926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.473023:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746405376 00000100:00100000:1.0:1746144652.473032:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746405376 00010000:00010000:1.0:1746144652.473073:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed33800/0xa7c849b16e018acf lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152defc expref: 10 pid: 14710 timeout: 731 lvb_type: 0 00000100:00100000:1.0:1746144652.473294:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5528 00000100:00100000:1.0:1746144652.473302:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746405376:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.473316:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144652.473321:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed33800/0xa7c849b16e018acf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152defc expref: 10 pid: 14710 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.473332:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed33800/0xa7c849b16e018acf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152defc expref: 10 pid: 14710 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.473354:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed33800/0xa7c849b16e018acf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152defc expref: 10 pid: 14710 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.473794:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144652.473800:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4de200/0xa7c849b16e018ae4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144652.473809:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4de200/0xa7c849b16e018ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144652.473817:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4de200/0xa7c849b16e018ae4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144652.473842:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.473988:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746405376:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 686us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.473994:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5528 00000100:00100000:0.0:1746144652.480790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.488178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.517576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.527801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.527866:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746406144 00000100:00100000:1.0:1746144652.527873:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746406144 00010000:00010000:1.0:1746144652.527910:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e018994 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de0e expref: 32 pid: 8388 timeout: 731 lvb_type: 1 00000100:00100000:1.0:1746144652.528509:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5529 00000100:00100000:1.0:1746144652.528519:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746406144:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144652.528536:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144652.528562:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e018994 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de0e expref: 32 pid: 8388 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.528572:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e018994 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de0e expref: 32 pid: 8388 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.528593:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e018994 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de0e expref: 32 pid: 8388 timeout: 731 lvb_type: 1 00010000:00010000:1.0:1746144652.528618:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144652.528690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.528704:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746406272 00000100:00100000:0.0:1746144652.528706:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746406272 00010000:00010000:0.0:1746144652.528722:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de23 expref: 15 pid: 8389 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1746144652.528740:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5530 00000100:00100000:0.0:1746144652.528745:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746406272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.528752:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.528759:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de23 expref: 15 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.528766:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de23 expref: 15 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.528777:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e0189a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de23 expref: 15 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.528788:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144652.528802:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746406272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.528807:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5530 00000100:00100000:0.0:1746144652.528817:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746406400 00000100:00100000:0.0:1746144652.528819:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746406400 00010000:00010000:0.0:1746144652.528828:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb78a00/0xa7c849b16e0188d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddcf expref: 8 pid: 8453 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1746144652.528846:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5531 00000100:00100000:0.0:1746144652.528851:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746406400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.528857:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.528864:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bb78a00/0xa7c849b16e0188d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddcf expref: 8 pid: 8453 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.528872:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bb78a00/0xa7c849b16e0188d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddcf expref: 8 pid: 8453 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.528881:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb78a00/0xa7c849b16e0188d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ddcf expref: 8 pid: 8453 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.528889:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.528890:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.528897:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e018af9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df11 expref: 30 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.528905:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e018af9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df11 expref: 30 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.528934:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed33a00/0xa7c849b16e018af9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df11 expref: 30 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.528945:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747382272:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144652.529002:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144652.529394:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746406144:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 875us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.529403:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5529 00000100:00100000:0.0:1746144652.531891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.533787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.540464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.541431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.541492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.541759:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5534 00000100:00100000:0.0:1746144652.541769:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746407040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.541776:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.541786:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f176200/0xa7c849b16e0189a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de2a expref: 11 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.541797:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f176200/0xa7c849b16e0189a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de2a expref: 11 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.541810:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f176200/0xa7c849b16e0189a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de2a expref: 11 pid: 8389 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.541823:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.541825:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.541832:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.541840:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.541878:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.541890:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747382784:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144652.543186:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144652.543330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.544561:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747382784:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144652.544579:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144652.544603:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746407040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2837us (3110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.544612:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5534 00000100:00100000:0.0:1746144652.555682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.560220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.582207:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746408064 00000100:00100000:0.0:1746144652.582218:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746408064 00000100:00100000:0.0:1746144652.582280:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11173 00000100:00100000:0.0:1746144652.582288:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:28821:x1830964746408064:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144652.582306:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.582327:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb79c00/0xa7c849b16e018b2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152df26 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.582360:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3ad200/0xa7c849b16e018a66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152decb expref: 29 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.582369:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e018aba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152deee expref: 6 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.582375:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b061800/0xa7c849b16e018a74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ded9 expref: 15 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.582382:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.582384:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.582387:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb79c00/0xa7c849b16e018b2a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df26 expref: 15 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.583079:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b061800/0xa7c849b16e018a74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ded9 expref: 15 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.583093:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b061800/0xa7c849b16e018a74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ded9 expref: 15 pid: 8388 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746144652.583106:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747382912:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144652.583781:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e018aba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152deee expref: 6 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.583792:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e018aba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152deee expref: 6 pid: 10724 timeout: 731 lvb_type: 1 00000100:00100000:0.0:1746144652.583801:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747383040:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144652.584527:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3ad200/0xa7c849b16e018a66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152decb expref: 29 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.584537:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3ad200/0xa7c849b16e018a66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152decb expref: 29 pid: 8388 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746144652.584546:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747383168:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144652.584566:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.592498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.592538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.592634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.600892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.602310:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746408704 00000100:00100000:1.0:1746144652.602319:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746408704 00002000:00100000:1.0:1746144652.602363:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3809280->3813375) req@ffff88009b32dc00 x1830964746408704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.602372:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32dc00 with x1830964746408704 ext(3809280->3813375) 00002000:00010000:1.0:1746144652.602377:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32dc00 00000100:00100000:1.0:1746144652.602410:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4163 00000100:00100000:1.0:1746144652.602418:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746408704:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144652.602612:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746408704:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 194us (1731us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144652.602619:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4163 00002000:00100000:1.0:1746144652.602624:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3809280->3813375) req@ffff88009b32dc00 x1830964746408704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/4536 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.602631:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32dc00 with x1830964746408704 ext(3809280->3813375) 00002000:00010000:1.0:1746144652.602633:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32dc00 00000100:00100000:0.0:1746144652.608718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.614503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.615986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.616615:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5539 00000100:00100000:0.0:1746144652.616624:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746409088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.616633:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.616646:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4dea00/0xa7c849b16e018ac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152def5 expref: 7 pid: 8388 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.616665:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4dea00/0xa7c849b16e018ac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152def5 expref: 7 pid: 8388 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.617192:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4dea00/0xa7c849b16e018ac1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152def5 expref: 7 pid: 8388 timeout: 731 lvb_type: 1 00010000:00010000:0.0:1746144652.617216:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144652.617234:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746409088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 612us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144652.617249:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5539 00000100:00100000:0.0:1746144652.617293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.617306:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746409216 00000100:00100000:0.0:1746144652.617309:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746409216 00010000:00010000:0.0:1746144652.617322:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152debd expref: 11 pid: 8388 timeout: 731 lvb_type: 0 00000100:00100000:0.0:1746144652.617347:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5540 00000100:00100000:0.0:1746144652.617353:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746409216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.617360:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.617367:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152debd expref: 11 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.617376:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152debd expref: 11 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.617393:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5044800/0xa7c849b16e018a58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152debd expref: 11 pid: 8388 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.617402:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.617404:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.618715:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4dfc00/0xa7c849b16e018b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df2d expref: 10 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.618735:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4dfc00/0xa7c849b16e018b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df2d expref: 10 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.618774:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4dfc00/0xa7c849b16e018b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df2d expref: 10 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.618786:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747383808:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144652.619065:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.622426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.622543:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746409472 00000100:00100000:1.0:1746144652.622552:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746409472 00002000:00100000:1.0:1746144652.623123:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3235840->3239935) req@ffff88009f16aa00 x1830964746409472/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.623152:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16aa00 with x1830964746409472 ext(3235840->3239935) 00002000:00010000:1.0:1746144652.623157:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16aa00 00000100:00100000:1.0:1746144652.623187:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4164 00000100:00100000:1.0:1746144652.623195:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746409472:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144652.623371:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746409472:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 176us (954us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144652.623377:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4164 00002000:00100000:1.0:1746144652.623382:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3235840->3239935) req@ffff88009f16aa00 x1830964746409472/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/4536 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.623389:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16aa00 with x1830964746409472 ext(3235840->3239935) 00002000:00010000:1.0:1746144652.623392:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16aa00 00000100:00100000:0.0:1746144652.627650:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746409728 00000100:00100000:0.0:1746144652.627659:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746409728 00000100:00100000:0.0:1746144652.627747:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3978 00000100:00100000:0.0:1746144652.627756:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+11:28821:x1830964746409728:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:0.0:1746144652.628310:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+12:28821:x1830964746409728:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 553us (900us total) trans 8589943799 rc 0/0 00000100:00100000:0.0:1746144652.628318:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3978 00000100:00100000:0.0:1746144652.662005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.664622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.664725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.664820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.664859:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746410112 00000100:00100000:0.0:1746144652.664867:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746410112 00000100:00100000:0.0:1746144652.664922:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746410240 00000100:00100000:0.0:1746144652.664924:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746410240 00000100:00100000:0.0:1746144652.664938:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746410368 00000100:00100000:0.0:1746144652.664939:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746410368 00000100:00100000:0.0:1746144652.664951:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11175 00000100:00100000:0.0:1746144652.664958:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746410112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.664976:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.664991:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb78800/0xa7c849b16e018b4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152df3b expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.665044:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747383936:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144652.665683:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.667503:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747384192:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144652.667531:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4dee00/0xa7c849b16e018b5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df49 expref: 17 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.667542:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4dee00/0xa7c849b16e018b5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df49 expref: 17 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.668284:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dee00, rc 0) 00000100:00100000:0.0:1746144652.668308:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746410368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3219us (3489us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144652.668316:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11177 00000100:00100000:0.0:1746144652.673773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.678842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.682432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.684906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144652.687541:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144652.687763:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746411264 00000100:00100000:0.0:1746144652.687769:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746411264 00000100:00100000:0.0:1746144652.687808:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3979 00000100:00100000:0.0:1746144652.687813:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28831:x1830964746411264:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144652.687995:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28831:x1830964746411264:12345-192.168.204.23@tcp:35:cat.0 Request processed in 181us (396us total) trans 8589943802 rc 0/0 00000100:00100000:0.0:1746144652.688001:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3979 00000100:00100000:0.0:1746144652.690297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.690446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.690624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.690771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.690817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.690934:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11180 00000100:00100000:1.0:1746144652.690942:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746412032:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.690949:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.690958:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044c00/0xa7c849b16e018b9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152df6c expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144652.691003:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747384576:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144652.691068:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.691079:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11181 00000100:00100000:0.0:1746144652.691087:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746412160:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144652.691094:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144652.691103:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb78a00/0xa7c849b16e018ba1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152df73 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.691127:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747384704:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144652.691174:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.697119:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747384576:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144652.697179:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044c00/0xa7c849b16e018b9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df6c expref: 32 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.697195:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044c00/0xa7c849b16e018b9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df6c expref: 32 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144652.697206:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044c00, rc 0) 00000100:00100000:0.0:1746144652.698669:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746412032:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7727us (7896us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144652.698675:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11180 00000100:00100000:0.0:1746144652.708822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.709370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.710432:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4166 00000100:00100000:1.0:1746144652.710444:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746412800:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144652.720352:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746412800:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9900us (11531us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.720363:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4166 00002000:00100000:1.0:1746144652.720374:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012d0c4380 x1830964746412800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.720384:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4380 with x1830964746412800 ext(0->1048575) 00002000:00010000:1.0:1746144652.720390:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4380 00000100:00100000:0.0:1746144652.721491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.727736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.732070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.735081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.735171:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746413568 00000100:00100000:1.0:1746144652.735180:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746413568 00002000:00100000:1.0:1746144652.735226:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1658879) req@ffff88012d0c6680 x1830964746413568/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.735247:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6680 with x1830964746413568 ext(1048576->1658879) 00010000:00010000:1.0:1746144652.735256:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 17 pid: 8451 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.735268:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 17 pid: 8451 timeout: 731 lvb_type: 0 00002000:00010000:1.0:1746144652.735275:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d0c6680 00000100:00100000:1.0:1746144652.735299:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 797 00000100:00100000:1.0:1746144652.735306:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746413568:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144652.746408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.746440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.752887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.753746:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746413568:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 18439us (18672us total) trans 21474840374 rc 0/0 00000100:00100000:1.0:1746144652.753755:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 797 00002000:00100000:1.0:1746144652.753762:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1658879) req@ffff88012d0c6680 x1830964746413568/t21474840374(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/448 e 0 to 0 dl 1746144663 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.753769:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6680 with x1830964746413568 ext(1048576->1658879) 00010000:00010000:1.0:1746144652.753776:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 19 pid: 8451 timeout: 731 lvb_type: 0 00010000:00010000:1.0:1746144652.753790:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed33400/0xa7c849b16e018b00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df18 expref: 19 pid: 8451 timeout: 731 lvb_type: 0 00002000:00010000:1.0:1746144652.753796:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d0c6680 00000100:00100000:0.0:1746144652.757461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.760316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.760801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.761317:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746414848 00000100:00100000:1.0:1746144652.761322:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746414848 00002000:00100000:1.0:1746144652.761353:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4100096->4104191) req@ffff88013644a680 x1830964746414848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.761362:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644a680 with x1830964746414848 ext(4100096->4104191) 00002000:00010000:1.0:1746144652.761366:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644a680 00000100:00100000:1.0:1746144652.761379:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4169 00000100:00100000:1.0:1746144652.761384:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746414848:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144652.761523:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746414848:12345-192.168.204.23@tcp:3:cat.0 Request processed in 138us (722us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144652.761529:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4169 00002000:00100000:1.0:1746144652.761533:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4100096->4104191) req@ffff88013644a680 x1830964746414848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/4536 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.761539:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644a680 with x1830964746414848 ext(4100096->4104191) 00002000:00010000:1.0:1746144652.761541:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644a680 00000100:00100000:0.0:1746144652.773015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.773063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.791703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.792119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.792316:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5547 00000100:00100000:0.0:1746144652.792324:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746415360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144652.792333:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144652.792358:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f4dfc00/0xa7c849b16e018b31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df2d expref: 14 pid: 8451 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.792369:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4dfc00/0xa7c849b16e018b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df2d expref: 14 pid: 8451 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.792387:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4dfc00/0xa7c849b16e018b31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df2d expref: 14 pid: 8451 timeout: 731 lvb_type: 0 00010000:00010000:0.0:1746144652.792411:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.792413:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.792419:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff1800/0xa7c849b16e018bd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df9d expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.792427:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff1800/0xa7c849b16e018bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df9d expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.792434:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.792435:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144652.792437:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e018be0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfa4 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.792443:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e018be0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfa4 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144652.792472:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e018be0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfa4 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.792650:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747386240:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144652.792902:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff1800/0xa7c849b16e018bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df9d expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144652.792911:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747386368:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144652.792934:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144652.796659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.797196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.797217:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746416000 00000100:00100000:1.0:1746144652.797225:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746416000 00002000:00100000:1.0:1746144652.797256:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013644bb80 x1830964746416000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.797263:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644bb80 with x1830964746416000 ext(2097152->3145727) 00002000:00010000:1.0:1746144652.797267:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644bb80 00000100:00100000:1.0:1746144652.797280:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4172 00000100:00100000:1.0:1746144652.797286:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746416000:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144652.806439:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746416000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9139us (9229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.806453:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4172 00002000:00100000:1.0:1746144652.806467:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013644bb80 x1830964746416000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.806477:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644bb80 with x1830964746416000 ext(2097152->3145727) 00002000:00010000:1.0:1746144652.806484:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644bb80 00000100:00100000:0.0:1746144652.813668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.813728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.813937:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746416256 00000100:00100000:1.0:1746144652.813944:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746416256 00000100:00100000:1.0:1746144652.814046:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11189 00000100:00100000:1.0:1746144652.814054:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:28826:x1830964746416256:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.814074:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.814091:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133c66200/0xa7c849b16e018be7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dfb2 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.814118:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d797600/0xa7c849b16e018bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3743744->18446744073709551615] (req 3743744->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df7a expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.814130:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144652.814132:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144652.814159:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133c66200/0xa7c849b16e018be7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfb2 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.814264:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d797600/0xa7c849b16e018bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3743744->18446744073709551615] (req 3743744->4104191) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df7a expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.814277:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d797600/0xa7c849b16e018bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3743744->18446744073709551615] (req 3743744->4104191) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df7a expref: 33 pid: 7257 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144652.814290:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747386496:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144652.814581:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144652.815986:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747386496:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144652.816007:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133c66200/0xa7c849b16e018be7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfb2 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.816019:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133c66200, rc 0) 00000100:00100000:1.0:1746144652.816045:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:28826:x1830964746416256:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1992us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.816051:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11189 00000100:00100000:0.0:1746144652.816976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.817309:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 799 00000100:00100000:1.0:1746144652.817322:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746416384:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144652.821857:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746416384:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4524us (4872us total) trans 17179873127 rc 0/0 00000100:00100000:1.0:1746144652.821869:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 799 00002000:00100000:1.0:1746144652.821881:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3743744->4104191) req@ffff88008f33e680 x1830964746416384/t17179873127(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/448 e 0 to 0 dl 1746144663 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.821891:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33e680 with x1830964746416384 ext(3743744->4104191) 00010000:00010000:1.0:1746144652.821900:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d797600/0xa7c849b16e018bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3743744->18446744073709551615] (req 3743744->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df7a expref: 35 pid: 7257 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144652.821916:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d797600/0xa7c849b16e018bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3743744->18446744073709551615] (req 3743744->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df7a expref: 35 pid: 7257 timeout: 732 lvb_type: 0 00002000:00010000:1.0:1746144652.821924:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f33e680 00000100:00100000:0.0:1746144652.825252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.835761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.835825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.835855:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746416768 00000100:00100000:1.0:1746144652.835865:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746416768 00002000:00100000:1.0:1746144652.835915:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008f33ca80 x1830964746416768/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.835925:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33ca80 with x1830964746416768 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.835931:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f33ca80 00000100:00100000:1.0:1746144652.835962:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746417024 00000100:00100000:1.0:1746144652.835965:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746417024 00002000:00100000:1.0:1746144652.835978:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008f33f800 x1830964746417024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.835984:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33f800 with x1830964746417024 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.835988:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f33f800 00000100:00100000:1.0:1746144652.835999:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4174 00000100:00100000:1.0:1746144652.836004:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746417024:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144652.837810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.843159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.844368:0:21334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746417536 00000100:00100000:1.0:1746144652.844381:0:21334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746417536 00002000:00100000:1.0:1746144652.844428:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008f33df80 x1830964746417536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.844439:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33df80 with x1830964746417536 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.844444:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f33df80 00000100:00100000:1.0:1746144652.844480:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4176 00000100:00100000:1.0:1746144652.844488:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746417536:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144652.856425:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746417024:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20416us (20595us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.856434:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4174 00002000:00100000:1.0:1746144652.856441:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008f33f800 x1830964746417024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.856448:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33f800 with x1830964746417024 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.856452:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f33f800 00000100:00100000:0.0:1746144652.856881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.859025:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746417536:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14534us (15890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144652.859034:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4176 00002000:00100000:1.0:1746144652.859042:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008f33df80 x1830964746417536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.859051:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33df80 with x1830964746417536 ext(3145728->4194303) 00002000:00010000:1.0:1746144652.859056:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f33df80 00000100:00100000:0.0:1746144652.865334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.865396:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746417920 00000100:00100000:1.0:1746144652.865407:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746417920 00000100:00100000:1.0:1746144652.865462:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11191 00000100:00100000:1.0:1746144652.865469:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746417920:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144652.865487:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144652.865506:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f323200/0xa7c849b16e018c18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dfc0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144652.865530:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.865532:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144652.865542:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323200/0xa7c849b16e018c18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc0 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144652.865557:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f323200/0xa7c849b16e018c18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc0 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144652.865569:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323200, rc 0) 00000100:00100000:1.0:1746144652.865619:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746417920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 150us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144652.865625:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11191 00000100:00100000:0.0:1746144652.870849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.871110:0:21334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746418176 00000100:00100000:1.0:1746144652.871121:0:21334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746418176 00002000:00100000:1.0:1746144652.871201:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880092936d80 x1830964746418176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/0 e 0 to 0 dl 1746144663 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.871211:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936d80 with x1830964746418176 ext(4194304->4935679) 00002000:00010000:1.0:1746144652.871217:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092936d80 00000100:00100000:1.0:1746144652.871254:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4177 00000100:00100000:1.0:1746144652.871261:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746418176:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144652.871529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144652.883165:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746418176:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11869us (12293us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144652.883176:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4177 00002000:00100000:1.0:1746144652.883186:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880092936d80 x1830964746418176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:293/0 lens 488/440 e 0 to 0 dl 1746144663 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144652.883193:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936d80 with x1830964746418176 ext(4194304->4935679) 00002000:00010000:1.0:1746144652.883198:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092936d80 00000100:00100000:0.0:1746144652.983877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144652.989677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.001600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.011467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.011547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.012171:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746419328 00000100:00100000:1.0:1746144653.012175:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746419328 00000100:00100000:1.0:1746144653.012213:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9953 00000100:00100000:1.0:1746144653.012379:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:28840:x1830964746419328:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144653.012396:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.012416:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dfce expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.012516:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012529:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012539:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012550:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012556:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012565:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012665:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012675:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012681:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144653.012690:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144653.012774:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012781:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012787:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012793:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f322600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.012797:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012804:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012814:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144653.012816:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.012820:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012829:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012859:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012864:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012869:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012873:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f323800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.012876:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012880:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012886:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090bc6a00) 00010000:00010000:1.0:1746144653.012888:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.012890:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012895:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.012931:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfce expref: 307 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.012942:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfce expref: 306 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.012953:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.012955:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144653.012957:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f322e00, rc 0) 00000100:00100000:1.0:1746144653.012983:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:28840:x1830964746419328:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 764us (1522us total) trans 8589943805 rc 0/0 00000100:00100000:1.0:1746144653.012988:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9953 00000100:00100000:0.0:1746144653.025762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.026578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.031023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.033439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.040737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.047275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.096936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.099833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.118863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.119017:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746420992 00000100:00100000:1.0:1746144653.119028:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746420992 00000100:00100000:1.0:1746144653.119098:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9954 00000100:00100000:1.0:1746144653.119107:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:28845:x1830964746420992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.119153:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.119173:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dfe3 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.119293:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119307:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119319:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119333:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119338:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119347:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119457:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119464:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119469:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144653.119477:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144653.119550:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119556:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119561:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119566:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f322600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.119569:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119575:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119583:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144653.119586:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.119589:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119597:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119623:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119627:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119632:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119635:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f323c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.119637:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119640:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119652:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090bc6d00) 00010000:00010000:1.0:1746144653.119653:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.119655:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119662:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.119701:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfe3 expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.119711:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfe3 expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.119721:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.119723:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144653.119725:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323e00, rc 0) 00000100:00100000:1.0:1746144653.119776:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:28845:x1830964746420992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 671us (925us total) trans 8589943808 rc 0/0 00000100:00100000:1.0:1746144653.119782:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9954 00000100:00100000:0.0:1746144653.126544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.126588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.126626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.126661:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746421376 00000100:00100000:0.0:1746144653.126671:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746421376 00010000:00010000:0.0:1746144653.126709:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013490c800/0xa7c849b16e018c1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc7 expref: 15 pid: 8451 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.126732:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746421504 00000100:00100000:0.0:1746144653.126733:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746421504 00000100:00100000:0.0:1746144653.126748:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5553 00000100:00100000:0.0:1746144653.126754:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746421376:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144653.126769:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144653.126791:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013490c800/0xa7c849b16e018c1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc7 expref: 15 pid: 8451 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.126808:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013490c800/0xa7c849b16e018c1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc7 expref: 15 pid: 8451 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.126829:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013490c800/0xa7c849b16e018c1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc7 expref: 15 pid: 8451 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.126858:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.126859:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.126867:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f349e00/0xa7c849b16e018c50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4087807) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfdc expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.126874:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f349e00/0xa7c849b16e018c50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4087807) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfdc expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.126903:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f349e00/0xa7c849b16e018c50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfdc expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.126914:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f271f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747387776:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144653.126938:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 613 00000100:00100000:1.0:1746144653.126946:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1961:x1830964746421504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.126954:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.126968:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e018c6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfe3 expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.126981:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.126985:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.127006:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:1961:x1830964746421504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 62us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.127010:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.127013:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 613 00000100:00100000:1.0:1746144653.129831:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f271f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747387776:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144653.129853:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.129880:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746421376:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3126us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.129888:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5553 00000100:00100000:0.0:1746144653.130812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.133698:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746422144 00000100:00100000:1.0:1746144653.133707:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746422144 00000100:00100000:1.0:1746144653.133760:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9955 00000100:00100000:1.0:1746144653.133767:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:28848:x1830964746422144:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.133793:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.133811:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322a00/0xa7c849b16e018c7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dff1 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.133925:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.133937:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.133947:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.133958:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.133963:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.133968:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134068:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134076:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134082:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144653.134090:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144653.134208:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134214:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134220:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134225:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f323800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.134239:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134245:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134255:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144653.134258:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.134262:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134266:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323800/0xa7c849b16e018c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134283:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134288:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134292:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134296:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f323c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.134298:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134303:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134308:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090bc6e00) 00010000:00010000:1.0:1746144653.134309:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.134311:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134316:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323c00/0xa7c849b16e018c88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144653.134350:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322a00/0xa7c849b16e018c7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dff1 expref: 19 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.134360:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dff1 expref: 18 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.134366:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.134367:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144653.134370:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f322600, rc 0) 00000100:00100000:1.0:1746144653.134409:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:28848:x1830964746422144:12345-192.168.204.23@tcp:101:cat.0 Request processed in 643us (762us total) trans 8589943810 rc 0/0 00000100:00100000:1.0:1746144653.134416:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9955 00000100:00100000:0.0:1746144653.139296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.140835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.141733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.141815:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746422784 00000100:00100000:1.0:1746144653.141819:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746422784 00000100:00100000:1.0:1746144653.141860:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 614 00000100:00100000:1.0:1746144653.141866:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746422784:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.141876:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.141900:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322600/0xa7c849b16e018c8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dff1 expref: 19 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.141914:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.141918:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.141935:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746422784:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.141941:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 614 00000100:00100000:0.0:1746144653.151203:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746423168 00000100:00100000:0.0:1746144653.151207:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746423168 00000100:00100000:0.0:1746144653.151249:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746423296 00000100:00100000:0.0:1746144653.151252:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746423296 00000100:00100000:0.0:1746144653.151272:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11196 00000100:00100000:0.0:1746144653.151279:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746423168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144653.151292:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144653.151303:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11197 00010000:00010000:0.0:1746144653.151310:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093999c00/0xa7c849b16e018ca4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dff8 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.151312:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746423296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.151320:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.151330:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f323400/0xa7c849b16e018cab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152dfff expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.151361:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747388160:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144653.151362:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f271180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747388032:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144653.151431:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.151475:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.156373:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f271180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747388032:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144653.156413:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093999c00/0xa7c849b16e018ca4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dff8 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.156430:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093999c00/0xa7c849b16e018ca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dff8 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.156456:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093999c00, rc 0) 00000100:00100000:1.0:1746144653.156944:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746423168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5224us (5320us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144653.156956:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11196 00000100:00100000:0.0:1746144653.166608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.166708:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746423424 00000100:00100000:1.0:1746144653.166718:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746423424 00000100:00100000:1.0:1746144653.166817:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11198 00000100:00100000:1.0:1746144653.166827:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:28848:x1830964746423424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.166849:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.166871:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e018cb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e006 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.166904:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f349e00/0xa7c849b16e018c50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfdc expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.166912:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.166913:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.166917:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e018cb2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e006 expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.166948:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f349e00/0xa7c849b16e018c50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4087807) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfdc expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.166962:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f349e00/0xa7c849b16e018c50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->4087807) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfdc expref: 19 pid: 8451 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.166973:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747388288:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.167566:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.169462:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747388288:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.169499:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e018cb2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e006 expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.169517:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323800, rc 0) 00000100:00100000:1.0:1746144653.169562:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:28848:x1830964746423424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2736us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.169570:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11198 00000100:00100000:0.0:1746144653.170018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.171072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.171217:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746423680 00000100:00100000:1.0:1746144653.171221:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746423680 00000100:00100000:1.0:1746144653.171309:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11199 00000100:00100000:1.0:1746144653.171316:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:28845:x1830964746423680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.171326:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.171341:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f323e00/0xa7c849b16e018cb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e00d expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.171363:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.171368:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323e00/0xa7c849b16e018cb9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e00d expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.171378:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f323e00/0xa7c849b16e018cb9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e00d expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.171385:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323e00, rc 0) 00000100:00100000:1.0:1746144653.171633:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28845:x1830964746423680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 316us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.171639:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11199 00000100:00100000:0.0:1746144653.185799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.192039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.192087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.211478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.211555:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746424448 00000100:00100000:1.0:1746144653.211566:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746424448 00000100:00100000:1.0:1746144653.211633:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11200 00000100:00100000:1.0:1746144653.211642:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:28845:x1830964746424448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.211663:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.211683:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e018cc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e014 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.211712:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.211714:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.211722:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e018cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e014 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.211737:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e018cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e014 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.211748:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323400, rc 0) 00000100:00100000:1.0:1746144653.211807:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:28845:x1830964746424448:12345-192.168.204.23@tcp:101:cat.0 Request processed in 165us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.211813:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11200 00000100:00100000:0.0:1746144653.212416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.212480:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746424576 00000100:00100000:0.0:1746144653.212484:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746424576 00000100:00100000:0.0:1746144653.212930:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11201 00000100:00100000:0.0:1746144653.212937:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:28848:x1830964746424576:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144653.212947:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144653.212956:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d796e00/0xa7c849b16e018cc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e01b expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.212970:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.212971:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.212975:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d796e00/0xa7c849b16e018cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e01b expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.212987:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d796e00/0xa7c849b16e018cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e01b expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.212995:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d796e00, rc 0) 00000100:00100000:0.0:1746144653.213492:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:28848:x1830964746424576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 554us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.213499:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11201 00000100:00100000:0.0:1746144653.224963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.225013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.228976:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746425088:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12024us (12222us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144653.228988:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4187 00002000:00100000:0.0:1746144653.229001:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013695a680 x1830964746425088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.229010:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a680 with x1830964746425088 ext(3145728->4194303) 00002000:00010000:0.0:1746144653.229015:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695a680 00000100:00100000:0.0:1746144653.239187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.239209:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746425728 00000100:00100000:1.0:1746144653.239217:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746425728 00000100:00100000:1.0:1746144653.239262:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11202 00000100:00100000:1.0:1746144653.239270:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746425728:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.239286:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.239303:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b40e8c00/0xa7c849b16e018cce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e022 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.239356:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747388672:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144653.239412:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144653.245834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.245883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.247010:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747388672:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144653.247044:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b40e8c00/0xa7c849b16e018cce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e022 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.247058:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b40e8c00/0xa7c849b16e018cce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e022 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.247073:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b40e8c00, rc 0) 00000100:00100000:1.0:1746144653.247104:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746425728:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7834us (7917us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144653.247111:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11202 00000100:00100000:0.0:1746144653.250504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.259777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.260615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.273603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.273705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.275367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.275407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.277078:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9957 00000100:00100000:0.0:1746144653.277087:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:28852:x1830964746427264:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144653.277096:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144653.277103:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796400/0xa7c849b16e018d14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e04c expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.277152:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277158:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277164:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277172:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277176:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277181:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277232:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797a00/0xa7c849b16e018d29 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277239:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797a00/0xa7c849b16e018d29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.277245:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797a00/0xa7c849b16e018d29 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:0.0:1746144653.277250:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144653.279529:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279536:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279541:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279545:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d797000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.279548:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279553:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279564:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144653.279566:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.279568:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279573:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797000/0xa7c849b16e018d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279585:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279590:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279594:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279597:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d797e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.279599:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279604:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279609:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9e00) 00010000:00010000:1.0:1746144653.279610:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.279612:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279616:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797e00/0xa7c849b16e018d22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.279643:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d796400/0xa7c849b16e018d14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e04c expref: 312 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.279653:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797a00/0xa7c849b16e018d29 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e04c expref: 311 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.279659:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.279661:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144653.279663:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d797a00, rc 0) 00000100:00100000:1.0:1746144653.279687:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:28852:x1830964746427264:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2603us (4280us total) trans 8589943813 rc 0/0 00000100:00100000:1.0:1746144653.279693:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9957 00000100:00100000:0.0:1746144653.280048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.280813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.282602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.283413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.285500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.285548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.285575:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746428416 00000100:00100000:0.0:1746144653.285583:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746428416 00000100:00100000:0.0:1746144653.285632:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11207 00000100:00100000:0.0:1746144653.285640:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:28853:x1830964746428416:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144653.285658:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144653.285675:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d797800/0xa7c849b16e018d37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e053 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.285702:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e018cb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e006 expref: 16 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.285711:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f323e00/0xa7c849b16e018cb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e00d expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.285717:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.285719:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.285723:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d797800/0xa7c849b16e018d37 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3678208->3780607] (req 3678208->3780607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e053 expref: 16 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.285753:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f323e00/0xa7c849b16e018cb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e00d expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.285769:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f323e00/0xa7c849b16e018cb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e00d expref: 21 pid: 8453 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.285781:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389440:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144653.285842:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e018cb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e006 expref: 16 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.285850:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e018cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e006 expref: 16 pid: 8453 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.285858:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389568:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144653.285873:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.286114:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746428032 00000100:00100000:1.0:1746144653.286119:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746428032 00000100:00100000:1.0:1746144653.286163:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 616 00000100:00100000:1.0:1746144653.286169:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1961:x1830964746428032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.286184:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.286204:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d797a00/0xa7c849b16e018d29 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e04c expref: 311 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.286217:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.286236:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.286261:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1961:x1830964746428032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 92us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.286268:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 616 00000100:00100000:1.0:1746144653.296770:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389440:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.296784:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389568:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.296819:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d797800/0xa7c849b16e018d37 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3678208->3780607] (req 3678208->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e053 expref: 16 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.296837:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d797800, rc 0) 00000100:00100000:1.0:1746144653.296887:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:28853:x1830964746428416:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 11246us (11336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.296896:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11207 00000100:00100000:0.0:1746144653.300664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.304341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.304458:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746429056 00000100:00100000:1.0:1746144653.304466:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746429056 00000100:00100000:1.0:1746144653.304517:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11208 00000100:00100000:1.0:1746144653.304524:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746429056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.304540:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.304557:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c222400/0xa7c849b16e018d3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e05a expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.304610:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389824:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144653.307151:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144653.307593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:1.0:1746144653.309871:0:8453:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.309875:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.309877:0:8453:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144653 -> 1746144654 00000100:00100000:1.0:1746144653.309895:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389824:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144653.309926:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c222400/0xa7c849b16e018d3e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e05a expref: 22 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.309938:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c222400/0xa7c849b16e018d3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e05a expref: 22 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.310556:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c222400, rc 0) 00000100:00100000:1.0:1746144653.310598:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746429056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6073us (6264us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144653.310604:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11208 00000100:00100000:0.0:1746144653.310857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.311273:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746429440 00000100:00100000:1.0:1746144653.311278:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746429440 00000100:00100000:1.0:1746144653.311475:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11209 00000100:00100000:1.0:1746144653.311482:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:28852:x1830964746429440:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144653.311495:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.311508:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e061 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.311531:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d797800/0xa7c849b16e018d37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3780607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e053 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.311539:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.311540:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.311543:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3674112->3956735] (req 3674112->3956735) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.311567:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d797800/0xa7c849b16e018d37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3780607) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e053 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.311579:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d797800/0xa7c849b16e018d37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3780607) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e053 expref: 14 pid: 8453 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.311595:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747389952:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.311659:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144653.312522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.313232:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3985 00000100:00100000:1.0:1746144653.313241:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:28853:x1830964746429696:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144653.313714:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:28853:x1830964746429696:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 475us (1193us total) trans 8589943815 rc 0/0 00000100:00100000:1.0:1746144653.313722:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3985 00000100:00100000:0.0:1746144653.313820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.314870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.323294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.328756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.335475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.345773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.346065:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746430720 00000100:00100000:1.0:1746144653.346075:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746430720 00000100:00100000:1.0:1746144653.346190:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9958 00000100:00100000:1.0:1746144653.346200:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28858:x1830964746430720:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144653.346237:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.346257:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222400/0xa7c849b16e018d53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e06f expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.346323:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346337:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346348:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346361:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346367:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346373:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346478:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346488:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 310 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.346496:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.346527:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 310 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.346538:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 310 pid: 14710 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.346550:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747390464:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.346685:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.348355:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747390464:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.348379:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:0.0:1746144653.348744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.348908:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746430976 00000100:00100000:1.0:1746144653.348914:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746430976 00000100:00100000:1.0:1746144653.348964:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3986 00000100:00100000:1.0:1746144653.348972:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:12354:x1830964746430976:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144653.349266:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:12354:x1830964746430976:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 294us (523us total) trans 8589943816 rc 0/0 00000100:00100000:1.0:1746144653.349272:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3986 00000100:00100000:0.0:1746144653.351395:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3293:1830964747390592:0@lo:400:kworker.0 00000100:00100000:0.0:1746144653.351431:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.351463:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830964747391104:0@lo:400:kworker.0 00000100:00100000:0.0:1746144653.351482:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.351495:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144653.351499:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1830964747390720:0@lo:400:kworker.0 00000100:00100000:0.0:1746144653.351514:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.351910:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747391232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746144653.351942:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.351967:0:13589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747391232 00000100:00100000:1.0:1746144653.351975:0:13589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747391232 00000100:00100000:1.0:1746144653.351999:0:13589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746144653.352003:0:13589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747391232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746144653.352019:0:13589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 408485888 pending 18743296 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746144653.352046:0:13589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747391232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.352050:0:13589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746144653.352080:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747391232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144653.352113:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1830964747390720:0@lo:400:kworker.0 00000100:00100000:0.0:1746144653.352121:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3293:1830964747390592:0@lo:400:kworker.0 00000100:00100000:0.0:1746144653.352128:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830964747391104:0@lo:400:kworker.0 00000100:00100000:0.0:1746144653.352193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.352258:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746431104 00000100:00100000:1.0:1746144653.352262:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746431104 00010000:00010000:1.0:1746144653.352304:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 312 pid: 14710 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.352330:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5559 00000100:00100000:1.0:1746144653.352335:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:1960:x1830964746431104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.352344:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.352349:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 312 pid: 14710 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.352364:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 312 pid: 14710 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.352384:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009945ec00/0xa7c849b16e018ba8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df5e expref: 312 pid: 14710 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.352401:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.352406:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352415:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352421:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352445:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.352469:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1960:x1830964746431104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 133us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.352474:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5559 00010000:00010000:1.0:1746144653.352490:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352496:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:1.0:1746144653.352535:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:1.0:1746144653.352540:0:14708:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144653.352553:0:14708:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352566:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352575:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352581:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352587:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352592:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c222800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.352596:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352603:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352610:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144653.352613:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.352616:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352620:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e018d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352627:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352631:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352635:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352640:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c222a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.352642:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352646:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352651:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880090bc6a00) 00010000:00010000:1.0:1746144653.352652:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.352655:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352658:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222a00/0xa7c849b16e018d61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.352687:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222400/0xa7c849b16e018d53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e06f expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.352698:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222c00/0xa7c849b16e018d68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e06f expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.352704:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.352706:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144653.352708:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c222c00, rc 0) 00000100:00100000:1.0:1746144653.352729:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28858:x1830964746430720:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6532us (6968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.353302:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9958 00000100:00100000:0.0:1746144653.356708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.357232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.357626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.357667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.357669:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746431360 00000100:00100000:1.0:1746144653.357673:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746431360 00000100:00100000:1.0:1746144653.358337:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746431488 00000100:00100000:1.0:1746144653.358341:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746431488 00000100:00100000:1.0:1746144653.358365:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11212 00000100:00100000:1.0:1746144653.358371:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746431360:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144653.358380:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.358393:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e07d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.358412:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.358413:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.358419:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.358429:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.358436:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c222200, rc 0) 00000100:00100000:1.0:1746144653.358455:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746431360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 85us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.358461:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11212 00000100:00100000:0.0:1746144653.369370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.373768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.379730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.383516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.389040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.391998:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.392540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.392566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.392582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.392602:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.392629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.392689:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746432896 00000100:00100000:1.0:1746144653.392698:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746432896 00000100:00100000:1.0:1746144653.392733:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433152 00000100:00100000:1.0:1746144653.392734:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433152 00000100:00100000:1.0:1746144653.392751:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433408 00000100:00100000:1.0:1746144653.392752:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433408 00000100:00100000:1.0:1746144653.392761:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746432768 00000100:00100000:1.0:1746144653.392762:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746432768 00000100:00100000:1.0:1746144653.392769:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433024 00000100:00100000:1.0:1746144653.392770:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433024 00000100:00100000:1.0:1746144653.392778:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433280 00000100:00100000:1.0:1746144653.392780:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433280 00000100:00100000:1.0:1746144653.392791:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11216 00000100:00100000:1.0:1746144653.392798:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746432896:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:1.0:1746144653.392838:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801294e7200/0xa7c849b16e018dca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.392855:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.392862:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.392868:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f323200/0xa7c849b16e018c18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc0 expref: 21 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.392873:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.392875:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.392877:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801294e7200/0xa7c849b16e018dca lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.392904:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f323200/0xa7c849b16e018c18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc0 expref: 21 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.392915:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f323200/0xa7c849b16e018c18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfc0 expref: 21 pid: 7257 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1746144653.392926:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747391872:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.392994:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393000:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 9 pid: 8451 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1746144653.393007:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747392000:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.393025:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393031:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 15 pid: 8450 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.393039:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747392128:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.393053:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.393072:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11217 00000100:00100000:1.0:1746144653.393077:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746433152:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:1.0:1746144653.393096:0:4760:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393105:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393112:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de54 expref: 34 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393125:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e0189b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de38 expref: 19 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393130:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.393131:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.393147:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393163:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e0189b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de38 expref: 19 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393170:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e0189b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de38 expref: 19 pid: 8389 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1746144653.393179:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747392256:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.393203:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de54 expref: 34 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393209:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de54 expref: 34 pid: 29370 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1746144653.393216:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747392384:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.393248:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.393263:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 10 pid: 8451 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1746144653.393269:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747392512:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.393282:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.393294:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11218 00000100:00100000:1.0:1746144653.393299:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746433408:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:1.0:1746144653.393313:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393323:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393328:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.393329:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.393331:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393344:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.393351:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 21 pid: 8453 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.393357:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747392640:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.393372:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.400105:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747391872:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.400122:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747392000:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.400288:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747392128:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.400316:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801294e7200/0xa7c849b16e018dca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.402596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.402630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.402676:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747392256:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144653.403113:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747392640:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144653.403162:0:8453:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.403186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.403196:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433792 00000100:00100000:0.0:1746144653.403198:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433792 00010000:00010000:0.0:1746144653.403212:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 16 pid: 8450 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.403240:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5564 00000100:00100000:0.0:1746144653.403246:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746433792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144653.403253:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144653.403265:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 16 pid: 8450 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.403273:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 16 pid: 8450 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.403285:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d796000/0xa7c849b16e018bbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df81 expref: 16 pid: 8450 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.403297:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.403314:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747392384:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.403324:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747392512:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.403338:0:4760:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.403411:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746433792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 165us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.403419:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5564 00000100:00100000:0.0:1746144653.403427:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746434176 00000100:00100000:0.0:1746144653.403429:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746434176 00010000:00010000:0.0:1746144653.403437:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d796800/0xa7c849b16e0189da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de54 expref: 35 pid: 29370 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1746144653.403454:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433536 00000100:00100000:0.0:1746144653.403456:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433536 00010000:00010000:0.0:1746144653.403463:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 10 pid: 8451 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1746144653.403473:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5566 00000100:00100000:0.0:1746144653.403477:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746433536:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144653.403482:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144653.403488:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 10 pid: 8451 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1746144653.403496:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 10 pid: 8451 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1746144653.403506:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c222200/0xa7c849b16e018d7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e07d expref: 10 pid: 8451 timeout: 732 lvb_type: 1 00010000:00010000:0.0:1746144653.403513:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.403514:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.403519:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801294e7200/0xa7c849b16e018dca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.403531:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801294e7200/0xa7c849b16e018dca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.403546:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144653.403559:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746433536:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 81us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.403563:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5566 00000100:00100000:1.0:1746144653.405622:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746433920 00000100:00100000:1.0:1746144653.405629:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746433920 00010000:00010000:1.0:1746144653.405658:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 11 pid: 8451 timeout: 732 lvb_type: 1 00000100:00100000:1.0:1746144653.406542:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5568 00000100:00100000:1.0:1746144653.407640:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746433920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.407652:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.407666:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 12 pid: 8451 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1746144653.407680:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 12 pid: 8451 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1746144653.407745:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e0188ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dde4 expref: 12 pid: 8451 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1746144653.407760:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.407761:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.407765:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.407772:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.407792:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.408376:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746433920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1826us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.408381:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5568 00010000:00010000:1.0:1746144653.408406:0:4760:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408414:0:4760:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408432:0:4760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408443:0:4760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408450:0:4760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408455:0:4760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacd000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144653.408458:0:4760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408464:0:4760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408473:0:4760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.408478:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e018dd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.408514:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746433152:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 15438us (15976us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.408521:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11217 00000100:00100000:0.0:1746144653.408652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.408815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.408827:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746434688 00000100:00100000:0.0:1746144653.408832:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746434688 00010000:00010000:0.0:1746144653.408848:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4de400/0xa7c849b16e018b62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df50 expref: 19 pid: 8451 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.408862:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5570 00000100:00100000:0.0:1746144653.408867:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746434688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144653.408874:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144653.408881:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4de400/0xa7c849b16e018b62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df50 expref: 19 pid: 8451 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.408890:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4de400/0xa7c849b16e018b62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df50 expref: 19 pid: 8451 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.408901:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.408903:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.408906:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.408913:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.408924:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144653.408940:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746434688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.408946:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5570 00000100:00100000:0.0:1746144653.408993:0:21334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746434560 00000100:00100000:0.0:1746144653.408996:0:21334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746434560 00002000:00100000:0.0:1746144653.409021:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3674112->3956735) req@ffff8800a4b62d80 x1830964746434560/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.409029:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62d80 with x1830964746434560 ext(3674112->3956735) 00010000:00010000:0.0:1746144653.409036:0:21334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 21 pid: 8453 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.409044:0:21334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 21 pid: 8453 timeout: 732 lvb_type: 0 00002000:00010000:0.0:1746144653.409049:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4b62d80 00000100:00100000:0.0:1746144653.409061:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 804 00000100:00100000:0.0:1746144653.409065:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746434560:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:0.0:1746144653.409430:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f000/0xa7c849b16e018d6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e076 expref: 9 pid: 10724 timeout: 732 lvb_type: 1 00000100:00100000:0.0:1746144653.409441:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747392896:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144653.409451:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4de400/0xa7c849b16e018b62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df50 expref: 18 pid: 8451 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.409459:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747393024:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144653.409486:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409494:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409499:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409511:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409517:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409523:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409527:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995bae00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144653.409529:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409535:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409544:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.409550:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800995bae00/0xa7c849b16e018ddf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.409585:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746432768:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 16278us (17001us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.409591:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11219 00000100:00100000:0.0:1746144653.409638:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747393152:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144653.409646:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747393280:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144653.412052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.418455:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746434560:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9388us (9802us total) trans 21474840379 rc 0/0 00000100:00100000:0.0:1746144653.418464:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 804 00002000:00100000:0.0:1746144653.418474:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (3674112->3956735) req@ffff8800a4b62d80 x1830964746434560/t21474840379(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/448 e 0 to 0 dl 1746144664 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.418483:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62d80 with x1830964746434560 ext(3674112->3956735) 00010000:00010000:0.0:1746144653.418491:0:21334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.418502:0:21334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 732 lvb_type: 0 00002000:00010000:0.0:1746144653.418513:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4b62d80 00000100:00100000:0.0:1746144653.420796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.420873:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746436096 00000100:00100000:1.0:1746144653.420881:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746436096 00010000:00010000:1.0:1746144653.420908:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.420944:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5581 00000100:00100000:1.0:1746144653.420951:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746436096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.420963:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.420981:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.420991:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.421008:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e018d45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3674112->3956735) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e061 expref: 22 pid: 8453 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.421054:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.421055:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.421059:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.421067:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.421178:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144653.421217:0:8453:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421235:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421252:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.421280:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746436096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 328us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.421286:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5581 00010000:00010000:0.0:1746144653.421324:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421331:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421337:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19f0400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144653.421340:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421347:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421355:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.421366:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e018dd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.421405:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746433408:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 28106us (28838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.421411:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11218 00000100:00100000:0.0:1746144653.422763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.422814:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746436352 00000100:00100000:1.0:1746144653.422819:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746436352 00000100:00100000:1.0:1746144653.422850:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9962 00000100:00100000:1.0:1746144653.422856:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:28858:x1830964746436352:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:1.0:1746144653.422929:0:14708:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.422946:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018da7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e099 expref: 12 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423020:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.423024:0:14708:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144653.423050:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e018df4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.423061:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de70 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423068:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56200/0xa7c849b16e018a19 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152de7e expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423072:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423078:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b63e800/0xa7c849b16e018c0a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfb9 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423084:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfce expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423089:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e018df4 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144653.423120:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfce expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423131:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e018c3b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfce expref: 310 pid: 15388 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.423422:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394432:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.423763:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b63e800/0xa7c849b16e018c0a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfb9 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423772:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b63e800/0xa7c849b16e018c0a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152dfb9 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.423778:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394560:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.423802:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423808:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.423813:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.423829:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56200/0xa7c849b16e018a19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de7e expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423835:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090f56200/0xa7c849b16e018a19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de7e expref: 310 pid: 15388 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.423845:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394816:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.423860:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de70 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.423866:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b061600/0xa7c849b16e018a04 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152de70 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00000100:00100000:1.0:1746144653.423871:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394944:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.423882:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144653.426754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.427163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.427378:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394432:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.427387:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394560:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.427393:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394688:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.427484:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394816:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.427491:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747394944:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.427523:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e018df4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:0.0:1746144653.428550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.428580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.428611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.430569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.430625:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746437248 00000100:00100000:0.0:1746144653.430630:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746437248 00010000:00010000:0.0:1746144653.430652:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00000100:00100000:0.0:1746144653.430676:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5586 00000100:00100000:0.0:1746144653.430681:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746437248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144653.430689:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144653.430692:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.430702:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.430726:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed32c00/0xa7c849b16e018b3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152df34 expref: 19 pid: 14710 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.430772:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144653.430776:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e018df4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.430784:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e018df4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.430790:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e018df4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.430820:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144653.430893:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746437248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 211us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.430899:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5586 00000001:00080000:0.0:1746144653.475177:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943813 is committed 00000001:00080000:0.0:1746144653.475197:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943799 is committed 00000001:00080000:1.0:1746144653.475394:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943816 is committed 00000001:00080000:1.0:1746144653.475403:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943815 is committed 00000001:00080000:1.0:1746144653.475418:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943820 is committed 00000004:00080000:1.0:1746144653.475423:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1945 committed 00000004:00080000:1.0:1746144653.475431:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2012 committed 00000004:00080000:1.0:1746144653.475437:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2011 committed 00000004:00080000:1.0:1746144653.475439:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2010 committed 00000004:00080000:1.0:1746144653.475441:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2009 committed 00000004:00080000:1.0:1746144653.475442:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1944 committed 00000004:00080000:1.0:1746144653.475443:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2008 committed 00000004:00080000:1.0:1746144653.475445:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1943 committed 00000004:00080000:1.0:1746144653.475446:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2007 committed 00000004:00080000:1.0:1746144653.475447:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1942 committed 00000004:00080000:1.0:1746144653.475451:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1941 committed 00000004:00080000:1.0:1746144653.475452:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1940 committed 00000004:00080000:1.0:1746144653.475454:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2006 committed 00000004:00080000:1.0:1746144653.475455:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2005 committed 00000004:00080000:1.0:1746144653.475457:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1939 committed 00000004:00080000:1.0:1746144653.475458:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1938 committed 00000004:00080000:1.0:1746144653.475460:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2004 committed 00000001:00080000:1.0:1746144653.475493:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943819 is committed 00000100:00100000:0.0:1746144653.476229:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747395072 00000100:00100000:0.0:1746144653.476236:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747395072 00000100:00100000:0.0:1746144653.476270:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11222 00000100:00100000:0.0:1746144653.476277:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747395072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.476472:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830964747395072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (276us total) trans 21474840380 rc 0/0 00000100:00100000:0.0:1746144653.476477:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11222 00000100:00100000:0.0:1746144653.476486:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11223 00000100:00100000:0.0:1746144653.476490:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3295:x1830964747395584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.476566:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830964747395584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (297us total) trans 21474840381 rc 0/0 00000100:00100000:0.0:1746144653.476571:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11223 00000100:00100000:0.0:1746144653.476582:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11225 00000100:00100000:0.0:1746144653.476586:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3295:x1830964747396608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.476662:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3295:x1830964747396608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (347us total) trans 17179873130 rc 0/0 00000100:00100000:0.0:1746144653.476667:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11225 00000100:00100000:0.0:1746144653.476680:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11227 00000100:00100000:0.0:1746144653.476685:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830964747395712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.477029:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830964747395712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 343us (664us total) trans 21474840383 rc 0/0 00000100:00100000:0.0:1746144653.477034:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11227 00000004:00080000:0.0:1746144653.477070:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cf800/2, rc 0, transno 21474840382 00000100:00100000:0.0:1746144653.477075:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747395200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144653.477081:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4b61c00/2, rc 0, transno 21474840383 00000100:00100000:0.0:1746144653.477084:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747395712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.477089:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144653.477091:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1fdc00/2, rc 0, transno 17179873131 00000100:00100000:0.0:1746144653.477098:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747396224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144653.477103:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebf100/2, rc 0, transno 17179873132 00000100:00100000:0.0:1746144653.477106:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747396736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144653.477111:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cfb80/2, rc 0, transno 21474840380 00000100:00100000:0.0:1746144653.477114:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747395072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.477115:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144653.477122:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4b63800/2, rc 0, transno 21474840381 00000100:00100000:0.0:1746144653.477124:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747395584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.477128:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144653.477129:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1fed80/2, rc 0, transno 17179873129 00000100:00100000:0.0:1746144653.477132:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747396096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.477162:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144653.477163:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebd500/2, rc 0, transno 17179873130 00000100:00100000:0.0:1746144653.477165:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747396608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.477172:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.477178:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747395328 00000100:00100000:0.0:1746144653.477180:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747395328 00000100:00100000:1.0:1746144653.477185:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.477193:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.477240:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.477951:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747395840 00000100:00100000:0.0:1746144653.477954:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747395840 00000100:00100000:1.0:1746144653.477969:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746144653.477969:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747396352 00000100:00100000:0.0:1746144653.477971:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747396352 00000100:00100000:1.0:1746144653.477975:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.477979:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747396864 00000100:00100000:0.0:1746144653.477981:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747396864 00000100:00100000:0.0:1746144653.477989:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11230 00000100:00100000:1.0:1746144653.477993:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.477994:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3293:x1830964747395328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.478004:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.478017:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.478024:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.478036:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.478043:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.478056:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.478074:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747395456 00000100:00100000:1.0:1746144653.478076:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747395456 00000100:00100000:1.0:1746144653.478089:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747395968 00000100:00100000:1.0:1746144653.478090:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747395968 00000100:00100000:1.0:1746144653.478096:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747396480 00000100:00100000:1.0:1746144653.478097:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747396480 00000100:00100000:1.0:1746144653.478103:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747396992 00000100:00100000:1.0:1746144653.478105:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747396992 00000100:00100000:0.0:1746144653.478105:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747395328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (989us total) trans 21474840384 rc 0/0 00000100:00100000:0.0:1746144653.478110:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11230 00000100:00100000:1.0:1746144653.478113:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11231 00000100:00100000:1.0:1746144653.478116:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747395840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.478118:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11232 00000100:00100000:0.0:1746144653.478121:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747396352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.478213:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747395840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (1049us total) trans 21474840385 rc 0/0 00000100:00100000:0.0:1746144653.478213:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747396352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1025us total) trans 17179873133 rc 0/0 00000100:00100000:0.0:1746144653.478218:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11232 00000100:00100000:1.0:1746144653.478231:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11231 00000100:00100000:0.0:1746144653.478242:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11233 00000100:00100000:1.0:1746144653.478244:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11234 00000100:00100000:0.0:1746144653.478246:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747396864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.478248:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747395456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144653.478311:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144653.478314:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144653.478316:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144653.478318:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00000100:00100000:0.0:1746144653.478319:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747396864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1079us total) trans 17179873134 rc 0/0 00002000:00010000:1.0:1746144653.478320:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144653.478324:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11233 00000100:00100000:0.0:1746144653.478333:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11235 00000100:00100000:1.0:1746144653.478334:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747395456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (341us total) trans 21474840386 rc 0/0 00000100:00100000:0.0:1746144653.478337:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747395968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.478339:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11234 00000100:00100000:1.0:1746144653.478348:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11236 00000100:00100000:1.0:1746144653.478351:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747396480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.478407:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747395968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (389us total) trans 21474840387 rc 0/0 00000100:00100000:1.0:1746144653.478410:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747396480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (373us total) trans 17179873135 rc 0/0 00000100:00100000:0.0:1746144653.478412:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11235 00000100:00100000:1.0:1746144653.478415:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11236 00000100:00100000:0.0:1746144653.478421:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11237 00000100:00100000:0.0:1746144653.478424:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747396992:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.478438:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cca80/2, rc 0, transno 21474840386 00000100:00100000:1.0:1746144653.478442:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.478448:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1fdf80/2, rc 0, transno 21474840387 00000100:00100000:1.0:1746144653.478451:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.478456:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebdc00/2, rc 0, transno 17179873135 00000100:00100000:1.0:1746144653.478459:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.478465:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cd500/2, rc 0, transno 21474840384 00000100:00100000:1.0:1746144653.478467:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.478473:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1fc380/2, rc 0, transno 21474840385 00000100:00100000:1.0:1746144653.478475:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747395840:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.478480:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f1fe680/2, rc 0, transno 17179873133 00000100:00100000:1.0:1746144653.478483:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f1fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.478488:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb48000/2, rc 0, transno 17179873134 00000100:00100000:1.0:1746144653.478491:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.478493:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747396992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (436us total) trans 17179873136 rc 0/0 00000004:00080000:1.0:1746144653.478497:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb48380/2, rc 0, transno 17179873136 00000100:00100000:0.0:1746144653.478498:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11237 00000100:00100000:1.0:1746144653.478500:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747396992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.478616:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747397120 00000100:00100000:0.0:1746144653.478619:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747397120 00000100:00100000:0.0:1746144653.478632:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11238 00000100:00100000:0.0:1746144653.478636:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3296:x1830964747397120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.478723:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3296:x1830964747397120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (122us total) trans 17179873137 rc 0/0 00000100:00100000:0.0:1746144653.478728:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11238 00000100:00100000:0.0:1746144653.480334:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.484825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.488468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.488504:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.488566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.488746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.488855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.488903:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746437632 00000100:00100000:1.0:1746144653.488907:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746437632 00000100:00100000:0.0:1746144653.488934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.489366:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11241 00000100:00100000:0.0:1746144653.489373:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746437888:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144653.489379:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144653.489387:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacc800/0xa7c849b16e018e1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e0ca expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144653.489399:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d8b, atime: 0x68140d8b, ctime: 0x68140d8b, blocks: 0x821 00010000:00010000:0.0:1746144653.489405:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.489406:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.489411:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacc800/0xa7c849b16e018e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0ca expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144653.489419:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dacc800/0xa7c849b16e018e1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0ca expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144653.489425:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacc800, rc 0) 00000100:00100000:0.0:1746144653.489438:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746437888:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 68us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.489443:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11241 00000100:00100000:0.0:1746144653.489451:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11243 00000100:00100000:0.0:1746144653.489455:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746438272:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144653.489459:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144653.489465:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacd600/0xa7c849b16e018e2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e0df expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144653.489477:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d8e, atime: 0x68140d8e, ctime: 0x68140d8e, blocks: 0x1029 00010000:00010000:0.0:1746144653.489482:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.489483:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144653.489486:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd600/0xa7c849b16e018e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0df expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144653.489494:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd600/0xa7c849b16e018e2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0df expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144653.489500:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd600, rc 0) 00000100:00100000:0.0:1746144653.489511:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131001050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746438272:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 56us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144653.489515:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11243 00000100:00100000:1.0:1746144653.489726:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11244 00000100:00100000:1.0:1746144653.489731:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746437632:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144653.489738:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.489746:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5115c00/0xa7c849b16e018e33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e0bc expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144653.489758:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d8d, atime: 0x68140d88, ctime: 0x68140d8d, blocks: 0x805 00010000:00010000:1.0:1746144653.489765:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.489766:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.489770:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5115c00/0xa7c849b16e018e33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0bc expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.489779:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5115c00/0xa7c849b16e018e33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0bc expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.489785:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5115c00, rc 0) 00000100:00100000:1.0:1746144653.489802:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746437632:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 72us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.489807:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11244 00000100:00100000:0.0:1746144653.496107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.504565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.504608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.504634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.505278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.505911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.506507:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4199 00000100:00100000:1.0:1746144653.506515:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746439040:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144653.506530:0:1570:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.506536:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.506538:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.506540:0:1570:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.506548:0:1570:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.506953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.506969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144653.540692:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.540710:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.540722:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.540728:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428be00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144653.540882:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.540890:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.540900:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.540905:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b428be00/0xa7c849b16e018e56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.543321:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746439552:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 36657us (38041us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144653.543329:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4201 00010000:00010000:1.0:1746144653.548789:0:1570:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.548805:0:1570:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.548812:0:1570:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.548818:0:1570:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5114e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144653.548822:0:1570:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.548829:0:1570:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.548847:0:1570:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.548852:0:1570:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5114e00/0xa7c849b16e018e48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.551630:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746439040:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 45114us (47019us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144653.551641:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4199 00000100:00100000:0.0:1746144653.565241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.574176:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.574217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.574253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.574272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.574286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.574363:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746440704 00000100:00100000:1.0:1746144653.574373:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746440704 00000100:00100000:1.0:1746144653.574412:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746440832 00000100:00100000:1.0:1746144653.574414:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746440832 00000100:00100000:1.0:1746144653.574432:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746440960 00000100:00100000:1.0:1746144653.574433:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746440960 00000100:00100000:0.0:1746144653.574661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.574689:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746441088 00000100:00100000:1.0:1746144653.574693:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746441088 00000100:00100000:0.0:1746144653.574701:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746441216 00000100:00100000:0.0:1746144653.574705:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746441216 00000100:00100000:1.0:1746144653.574708:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746441344 00000100:00100000:1.0:1746144653.574710:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746441344 00000100:00100000:1.0:1746144653.574726:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11245 00000100:00100000:0.0:1746144653.574731:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11246 00000100:00100000:1.0:1746144653.574733:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746440704:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:0.0:1746144653.574736:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746440832:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144653.574917:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144653.574918:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144653.574921:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144653 -> 1746144654 00002000:00010000:0.0:1746144653.574921:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.574923:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144648 -> 1746144654 00002000:00010000:0.0:1746144653.574923:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.574925:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144653 -> 1746144654 00002000:00010000:0.0:1746144653.574925:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144653 -> 1746144654 00002000:00010000:0.0:1746144653.574926:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746144653.574927:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:0.0:1746144653.574975:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746440832:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 238us (756us total) trans 21474840388 rc 0/0 00000100:00100000:0.0:1746144653.574981:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11246 00000100:00100000:0.0:1746144653.574997:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11248 00000100:00100000:0.0:1746144653.575001:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746441088:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144653.575067:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144653.575070:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144649 -> 1746144654 00002000:00010000:0.0:1746144653.575072:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144649 -> 1746144654 00002000:00010000:0.0:1746144653.575074:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144649 -> 1746144654 00002000:00010000:0.0:1746144653.575075:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144653.575692:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746440704:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 958us (1557us total) trans 17179873138 rc 0/0 00000100:00100000:1.0:1746144653.575700:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11245 00000100:00100000:0.0:1746144653.575702:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746441088:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 698us (1426us total) trans 17179873139 rc 0/0 00000100:00100000:0.0:1746144653.575708:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11248 00000100:00100000:1.0:1746144653.575712:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11250 00000100:00100000:1.0:1746144653.575718:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746441216:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144653.575788:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144653.575791:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.575792:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.575795:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144653 -> 1746144654 00002000:00010000:1.0:1746144653.575797:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5613 -> 5613 00000100:00100000:1.0:1746144653.575817:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746441216:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 99us (1529us total) trans 17179873140 rc 0/0 00000100:00100000:1.0:1746144653.575822:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11250 00000100:00100000:0.0:1746144653.581337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.584460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000001:00080000:0.0:1746144653.614399:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943821 is committed 00000001:00080000:0.0:1746144653.614421:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943822 is committed 00000004:00080000:0.0:1746144653.614426:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1953 committed 00000004:00080000:0.0:1746144653.614432:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2021 committed 00000004:00080000:0.0:1746144653.614439:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2020 committed 00000004:00080000:0.0:1746144653.614440:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2019 committed 00010000:00010000:1.0:1746144653.614441:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16907 initiator: MDT0 00000004:00080000:0.0:1746144653.614442:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746144653.614443:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1952 committed 00000004:00080000:0.0:1746144653.614445:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2017 committed 00000004:00080000:0.0:1746144653.614446:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1951 committed 00000004:00080000:0.0:1746144653.614448:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2016 committed 00010000:00010000:1.0:1746144653.614449:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16907 initiator: MDT0 00000004:00080000:0.0:1746144653.614449:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1950 committed 00000004:00080000:0.0:1746144653.614451:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1949 committed 00000004:00080000:0.0:1746144653.614452:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1948 committed 00000004:00080000:0.0:1746144653.614453:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2015 committed 00010000:00010000:1.0:1746144653.614456:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16907 initiator: MDT0 00000004:00080000:0.0:1746144653.614456:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746144653.614458:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1947 committed 00000004:00080000:0.0:1746144653.614459:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1946 committed 00010000:00010000:1.0:1746144653.614462:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b40e8c00 already unused, calling callback (ffffffffa1376690) 00000004:00080000:0.0:1746144653.614462:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2013 committed 00010000:00010000:1.0:1746144653.614466:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144653.614473:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144653.614489:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.614491:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144653.614494:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144653.614499:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e018e79 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16907 initiator: MDT0 00000100:00100000:0.0:1746144653.614574:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747397632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.614576:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747397760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614621:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614646:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614662:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614672:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614685:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614699:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747399296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.614712:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614726:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746144653.614731:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747397376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614745:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614756:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747397888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.614767:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614776:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.614789:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614798:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.614810:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614825:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747397504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614841:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614847:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747398016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614859:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614865:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747398528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614878:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614885:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747399040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.614897:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.614920:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747397376 00000100:00100000:1.0:1746144653.614924:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747397376 00000100:00100000:1.0:1746144653.614942:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747397888 00000100:00100000:1.0:1746144653.614944:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747397888 00000100:00100000:1.0:1746144653.614951:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747398400 00000100:00100000:1.0:1746144653.614953:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747398400 00000100:00100000:1.0:1746144653.614961:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747398912 00000100:00100000:1.0:1746144653.614962:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747398912 00000100:00100000:1.0:1746144653.614968:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747397504 00000100:00100000:1.0:1746144653.614970:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747397504 00000100:00100000:1.0:1746144653.614976:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747398016 00000100:00100000:1.0:1746144653.614978:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747398016 00000100:00100000:1.0:1746144653.614984:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747398528 00000100:00100000:1.0:1746144653.614985:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747398528 00000100:00100000:1.0:1746144653.614992:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747399040 00000100:00100000:1.0:1746144653.614993:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747399040 00000100:00100000:1.0:1746144653.615004:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11253 00000100:00100000:1.0:1746144653.615010:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830964747398784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.615185:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747398784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (498us total) trans 21474840393 rc 0/0 00000100:00100000:1.0:1746144653.615191:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11253 00000100:00100000:1.0:1746144653.615201:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11255 00000100:00100000:1.0:1746144653.615206:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830964747397376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144653.615304:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144653.615306:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144653.615308:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144653.615310:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144653.615312:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144653.615332:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747397376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (586us total) trans 21474840394 rc 0/0 00000100:00100000:1.0:1746144653.615338:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11255 00000100:00100000:1.0:1746144653.615349:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11257 00000100:00100000:1.0:1746144653.615354:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3295:x1830964747398400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.615435:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747398400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (644us total) trans 17179873143 rc 0/0 00000100:00100000:1.0:1746144653.615441:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11257 00000100:00100000:1.0:1746144653.615450:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11260 00000100:00100000:1.0:1746144653.615455:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3293:x1830964747398016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144653.615519:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144653.615521:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144653.615523:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144653.615524:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144653.615526:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144653.615549:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747398016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (688us total) trans 21474840395 rc 0/0 00000100:00100000:1.0:1746144653.615554:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11260 00000100:00100000:1.0:1746144653.615563:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11262 00000100:00100000:1.0:1746144653.615568:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3293:x1830964747399040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.615639:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.615643:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747399040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (744us total) trans 21474840397 rc 0/0 00000100:00100000:1.0:1746144653.615648:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11262 00000100:00100000:1.0:1746144653.615656:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747397632 00000100:00100000:1.0:1746144653.615659:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747397632 00000100:00100000:0.0:1746144653.615663:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747398144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.615672:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11263 00000100:00100000:1.0:1746144653.615676:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747397632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.615681:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.615691:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747398656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.615706:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.615715:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747399168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.615729:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.615745:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747398144 00002000:00010000:1.0:1746144653.615748:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746144653.615748:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747398144 00002000:00010000:1.0:1746144653.615751:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144653.615753:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144653.615755:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144653.615756:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:0.0:1746144653.615760:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747398656 00000100:00100000:0.0:1746144653.615763:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747398656 00000100:00100000:0.0:1746144653.615769:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747399168 00000100:00100000:0.0:1746144653.615771:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747399168 00000100:00100000:0.0:1746144653.615779:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11264 00000100:00100000:1.0:1746144653.615780:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747397632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (139us total) trans 17179873145 rc 0/0 00000100:00100000:0.0:1746144653.615784:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747398144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.615785:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11263 00000100:00100000:1.0:1746144653.615795:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11265 00000100:00100000:1.0:1746144653.615800:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747398656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144653.615862:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:0.0:1746144653.615864:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.615866:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.615868:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.615870:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5613 -> 5613 00000100:00100000:1.0:1746144653.615882:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3294:x1830964747398656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (174us total) trans 17179873147 rc 0/0 00000100:00100000:1.0:1746144653.615887:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11265 00000100:00100000:0.0:1746144653.615887:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3294:x1830964747398144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (205us total) trans 17179873146 rc 0/0 00000100:00100000:0.0:1746144653.615893:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11264 00000004:00080000:1.0:1746144653.615923:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801309d4000/2, rc 0, transno 21474840398 00000004:00080000:0.0:1746144653.615923:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b811f80/2, rc 0, transno 17179873145 00000100:00100000:1.0:1746144653.615928:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747397504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.615931:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747397632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.615936:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd90380/2, rc 0, transno 21474840395 00000100:00100000:1.0:1746144653.615939:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747398016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144653.615939:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb4e00/2, rc 0, transno 17179873146 00000100:00100000:0.0:1746144653.615941:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747398144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.615945:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd90a80/2, rc 0, transno 21474840396 00000004:00080000:0.0:1746144653.615947:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e1500/2, rc 0, transno 17179873147 00000100:00100000:1.0:1746144653.615948:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747398528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.615950:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747398656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.615955:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd93800/2, rc 0, transno 21474840397 00000004:00080000:0.0:1746144653.615956:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e3100/2, rc 0, transno 17179873148 00000100:00100000:1.0:1746144653.615957:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747399040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.615959:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747399168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.615995:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801309d7800/2, rc 0, transno 21474840394 00000100:00100000:1.0:1746144653.615998:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747397376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.616005:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b812300/2, rc 0, transno 17179873142 00000100:00100000:1.0:1746144653.616007:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747397888:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.616013:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e31500/2, rc 0, transno 17179873143 00000100:00100000:1.0:1746144653.616015:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.616020:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e1c00/2, rc 0, transno 17179873144 00000100:00100000:1.0:1746144653.616022:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144653.616028:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33dc00/2, rc 0, transno 21474840391 00000100:00100000:1.0:1746144653.616030:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747397760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.616036:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd90700/2, rc 0, transno 21474840392 00000100:00100000:1.0:1746144653.616038:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.616043:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd92a00/2, rc 0, transno 21474840393 00000100:00100000:1.0:1746144653.616045:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747398784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.616051:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f5e3800/2, rc 0, transno 17179873141 00000100:00100000:1.0:1746144653.616053:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f5e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747399296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.616060:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746144653.616063:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747399424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.616090:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.616900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000004:00080000:1.0:1746144653.616925:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ee00a80/2, rc 0, transno 17179873149 00000100:00100000:1.0:1746144653.616928:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747399424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.620629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.634441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.640492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.640623:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746442624 00000100:00100000:1.0:1746144653.640631:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746442624 00000100:00100000:1.0:1746144653.640688:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9968 00000100:00100000:1.0:1746144653.640695:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+6:28866:x1830964746442624:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144653.640714:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.640724:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e018eaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e0f4 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.640799:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.640808:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.640815:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.640822:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641021:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641029:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641114:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e018ebf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641123:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e018ebf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641129:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e018ebf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144653.641154:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144653.641214:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641231:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641237:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641241:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2de000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.641244:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641250:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641257:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144653.641260:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.641263:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641267:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e018eb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641292:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641297:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641301:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641305:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2dee00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144653.641307:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641311:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641321:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33800) 00010000:00010000:1.0:1746144653.641323:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144653.641325:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641329:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dee00/0xa7c849b16e018eb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144653.641359:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e018eaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0f4 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.641370:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e018ebf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0f4 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.641376:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144653.641378:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144653.641381:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2df000, rc 0) 00000100:00100000:1.0:1746144653.641440:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28866:x1830964746442624:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 745us (953us total) trans 8589943825 rc 0/0 00000100:00100000:1.0:1746144653.641446:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9968 00000100:00100000:0.0:1746144653.645659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.646579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.648308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.649581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.649848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.649908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.649944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144653.650248:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e018ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.650255:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e018ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:02000000:0.0:1746144653.650291:0:14708:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:0.0:1746144653.651095:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2839, 88 off236768 00000004:00080000:0.0:1746144653.651100:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632859965486ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651574:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2768, 88 off230520 00000004:00080000:0.0:1746144653.651579:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860444537ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651785:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2769, 88 off230608 00000004:00080000:0.0:1746144653.651790:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860655918ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651805:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2840, 88 off236856 00000004:00080000:0.0:1746144653.651808:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860673347ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651816:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2841, 88 off236944 00000004:00080000:0.0:1746144653.651819:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860684526ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651826:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2770, 88 off230696 00000004:00080000:0.0:1746144653.651828:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860693418ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651834:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2771, 88 off230784 00000004:00080000:0.0:1746144653.651836:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860701545ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651842:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2772, 88 off230872 00000004:00080000:0.0:1746144653.651844:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860709601ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651853:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2842, 88 off237032 00000004:00080000:0.0:1746144653.651855:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860720752ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651863:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2773, 88 off230960 00000004:00080000:0.0:1746144653.651865:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860730591ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651872:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2843, 88 off237120 00000004:00080000:0.0:1746144653.651875:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860740165ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651882:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2774, 88 off231048 00000004:00080000:0.0:1746144653.651885:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860750697ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144653.651892:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2844, 88 off237208 00000004:00080000:0.0:1746144653.651895:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860760351ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651908:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2845, 88 off237296 00000004:00080000:0.0:1746144653.651911:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860776186ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651918:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2846, 88 off237384 00000004:00080000:0.0:1746144653.651920:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860785678ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651926:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2847, 88 off237472 00000004:00080000:0.0:1746144653.651928:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 632860793508ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144653.651935:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2775, 88 off231136 00000004:00080000:0.0:1746144653.651937:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632860802936ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144653.656195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.661641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144653.684992:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e018ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0fb expref: 13 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.685009:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144653.685012:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746144653.685016:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880136933e00/0xa7c849b16e018f28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144653.685025:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136933e00/0xa7c849b16e018f28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144653.685030:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136933e00/0xa7c849b16e018f28 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144653.685037:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e018f13 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e117 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.685050:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e018f13 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e117 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.685055:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e018f13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e117 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.685098:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3800/0xa7c849b16e018f13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e117 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144653.685111:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747399936:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144653.685229:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef80c0 going to sleep for 11 seconds 00000001:00080000:0.0:1746144653.685245:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943828 is committed 00000004:00080000:0.0:1746144653.685251:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1961 committed 00000004:00080000:0.0:1746144653.685257:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2030 committed 00000004:00080000:0.0:1746144653.685262:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2029 committed 00000004:00080000:0.0:1746144653.685264:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2028 committed 00000004:00080000:0.0:1746144653.685265:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2027 committed 00000004:00080000:0.0:1746144653.685267:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1960 committed 00000004:00080000:0.0:1746144653.685268:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2026 committed 00000004:00080000:0.0:1746144653.685270:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1959 committed 00000004:00080000:0.0:1746144653.685272:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2025 committed 00000004:00080000:0.0:1746144653.685273:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1958 committed 00000004:00080000:0.0:1746144653.685274:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1957 committed 00000004:00080000:0.0:1746144653.685276:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1956 committed 00000004:00080000:0.0:1746144653.685277:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2024 committed 00000004:00080000:0.0:1746144653.685278:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2023 committed 00000004:00080000:0.0:1746144653.685280:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1955 committed 00000004:00080000:0.0:1746144653.685281:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1954 committed 00000004:00080000:0.0:1746144653.685285:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2022 committed 00000001:00080000:0.0:1746144653.685299:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943826 is committed 00000001:00080000:0.0:1746144653.685307:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943823 is committed 00000100:00100000:0.0:1746144653.685822:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747400064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.685861:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.685883:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144653.685888:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747400192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.685904:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.685929:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747400064 00000100:00100000:0.0:1746144653.685937:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747400064 00000100:00100000:0.0:1746144653.685975:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747400192 00000100:00100000:0.0:1746144653.685977:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747400192 00000100:00100000:0.0:1746144653.685994:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11269 00000100:00100000:0.0:1746144653.686001:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747400064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144653.686286:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144653.686289:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.686291:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.686293:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.686295:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144653.687251:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3293:x1830964747400064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1250us (1390us total) trans 21474840400 rc 0/0 00000100:00100000:0.0:1746144653.687256:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11269 00000100:00100000:0.0:1746144653.687270:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747400576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.687287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144653.687308:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32fb80/2, rc 0, transno 21474840399 00000100:00100000:0.0:1746144653.687311:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747400192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144653.687317:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32df80/2, rc 0, transno 21474840400 00000100:00100000:0.0:1746144653.687320:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747400064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.687634:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747400832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144653.687656:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.687687:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747400704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.687710:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747401088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.687913:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747401344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.687931:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.687970:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.688048:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747401856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.688063:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.688107:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747401600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.688125:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.688148:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747401216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.688168:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747401088 00000100:00100000:0.0:1746144653.688170:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747401088 00000100:00100000:0.0:1746144653.688184:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11273 00000100:00100000:0.0:1746144653.688189:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3293:x1830964747400576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.688202:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11275 00000100:00100000:0.0:1746144653.688206:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3295:x1830964747401344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144653.688314:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:0.0:1746144653.688317:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.688319:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.688321:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144653.688323:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5613 -> 5613 00000100:00100000:0.0:1746144653.688338:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3295:x1830964747401344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (406us total) trans 17179873150 rc 0/0 00000100:00100000:0.0:1746144653.688343:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11275 00000100:00100000:0.0:1746144653.688350:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11277 00000100:00100000:0.0:1746144653.688353:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3294:x1830964747400704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.688419:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747400704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (293us total) trans 21474840404 rc 0/0 00000100:00100000:0.0:1746144653.688424:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11277 00000100:00100000:0.0:1746144653.688500:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747400576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (1211us total) trans 21474840405 rc 0/0 00000100:00100000:0.0:1746144653.688505:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11273 00000004:00080000:1.0:1746144653.689174:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d28e00/2, rc 0, transno 21474840403 00000100:00100000:1.0:1746144653.689179:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747400832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144653.689187:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d29c00/2, rc 0, transno 17179873150 00000100:00100000:1.0:1746144653.689193:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747401344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.689207:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747401856 00000100:00100000:1.0:1746144653.689210:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747401856 00000100:00100000:0.0:1746144653.691725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.691756:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144653.691787:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747401728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.691822:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144653.691858:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d28a80/2, rc 0, transno 21474840404 00000100:00100000:0.0:1746144653.691862:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747400704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.691876:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747401728 00000100:00100000:0.0:1746144653.691878:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747401728 00000100:00100000:0.0:1746144653.691895:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11279 00000100:00100000:0.0:1746144653.691899:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747401728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.692001:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3294:x1830964747401728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (177us total) trans 17179873152 rc 0/0 00000100:00100000:0.0:1746144653.692008:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11279 00000100:00100000:0.0:1746144653.692020:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747400960 00000100:00100000:0.0:1746144653.692022:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747400960 00000100:00100000:0.0:1746144653.692074:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747401472 00000100:00100000:0.0:1746144653.692076:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747401472 00000100:00100000:0.0:1746144653.692087:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11280 00000100:00100000:0.0:1746144653.692091:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747400960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144653.692191:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747400960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (218us total) trans 21474840406 rc 0/0 00000100:00100000:0.0:1746144653.692196:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11280 00000004:00080000:0.0:1746144653.692342:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d2a680/2, rc 0, transno 17179873152 00000100:00100000:0.0:1746144653.692345:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747401728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.692355:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144653.692373:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d28700/2, rc 0, transno 21474840405 00000100:00100000:0.0:1746144653.692376:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747400576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144653.692386:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d29500/2, rc 0, transno 17179873151 00000100:00100000:0.0:1746144653.692389:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747401088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.692399:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747401600 00000100:00100000:0.0:1746144653.692402:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747401600 00000100:00100000:0.0:1746144653.692414:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11283 00000100:00100000:0.0:1746144653.692418:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747401600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.692488:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747401600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (131us total) trans 17179873156 rc 0/0 00000100:00100000:0.0:1746144653.692492:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11283 00000004:00080000:0.0:1746144653.692506:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d2a300/2, rc 0, transno 17179873156 00000100:00100000:0.0:1746144653.692509:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747401600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.692586:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11284 00000100:00100000:1.0:1746144653.692591:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747401856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.692677:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747401856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (4613us total) trans 17179873157 rc 0/0 00000100:00100000:1.0:1746144653.692682:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11284 00000100:00100000:1.0:1746144653.692738:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746144653.692743:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747402112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.692759:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144653.692772:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747402112 00000100:00100000:1.0:1746144653.692775:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747402112 00000100:00100000:1.0:1746144653.692789:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11285 00000100:00100000:1.0:1746144653.692793:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3294:x1830964747402112:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144653.692857:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d2aa00/2, rc 0, transno 17179873157 00000100:00100000:0.0:1746144653.692861:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747401856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144653.692872:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3294:x1830964747402112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (111us total) trans 17179873158 rc 0/0 00000100:00100000:1.0:1746144653.692876:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11285 00000004:00080000:1.0:1746144653.692896:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d2bb80/2, rc 0, transno 17179873158 00000100:00100000:1.0:1746144653.692899:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747402112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144653.693939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.698580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.698634:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f445c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747399936:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144653.698675:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2e00/0xa7c849b16e018ecd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0fb expref: 10 pid: 14708 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746144653.698694:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e018ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0fb expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.698730:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3000, rc 0) 00000100:00100000:0.0:1746144653.698774:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28866:x1830964746443136:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 52085us (52195us total) trans 8589943828 rc 0/0 00000100:00100000:0.0:1746144653.698783:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9969 00000100:00100000:0.0:1746144653.702708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.702759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.703838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.703879:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746445312 00000100:00100000:1.0:1746144653.703884:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746445312 00000100:00100000:0.0:1746144653.703901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.704159:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746446080 00000100:00100000:1.0:1746144653.704162:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746446080 00000100:00100000:1.0:1746144653.704186:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11287 00000100:00100000:1.0:1746144653.704192:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746445312:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.704200:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.704209:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0200/0xa7c849b16e018f3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e133 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.704234:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.704236:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.704243:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0200/0xa7c849b16e018f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e133 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.704256:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0200/0xa7c849b16e018f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e133 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144653.704264:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0200, rc 0) 00000100:00100000:1.0:1746144653.704290:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746445312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 98us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.704296:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11287 00000100:00100000:0.0:1746144653.704559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.704667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.704895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.704987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.706458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.708257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.708299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.708432:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5592 00000100:00100000:1.0:1746144653.708445:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746446336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144653.708453:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144653.708464:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942f4800/0xa7c849b16e018e10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0d1 expref: 12 pid: 22208 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1746144653.708473:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942f4800/0xa7c849b16e018e10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0d1 expref: 11 pid: 22208 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1746144653.708491:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942f4800/0xa7c849b16e018e10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0d1 expref: 11 pid: 22208 timeout: 732 lvb_type: 1 00010000:00010000:1.0:1746144653.708499:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.708500:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.708504:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.708510:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.708541:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144653.708549:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747402624:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144653.708590:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144653.711122:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747402624:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144653.711168:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144653.711204:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746446336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2764us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.711214:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5592 00000100:00100000:0.0:1746144653.712718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.712753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.713999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.714888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.716170:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.717749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.718567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.718984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.719053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.720296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.727396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.728330:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746448000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8771us (9761us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144653.728338:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4210 00002000:00100000:0.0:1746144653.728347:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f5e1f80 x1830964746448000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.728357:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f5e1f80 with x1830964746448000 ext(1048576->2097151) 00002000:00010000:0.0:1746144653.728361:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f5e1f80 00000100:00100000:0.0:1746144653.735110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.739402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.746301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.755849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.756682:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746450176 00000100:00100000:0.0:1746144653.756686:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746450176 00002000:00100000:0.0:1746144653.756706:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2088959) req@ffff88012cef8700 x1830964746450176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.756714:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8700 with x1830964746450176 ext(1048576->2088959) 00010000:00010000:0.0:1746144653.756720:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 33 pid: 7257 timeout: 732 lvb_type: 0 00010000:00010000:0.0:1746144653.756730:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 33 pid: 7257 timeout: 732 lvb_type: 0 00002000:00010000:0.0:1746144653.756735:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cef8700 00000100:00100000:0.0:1746144653.756748:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 806 00000100:00100000:0.0:1746144653.756753:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746450176:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144653.757650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.766245:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746450176:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 9479us (9638us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746144653.766257:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 806 00002000:00100000:1.0:1746144653.766270:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2088959) req@ffff88012cef8700 x1830964746450176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:H/200/0 rc 1040384/1040384 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.766279:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8700 with x1830964746450176 ext(1048576->2088959) 00010000:00010000:1.0:1746144653.766290:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 35 pid: 7257 timeout: 732 lvb_type: 0 00010000:00010000:1.0:1746144653.766306:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c90dc00/0xa7c849b16e018f44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e15d expref: 35 pid: 7257 timeout: 732 lvb_type: 0 00002000:00010000:1.0:1746144653.766314:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cef8700 00000100:00100000:0.0:1746144653.770412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.772726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.774987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.778778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.778852:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746450816 00000100:00100000:1.0:1746144653.778862:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746450816 00002000:00100000:1.0:1746144653.778924:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee01c00 x1830964746450816/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.778934:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01c00 with x1830964746450816 ext(1048576->2097151) 00002000:00010000:1.0:1746144653.778940:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee01c00 00000100:00100000:1.0:1746144653.778956:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746451072 00000100:00100000:1.0:1746144653.778959:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746451072 00002000:00100000:1.0:1746144653.778972:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee03100 x1830964746451072/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.778977:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03100 with x1830964746451072 ext(1048576->2097151) 00002000:00010000:1.0:1746144653.778981:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee03100 00000100:00100000:1.0:1746144653.779019:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4216 00000100:00100000:1.0:1746144653.779026:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746451072:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144653.790530:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746451072:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11493us (11750us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144653.790542:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4216 00002000:00100000:1.0:1746144653.790552:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee03100 x1830964746451072/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.790561:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03100 with x1830964746451072 ext(1048576->2097151) 00002000:00010000:1.0:1746144653.790566:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee03100 00000100:00100000:0.0:1746144653.797277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.798129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.798168:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746451200 00000100:00100000:1.0:1746144653.798178:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746451200 00000100:00100000:1.0:1746144653.798251:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11299 00000100:00100000:1.0:1746144653.798261:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:28870:x1830964746451200:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.798280:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.798301:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0a00/0xa7c849b16e018f91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e187 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.798331:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18200/0xa7c849b16e018f75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e16b expref: 35 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.798340:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.798342:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144653.798346:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0a00/0xa7c849b16e018f91 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e187 expref: 20 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.798381:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18200/0xa7c849b16e018f75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e16b expref: 35 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.798393:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18200/0xa7c849b16e018f75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e16b expref: 35 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144653.798404:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747403264:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144653.798495:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144653.804209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.804341:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747403264:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144653.804377:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0a00/0xa7c849b16e018f91 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e187 expref: 20 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.804395:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0a00, rc 0) 00000100:00100000:1.0:1746144653.804441:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:28870:x1830964746451200:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6182us (7176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.804449:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11299 00000100:00100000:0.0:1746144653.811553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.812163:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746451712 00000100:00100000:1.0:1746144653.812174:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746451712 00000100:00100000:1.0:1746144653.812679:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11300 00000100:00100000:1.0:1746144653.812692:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28869:x1830964746451712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.812714:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.812734:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e018f98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e18e expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.812766:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.812768:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.812777:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e018f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e18e expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.812794:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e018f98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e18e expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.812806:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0600, rc 0) 00000100:00100000:1.0:1746144653.812880:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28869:x1830964746451712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 191us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.814161:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11300 00000100:00100000:0.0:1746144653.820800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.820862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.831544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.831591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.831631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.831676:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746452608 00000100:00100000:0.0:1746144653.831686:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746452608 00002000:00100000:0.0:1746144653.831735:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee01180 x1830964746452608/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.831745:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01180 with x1830964746452608 ext(3145728->4194303) 00002000:00010000:0.0:1746144653.831752:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee01180 00000100:00100000:0.0:1746144653.831768:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746452352 00000100:00100000:0.0:1746144653.831770:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746452352 00002000:00100000:0.0:1746144653.831782:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fd90000 x1830964746452352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.831789:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90000 with x1830964746452352 ext(2097152->3145727) 00002000:00010000:0.0:1746144653.831791:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd90000 00000100:00100000:0.0:1746144653.833410:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4219 00000100:00100000:0.0:1746144653.833422:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746452608:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144653.833507:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4221 00000100:00100000:1.0:1746144653.833521:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746452736:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144653.837460:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746452096:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15831us (16588us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144653.837472:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4218 00002000:00100000:0.0:1746144653.837483:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee02300 x1830964746452096/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144653.837492:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02300 with x1830964746452096 ext(2097152->3145727) 00002000:00010000:0.0:1746144653.837497:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee02300 00000100:00100000:0.0:1746144653.845325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.845369:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746453376 00000100:00100000:0.0:1746144653.845380:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746453376 00000100:00100000:0.0:1746144653.845424:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9975 00000100:00100000:0.0:1746144653.845432:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e327850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28874:x1830964746453376:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144653.845458:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144653.845482:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfe00/0xa7c849b16e018f9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e195 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.845604:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845618:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845630:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845643:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845648:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845657:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845768:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845777:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845783:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:0.0:1746144653.845793:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144653.845886:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845893:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845898:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845904:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009badf600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144653.845908:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845914:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845925:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144653.845928:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144653.845931:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.845940:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf600/0xa7c849b16e018fa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848280:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848295:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848302:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848308:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009badfc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144653.848312:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848319:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848333:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d300) 00010000:00010000:0.0:1746144653.848336:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144653.848340:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848345:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfc00/0xa7c849b16e018fad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144653.848416:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009badfe00/0xa7c849b16e018f9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e195 expref: 12 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.848431:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e195 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144653.848443:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144653.848445:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144653.848448:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009badf000, rc 0) 00000100:00100000:0.0:1746144653.849872:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e327850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:28874:x1830964746453376:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3088us (3205us total) trans 8589943832 rc 0/0 00000100:00100000:0.0:1746144653.849886:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9975 00000100:00100000:0.0:1746144653.853393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.853458:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746453504 00000100:00100000:1.0:1746144653.853469:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746453504 00000100:00100000:1.0:1746144653.853526:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11301 00000100:00100000:1.0:1746144653.853534:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:28869:x1830964746453504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144653.853551:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144653.853568:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0e00/0xa7c849b16e018fc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e19c expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.853602:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.853604:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144653.853610:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0e00/0xa7c849b16e018fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e19c expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.853629:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0e00/0xa7c849b16e018fc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e19c expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144653.853638:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0e00, rc 0) 00000100:00100000:1.0:1746144653.853680:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:28869:x1830964746453504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144653.853685:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11301 00000100:00100000:1.0:1746144653.856946:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746452736:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23421us (25303us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144653.856957:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4221 00002000:00100000:1.0:1746144653.856969:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fd91880 x1830964746452736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.856978:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91880 with x1830964746452736 ext(2097152->3145727) 00002000:00010000:1.0:1746144653.856982:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd91880 00000100:00100000:0.0:1746144653.861995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.862053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.862156:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746454016 00000100:00100000:1.0:1746144653.862160:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746454016 00002000:00100000:1.0:1746144653.862187:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd92300 x1830964746454016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/0 e 0 to 0 dl 1746144664 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.862195:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd92300 with x1830964746454016 ext(3145728->4194303) 00002000:00010000:1.0:1746144653.862198:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd92300 00000100:00100000:1.0:1746144653.862533:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4224 00000100:00100000:1.0:1746144653.862541:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746454016:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144653.869681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.884913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.886325:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746454016:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23782us (24269us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144653.886335:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4224 00002000:00100000:1.0:1746144653.886342:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd92300 x1830964746454016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:294/0 lens 488/440 e 0 to 0 dl 1746144664 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144653.886350:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd92300 with x1830964746454016 ext(3145728->4194303) 00002000:00010000:1.0:1746144653.886354:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd92300 00000100:00100000:0.0:1746144653.900338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144653.912119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.991937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144653.998677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.002198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144654.002706:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144654.004699:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144654.005354:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144654.007705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144654.008125:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144654.011700:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.013508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.014177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144654.014815:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144654.015541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.018727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.023407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.025788:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.025828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.030038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.030680:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746457216 00000100:00100000:1.0:1746144654.030688:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746457216 00002000:00100000:1.0:1746144654.030744:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2285568->2289663) req@ffff88013129ce00 x1830964746457216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.030766:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ce00 with x1830964746457216 ext(2285568->2289663) 00002000:00010000:1.0:1746144654.030770:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129ce00 00000100:00100000:1.0:1746144654.030802:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4229 00000100:00100000:1.0:1746144654.030809:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746457216:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144654.030991:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746457216:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 181us (956us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144654.030997:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4229 00002000:00100000:1.0:1746144654.031003:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2285568->2289663) req@ffff88013129ce00 x1830964746457216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/4536 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.031009:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ce00 with x1830964746457216 ext(2285568->2289663) 00002000:00010000:1.0:1746144654.031012:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129ce00 00000100:00100000:0.0:1746144654.031342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.034315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144654.034910:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144654.036255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.036286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.036379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.036380:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746457856 00000100:00100000:1.0:1746144654.036384:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746457856 00010000:00010000:1.0:1746144654.036406:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacc800/0xa7c849b16e018e1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0ca expref: 9 pid: 8388 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1746144654.036455:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5604 00000100:00100000:1.0:1746144654.036462:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746457728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144654.036474:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144654.036498:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e018f60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e141 expref: 17 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746144654.036509:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e018f60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e141 expref: 17 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746144654.036532:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edd2600/0xa7c849b16e018f60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e141 expref: 17 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:1.0:1746144654.036549:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144654.036582:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746457728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.036588:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5604 00000100:00100000:1.0:1746144654.036600:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5606 00000100:00100000:1.0:1746144654.036606:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746457984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144654.036613:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144654.036620:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c19c00/0xa7c849b16e018f7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e172 expref: 23 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.036629:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c19c00/0xa7c849b16e018f7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e172 expref: 23 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.036646:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c19c00/0xa7c849b16e018f7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e172 expref: 23 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.036654:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.036657:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.036663:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.036671:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.036702:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.036714:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747405312:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144654.036779:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.037811:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747405312:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144654.037826:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144654.037847:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746457984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1242us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.037852:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5606 00000100:00100000:0.0:1746144654.040803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.044968:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746458496 00000100:00100000:0.0:1746144654.044978:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746458496 00000100:00100000:0.0:1746144654.045032:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3996 00000100:00100000:0.0:1746144654.045041:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:28874:x1830964746458496:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:0.0:1746144654.045288:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:28874:x1830964746458496:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 247us (388us total) trans 8589943836 rc 0/0 00000100:00100000:0.0:1746144654.045295:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3996 00000100:00100000:1.0:1746144654.045422:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11307 00000100:00100000:1.0:1746144654.045437:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746458752:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.045444:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.045454:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01900f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e1cd expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.045494:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747405568:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144654.045553:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.048227:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747405568:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144654.048250:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01900f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1cd expref: 23 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.048257:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01900f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1cd expref: 23 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.048268:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0600, rc 0) 00000100:00100000:1.0:1746144654.048300:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746458752:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2870us (3313us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144654.048306:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11307 00000100:00100000:0.0:1746144654.056067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.056188:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746458880 00000100:00100000:1.0:1746144654.056206:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746458880 00000100:00100000:1.0:1746144654.056273:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11308 00000100:00100000:1.0:1746144654.056282:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:28884:x1830964746458880:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.056303:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.056325:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e1d4 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.056358:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.056371:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.056373:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.056377:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 23 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.056410:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.056423:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 15 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.056436:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747405696:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.056537:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.059373:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747405696:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.059410:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 23 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.059428:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0a00, rc 0) 00000100:00100000:1.0:1746144654.059472:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28884:x1830964746458880:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3191us (3415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.059480:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11308 00000100:00100000:0.0:1746144654.061819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.079717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.079790:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746459136 00000100:00100000:1.0:1746144654.079802:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746459136 00010000:00010000:1.0:1746144654.079946:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 18 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.079999:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5607 00000100:00100000:1.0:1746144654.080009:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746459136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144654.080024:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144654.080051:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 18 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.080064:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 18 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.080086:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f541a00/0xa7c849b16e018ff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b1 expref: 18 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.080121:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.080123:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.080130:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 22 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.080169:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 22 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.080204:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 22 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.080226:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747405824:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144654.081106:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.082656:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747405824:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144654.082679:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144654.082726:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746459136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2718us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.082737:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5607 00000100:00100000:0.0:1746144654.084929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.098547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.100333:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746459520 00000100:00100000:1.0:1746144654.100356:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746459520 00000100:00100000:1.0:1746144654.100426:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11309 00000100:00100000:1.0:1746144654.100435:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28884:x1830964746459520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.100457:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.100479:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e1db expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.100512:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.100520:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.100522:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.100525:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.100556:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.100568:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 16 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.100580:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747405952:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.101419:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.105536:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747405952:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.105579:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.105598:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0600, rc 0) 00000100:00100000:1.0:1746144654.105650:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28884:x1830964746459520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5216us (7113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.105660:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11309 00000100:00100000:0.0:1746144654.105924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.114873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.114943:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746459776 00000100:00100000:1.0:1746144654.114952:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746459776 00010000:00010000:1.0:1746144654.114995:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 19 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.116142:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5608 00000100:00100000:1.0:1746144654.116155:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746459776:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144654.116173:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144654.116199:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 19 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.116225:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 19 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.116248:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b061800/0xa7c849b16e019001 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1bf expref: 19 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.116276:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.116278:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.116289:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 23 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.116297:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 23 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.116330:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 23 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.116342:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747406080:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144654.116424:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.119783:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747406080:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144654.119836:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144654.120291:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746459776:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4138us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.120301:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5608 00000100:00100000:0.0:1746144654.123918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.143789:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.157092:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746461440 00000100:00100000:1.0:1746144654.157102:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746461440 00000100:00100000:1.0:1746144654.157168:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11310 00000100:00100000:1.0:1746144654.157176:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746461440:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.157192:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.157219:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e019039 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e1e9 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.157246:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.157249:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.157257:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e019039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1e9 expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.157273:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f1800/0xa7c849b16e019039 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1e9 expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.157284:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f1800, rc 0) 00000100:00100000:1.0:1746144654.157323:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746461440:12345-192.168.204.23@tcp:101:cat.0 Request processed in 148us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.157328:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11310 00000100:00100000:0.0:1746144654.157912:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746461824 00000100:00100000:0.0:1746144654.157917:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746461824 00000100:00100000:0.0:1746144654.158077:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11313 00000100:00100000:0.0:1746144654.158083:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746461824:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144654.158091:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.158099:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f333000/0xa7c849b16e01904e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e1fe expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.158125:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747406336:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144654.158176:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.163406:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747406336:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144654.163428:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f333000/0xa7c849b16e01904e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1fe expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.163437:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f333000/0xa7c849b16e01904e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1fe expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.163457:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f333000, rc 0) 00000100:00100000:1.0:1746144654.163478:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746461824:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5396us (5691us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144654.163484:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11313 00000100:00100000:0.0:1746144654.176396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.177439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.177532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.177578:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746462080 00000100:00100000:0.0:1746144654.177588:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746462080 00002000:00100000:0.0:1746144654.177643:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88013129d500 x1830964746462080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.177654:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129d500 with x1830964746462080 ext(4194304->4935679) 00002000:00010000:0.0:1746144654.177659:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013129d500 00000100:00100000:0.0:1746144654.177677:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746462592 00000100:00100000:0.0:1746144654.177680:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746462592 00002000:00100000:0.0:1746144654.177692:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88013129d880 x1830964746462592/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.177698:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129d880 with x1830964746462592 ext(1048576->2097151) 00002000:00010000:0.0:1746144654.177702:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129d880 00000100:00100000:0.0:1746144654.177714:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4238 00000100:00100000:0.0:1746144654.177720:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746462336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144654.193524:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746462336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15792us (16075us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144654.193540:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4238 00002000:00100000:1.0:1746144654.193553:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88013129c700 x1830964746462336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/440 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.193563:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129c700 with x1830964746462336 ext(1048576->2097151) 00002000:00010000:1.0:1746144654.193569:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129c700 00000100:00100000:0.0:1746144654.209266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.209307:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.210341:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11314 00000100:00100000:0.0:1746144654.210351:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746462720:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144654.210372:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.210391:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a2e7200/0xa7c849b16e019055 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e205 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.210449:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747406464:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144654.210551:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.210684:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11315 00000100:00100000:1.0:1746144654.210698:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746462848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.210707:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.210718:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d461600/0xa7c849b16e01905c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e20c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.210746:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747406592:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144654.210768:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.213667:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747406592:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144654.213706:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d461600/0xa7c849b16e01905c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e20c expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.213720:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d461600/0xa7c849b16e01905c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e20c expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.213735:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d461600, rc 0) 00000100:00100000:1.0:1746144654.213786:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746462848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3094us (4477us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144654.213794:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11315 00000100:00100000:0.0:1746144654.216910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.217337:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11316 00000100:00100000:1.0:1746144654.217350:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:28889:x1830964746462976:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.217369:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.217386:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e213 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.217414:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 36 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.217423:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.217425:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.217429:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.217457:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 36 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.217470:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 36 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.217482:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747406720:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.217553:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.221252:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747406720:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.221291:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.221311:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d460000, rc 0) 00000100:00100000:1.0:1746144654.221367:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:28889:x1830964746462976:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4022us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.221375:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11316 00000100:00100000:0.0:1746144654.240051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.240297:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746463232 00000100:00100000:1.0:1746144654.240308:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746463232 00010000:00010000:1.0:1746144654.240355:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 39 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.240944:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5609 00000100:00100000:1.0:1746144654.240955:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746463232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144654.240970:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144654.240996:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 39 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.241009:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 39 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.241033:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f541800/0xa7c849b16e018fec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1aa expref: 39 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.241782:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.241786:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.241796:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.241805:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.241846:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.241860:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747406848:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144654.241952:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.245601:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747406848:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144654.245635:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144654.245692:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746463232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4738us (5651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.245703:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5609 00000100:00100000:0.0:1746144654.249243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.261344:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.261442:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746463744 00000100:00100000:1.0:1746144654.261452:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746463744 00000100:00100000:1.0:1746144654.261509:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9978 00000100:00100000:1.0:1746144654.261517:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28892:x1830964746463744:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144654.261549:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.261569:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ea00/0xa7c849b16e01906a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e21a expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.261667:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.261682:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136933e00/0xa7c849b16e018f28 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e11e expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.261690:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e195 expref: 14 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.261701:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044e00/0xa7c849b16e018fde lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1a3 expref: 303 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.261706:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.261740:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044e00/0xa7c849b16e018fde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1a3 expref: 303 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.261752:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044e00/0xa7c849b16e018fde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1a3 expref: 303 pid: 14708 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.261765:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747406976:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.263769:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e195 expref: 14 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.263779:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009badf000/0xa7c849b16e018fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e195 expref: 14 pid: 14708 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.263788:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747407104:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.263821:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136933e00/0xa7c849b16e018f28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e11e expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.263827:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136933e00/0xa7c849b16e018f28 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e11e expref: 14 pid: 14709 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.263834:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747407232:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.263851:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.271393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.272515:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747406976:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.272525:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747407104:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.272530:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747407232:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144654.272817:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746464128 00000100:00100000:0.0:1746144654.272820:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746464128 00000100:00100000:0.0:1746144654.272858:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11317 00000100:00100000:0.0:1746144654.272865:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:28889:x1830964746464128:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144654.272873:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.272885:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a2e7200/0xa7c849b16e019086 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e228 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.272905:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.272918:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144654.272920:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144654.272923:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2e7200/0xa7c849b16e019086 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e228 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.272950:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.272961:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 23 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.272973:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747407360:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144654.273043:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746144654.273508:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144654.282554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.282597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.282718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.282719:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747407360:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.282752:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a2e7200/0xa7c849b16e019086 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e228 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.282765:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746464640 00010000:00010000:1.0:1746144654.282770:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a2e7200, rc 0) 00000100:00100000:0.0:1746144654.282771:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746464640 00002000:00100000:0.0:1746144654.282811:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2289663) req@ffff8800943f9f80 x1830964746464640/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144654.282812:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:28889:x1830964746464128:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9948us (10343us total) trans 0 rc 0/0 00002000:00100000:0.0:1746144654.282819:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9f80 with x1830964746464640 ext(2097152->2289663) 00000100:00100000:1.0:1746144654.282821:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11317 00010000:00010000:0.0:1746144654.282825:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 24 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.282834:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 24 pid: 7257 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746144654.282840:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943f9f80 00000100:00100000:1.0:1746144654.282873:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 812 00000100:00100000:1.0:1746144654.282886:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746464640:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:1.0:1746144654.283332:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.283339:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144654.283357:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144654.283953:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ea00/0xa7c849b16e01906a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e21a expref: 304 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.284090:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e21a expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.284096:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144654.284098:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746144654.284129:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f200, rc 0) 00000100:00100000:1.0:1746144654.284242:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28892:x1830964746463744:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 22725us (22907us total) trans 8589943839 rc 0/0 00000100:00100000:1.0:1746144654.284248:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9978 00000100:00100000:1.0:1746144654.292469:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746464640:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9580us (9740us total) trans 21474840409 rc 0/0 00000100:00100000:1.0:1746144654.292479:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 812 00002000:00100000:1.0:1746144654.292490:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2289663) req@ffff8800943f9f80 x1830964746464640/t21474840409(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/448 e 0 to 0 dl 1746144665 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.292500:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9f80 with x1830964746464640 ext(2097152->2289663) 00010000:00010000:1.0:1746144654.292510:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 26 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.292525:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f541c00/0xa7c849b16e018ffa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1b8 expref: 26 pid: 7257 timeout: 733 lvb_type: 0 00002000:00010000:1.0:1746144654.292531:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943f9f80 00000100:00100000:0.0:1746144654.296794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.307378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.307557:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746464896 00000100:00100000:1.0:1746144654.307565:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746464896 00000100:00100000:1.0:1746144654.307615:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11318 00000100:00100000:1.0:1746144654.307622:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:28892:x1830964746464896:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144654.307635:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.307650:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936dd200/0xa7c849b16e01909b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e22f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.307674:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.307681:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.307682:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.307686:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936dd200/0xa7c849b16e01909b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e22f expref: 39 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.307708:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.307717:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 19 pid: 8451 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.307727:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747407616:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.307799:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144654.314644:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747407616:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.314671:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936dd200/0xa7c849b16e01909b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e22f expref: 39 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.314685:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936dd200, rc 0) 00000100:00100000:1.0:1746144654.314726:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:28892:x1830964746464896:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7103us (7353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.314733:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11318 00000100:00100000:1.0:1746144654.314825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.314842:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746465152 00000100:00100000:1.0:1746144654.314847:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746465152 00002000:00100000:1.0:1746144654.314872:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f0c1180 x1830964746465152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.314882:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c1180 with x1830964746465152 ext(2097152->3145727) 00002000:00010000:1.0:1746144654.314885:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c1180 00000100:00100000:1.0:1746144654.314895:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4241 00000100:00100000:1.0:1746144654.314901:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746465152:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144654.315468:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746465664 00000100:00100000:0.0:1746144654.315471:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746465664 00002000:00100000:0.0:1746144654.315484:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012cefad80 x1830964746465664/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.315490:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefad80 with x1830964746465664 ext(3145728->4194303) 00010000:00010000:0.0:1746144654.315496:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 20 pid: 8451 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.315507:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d460000/0xa7c849b16e019063 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e213 expref: 20 pid: 8451 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746144654.315513:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cefad80 00000100:00100000:0.0:1746144654.315525:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 813 00000100:00100000:0.0:1746144654.315529:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746465664:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144654.332598:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.332717:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746465920 00000100:00100000:1.0:1746144654.332727:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746465920 00000100:00100000:1.0:1746144654.332764:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9980 00000100:00100000:1.0:1746144654.332770:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28897:x1830964746465920:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.332789:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.332803:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c6e00/0xa7c849b16e0190a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e236 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.332890:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.332900:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.332910:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.332923:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.332928:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.332933:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333017:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333025:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333030:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144654.333036:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144654.333098:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333105:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333110:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333115:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800920c7200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144654.333118:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333123:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333166:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144654.333169:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144654.333173:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333177:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c7200/0xa7c849b16e0190a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333836:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333843:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333848:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333852:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936dc800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144654.333854:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333858:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333866:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ee48300) 00010000:00010000:1.0:1746144654.333868:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144654.333870:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333874:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dc800/0xa7c849b16e0190b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.333909:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920c6e00/0xa7c849b16e0190a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e236 expref: 306 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.333920:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e236 expref: 305 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.333926:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144654.333928:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144654.333930:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5345600, rc 0) 00000100:00100000:1.0:1746144654.333953:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:28897:x1830964746465920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1183us (1356us total) trans 8589943840 rc 0/0 00000100:00100000:1.0:1746144654.333958:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9980 00000100:00100000:1.0:1746144654.335117:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746465152:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20211us (20287us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144654.335125:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4241 00002000:00100000:1.0:1746144654.335149:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f0c1180 x1830964746465152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/440 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.335157:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c1180 with x1830964746465152 ext(2097152->3145727) 00002000:00010000:1.0:1746144654.335160:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c1180 00000100:00100000:0.0:1746144654.336075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.337937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.338147:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746466304 00000100:00100000:0.0:1746144654.338152:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746466304 00000100:00100000:0.0:1746144654.338182:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3997 00000100:00100000:0.0:1746144654.338187:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b51a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:28897:x1830964746466304:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144654.338356:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b51a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:28897:x1830964746466304:12345-192.168.204.23@tcp:35:cat.0 Request processed in 167us (421us total) trans 8589943841 rc 0/0 00000100:00100000:0.0:1746144654.338362:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3997 00000100:00100000:1.0:1746144654.338988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.339453:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746466560 00000100:00100000:0.0:1746144654.339457:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746466560 00002000:00100000:0.0:1746144654.339481:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4112384->4116479) req@ffff88009f0c0e00 x1830964746466560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.339489:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c0e00 with x1830964746466560 ext(4112384->4116479) 00002000:00010000:0.0:1746144654.339493:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0c0e00 00000100:00100000:1.0:1746144654.339566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.339583:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746466688 00000100:00100000:1.0:1746144654.339585:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746466688 00000100:00100000:0.0:1746144654.340160:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4243 00000100:00100000:0.0:1746144654.340169:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746466560:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144654.340298:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746466560:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 130us (1310us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144654.340304:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4243 00002000:00100000:0.0:1746144654.340309:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4112384->4116479) req@ffff88009f0c0e00 x1830964746466560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/4536 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.340315:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c0e00 with x1830964746466560 ext(4112384->4116479) 00002000:00010000:0.0:1746144654.340318:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0c0e00 00000100:00100000:1.0:1746144654.341191:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11319 00000100:00100000:1.0:1746144654.341213:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:28889:x1830964746466688:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144654.341224:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.341243:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920c7200/0xa7c849b16e0190c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e23d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.341265:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936dd200/0xa7c849b16e01909b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e22f expref: 38 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.341272:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.341274:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.341277:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920c7200/0xa7c849b16e0190c5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e23d expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.341302:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936dd200/0xa7c849b16e01909b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e22f expref: 38 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.341313:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936dd200/0xa7c849b16e01909b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e22f expref: 38 pid: 8451 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.341323:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747407872:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.341389:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.342679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.343599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.343960:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747407872:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.343984:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920c7200/0xa7c849b16e0190c5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e23d expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.343994:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920c7200, rc 0) 00000100:00100000:1.0:1746144654.344015:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:28889:x1830964746466688:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2817us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.344020:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11319 00000100:00100000:0.0:1746144654.344693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.344728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.356114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.356230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.356312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.361802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.365832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.373908:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.373938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.373961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.374348:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746468352:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8184us (8526us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144654.374354:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4245 00002000:00100000:0.0:1746144654.374359:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800943f9500 x1830964746468352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/440 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.374365:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9500 with x1830964746468352 ext(3145728->4194303) 00002000:00010000:0.0:1746144654.374367:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9500 00000100:00100000:0.0:1746144654.374380:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4247 00000100:00100000:0.0:1746144654.374386:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746468864:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144654.380613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.382344:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746469376 00000100:00100000:0.0:1746144654.382355:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746469376 00002000:00100000:0.0:1746144654.382394:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3350528->4194303) req@ffff88009f0c1500 x1830964746469376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.382403:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c1500 with x1830964746469376 ext(3350528->4194303) 00002000:00010000:0.0:1746144654.382409:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c1500 00000100:00100000:0.0:1746144654.382436:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4249 00000100:00100000:0.0:1746144654.382443:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746469376:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144654.394705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.395164:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746469120:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19882us (21200us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144654.395175:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4248 00002000:00100000:0.0:1746144654.395183:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800943fb100 x1830964746469120/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/440 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.395190:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fb100 with x1830964746469120 ext(2097152->3145727) 00010000:00010000:0.0:1746144654.395195:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c90da00/0xa7c849b16e0190d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e24b expref: 28 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.395216:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c90da00/0xa7c849b16e0190d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3350527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e24b expref: 28 pid: 8388 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746144654.395221:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943fb100 00000100:00100000:0.0:1746144654.405013:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746470016 00000100:00100000:0.0:1746144654.405018:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746470016 00000100:00100000:0.0:1746144654.405051:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11324 00000100:00100000:0.0:1746144654.405058:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:28897:x1830964746470016:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144654.405070:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.405082:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c256000/0xa7c849b16e0190e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e260 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.405100:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144654.405102:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144654.405933:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c256000/0xa7c849b16e0190e8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e260 expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.406040:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c256000/0xa7c849b16e0190e8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e260 expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.406053:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c256000, rc 0) 00000100:00100000:0.0:1746144654.410676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.415681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.415718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.419299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.419326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.419959:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746470528 00000100:00100000:1.0:1746144654.419966:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746470528 00010000:00010000:1.0:1746144654.419991:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5115c00/0xa7c849b16e018e33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e0bc expref: 9 pid: 30345 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1746144654.420162:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746470656 00000100:00100000:1.0:1746144654.420166:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746470656 00010000:00010000:1.0:1746144654.420186:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1f0200/0xa7c849b16e018f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e133 expref: 21 pid: 8451 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746144654.424731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.424779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.424855:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746471424 00000100:00100000:1.0:1746144654.424860:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746471424 00002000:00100000:1.0:1746144654.424888:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f445500 x1830964746471424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.424895:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445500 with x1830964746471424 ext(2097152->3145727) 00002000:00010000:1.0:1746144654.424897:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f445500 00000100:00100000:1.0:1746144654.424907:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746471680 00000100:00100000:1.0:1746144654.424908:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746471680 00002000:00100000:1.0:1746144654.424917:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f444700 x1830964746471680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.424922:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444700 with x1830964746471680 ext(3145728->4194303) 00002000:00010000:1.0:1746144654.424925:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f444700 00000100:00100000:1.0:1746144654.424935:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4253 00000100:00100000:1.0:1746144654.424939:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746471424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144654.430346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.438506:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746471424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13560us (13770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144654.438519:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4253 00002000:00100000:1.0:1746144654.438527:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f445500 x1830964746471424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:295/0 lens 488/440 e 0 to 0 dl 1746144665 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.438535:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445500 with x1830964746471424 ext(2097152->3145727) 00002000:00010000:1.0:1746144654.438539:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f445500 00000100:00100000:0.0:1746144654.438970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.439644:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746472064 00000100:00100000:0.0:1746144654.439647:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746472064 00010000:00010000:0.0:1746144654.439662:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 30 pid: 10724 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.439694:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5623 00000100:00100000:0.0:1746144654.439700:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746472064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.439707:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.439715:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 30 pid: 10724 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.439724:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 30 pid: 10724 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.439736:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019016 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1d4 expref: 30 pid: 10724 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.439760:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.439762:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.439767:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.439773:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.439801:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.439811:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747409664:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144654.439853:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.444833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.444882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.460796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.460843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.469031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.469078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.486083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.486198:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746473472 00000100:00100000:1.0:1746144654.486217:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746473472 00000100:00100000:1.0:1746144654.487103:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9981 00000100:00100000:1.0:1746144654.487116:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:28902:x1830964746473472:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144654.487184:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.487214:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d460400/0xa7c849b16e019127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e29f expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.487282:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461400/0xa7c849b16e01912e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.487296:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461400/0xa7c849b16e01912e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.487307:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461400/0xa7c849b16e01912e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.487321:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461200/0xa7c849b16e019135 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.487326:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461200/0xa7c849b16e019135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.487331:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461200/0xa7c849b16e019135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144654.487707:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db31800/0xa7c849b16e01913c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144654.487718:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e21a expref: 305 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.487726:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc000/0xa7c849b16e01907f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e221 expref: 14 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.487736:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db31800/0xa7c849b16e01913c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144654.487770:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc000/0xa7c849b16e01907f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e221 expref: 14 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.487782:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc000/0xa7c849b16e01907f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e221 expref: 14 pid: 14708 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.487794:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f447b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747410560:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144654.488272:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e21a expref: 305 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.488280:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1f200/0xa7c849b16e019071 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e21a expref: 305 pid: 14709 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.488288:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747410688:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144654.488309:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.489890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.489934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.490167:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746473728 00000100:00100000:1.0:1746144654.490173:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746473728 00000100:00100000:1.0:1746144654.490228:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746473984 00000100:00100000:1.0:1746144654.490230:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746473984 00000100:00100000:0.0:1746144654.490243:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3998 00000100:00100000:0.0:1746144654.490250:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:7627:x1830964746473728:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144654.490265:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3999 00000100:00100000:1.0:1746144654.490270:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:23544:x1830964746473984:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746144654.490688:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:7627:x1830964746473728:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 438us (802us total) trans 8589943842 rc 0/0 00000100:00100000:0.0:1746144654.490694:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3998 00000100:00100000:1.0:1746144654.490737:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:23544:x1830964746473984:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 467us (802us total) trans 8589943843 rc 0/0 00000100:00100000:1.0:1746144654.490742:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3999 00000100:00100000:0.0:1746144654.492564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.492614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.498107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.498182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.498509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.500584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.500625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.500638:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746474496 00000100:00100000:0.0:1746144654.500643:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746474496 00000100:00100000:0.0:1746144654.500676:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746474752 00000100:00100000:0.0:1746144654.500678:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746474752 00000100:00100000:1.0:1746144654.500687:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11336 00000100:00100000:1.0:1746144654.500700:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746474496:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144654.500711:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.500722:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d461600/0xa7c849b16e019158 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e2ad expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.500740:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11337 00000100:00100000:0.0:1746144654.500745:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746474752:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144654.500753:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.500762:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e01915f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e2bb expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.500763:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747410944:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144654.500773:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.500774:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.500780:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e01915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2bb expref: 12 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.500792:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e01915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2bb expref: 12 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.500799:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177000, rc 0) 00000100:00100000:1.0:1746144654.500812:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.500815:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746474752:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.500823:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11337 00000100:00100000:1.0:1746144654.500835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.503842:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747410944:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144654.503882:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d461600/0xa7c849b16e019158 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2ad expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.503900:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d461600/0xa7c849b16e019158 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2ad expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.503925:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d461600, rc 0) 00000100:00100000:1.0:1746144654.503969:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746474496:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3275us (3388us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144654.503976:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11336 00000100:00100000:0.0:1746144654.509435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.514415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.517552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.523376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.526821:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746475904 00000100:00100000:1.0:1746144654.526830:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746475904 00000100:00100000:1.0:1746144654.526883:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11339 00000100:00100000:1.0:1746144654.526892:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746475904:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144654.526935:0:8388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.526954:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f14f800/0xa7c849b16e0190ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e267 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.526960:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.526962:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144654.526965:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.526998:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f14f800/0xa7c849b16e0190ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e267 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.527080:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f14f800/0xa7c849b16e0190ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e267 expref: 19 pid: 8388 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.527092:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747411200:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.527178:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.527684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.528106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.528163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.528176:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746476288 00000100:00100000:0.0:1746144654.528178:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746476288 00000100:00100000:0.0:1746144654.528195:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11343 00000100:00100000:0.0:1746144654.528212:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746476288:12345-192.168.204.23@tcp:1:mirror_io.0 00000100:00100000:1.0:1746144654.528289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.528302:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746476544 00000100:00100000:1.0:1746144654.528305:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746476544 00000100:00100000:1.0:1746144654.528324:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11344 00000100:00100000:1.0:1746144654.528329:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746476544:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144654.528344:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.528353:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.528359:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.528365:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c256000/0xa7c849b16e0190e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e260 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528682:0:22208:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f176400/0xa7c849b16e0191c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528693:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e018f83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e179 expref: 19 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528699:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e01915f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2bb expref: 12 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.528706:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2800/0xa7c849b16e018f8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e180 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528711:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.528713:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.528715:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f176400/0xa7c849b16e0191c1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528730:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2800/0xa7c849b16e018f8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e180 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528736:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2800/0xa7c849b16e018f8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e180 expref: 39 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.528744:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747411840:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144654.528769:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e01915f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2bb expref: 12 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.528775:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f177000/0xa7c849b16e01915f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2bb expref: 12 pid: 7257 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746144654.528780:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747411968:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144654.528795:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e018f83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e179 expref: 19 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.528801:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e018f83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e179 expref: 19 pid: 7257 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.528808:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747412096:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144654.528817:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746144654.528860:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.528861:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.528863:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.528877:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c256000/0xa7c849b16e0190e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e260 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.528887:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c256000/0xa7c849b16e0190e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e260 expref: 26 pid: 8451 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.528894:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747412224:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.528914:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.528920:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 12 pid: 4758 timeout: 733 lvb_type: 1 00000100:00100000:1.0:1746144654.528926:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747412352:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.528939:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.528944:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 20 pid: 8388 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.528949:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747412480:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.528959:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144654.529676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.529753:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747411200:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.529768:0:8388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.533331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.533348:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747411840:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144654.533357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.533361:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747411968:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.533402:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746477056 00000100:00100000:1.0:1746144654.533407:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746477056 00002000:00100000:1.0:1746144654.533448:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1433599) req@ffff88009b483800 x1830964746477056/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/0 e 0 to 0 dl 1746144665 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144654.533456:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483800 with x1830964746477056 ext(1048576->1433599) 00010000:00010000:1.0:1746144654.533462:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 21 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.533471:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 21 pid: 8388 timeout: 733 lvb_type: 0 00002000:00010000:1.0:1746144654.533477:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b483800 00000100:00100000:1.0:1746144654.533499:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 817 00000100:00100000:1.0:1746144654.533506:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746477056:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144654.533557:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747412096:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144654.533572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144654.533574:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f176400/0xa7c849b16e0191c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.533599:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747412224:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.533607:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747412352:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144654.533616:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747412480:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144654.533632:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.533867:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5628 00000100:00100000:0.0:1746144654.533879:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746477312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.533893:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.533913:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2800/0xa7c849b16e018f8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e180 expref: 40 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.533924:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd2800/0xa7c849b16e018f8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e180 expref: 40 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.533941:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2800/0xa7c849b16e018f8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e180 expref: 40 pid: 7257 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.533958:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.534126:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1962:x1830964746477312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 251us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.534158:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5628 00000100:00100000:1.0:1746144654.540283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.544245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.544265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.544278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.544293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.544309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.544328:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746477184 00000100:00100000:0.0:1746144654.544336:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746477184 00010000:00010000:0.0:1746144654.544370:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a2e6800/0xa7c849b16e019040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1f0 expref: 23 pid: 29370 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746144654.544393:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746477696 00000100:00100000:0.0:1746144654.544396:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746477696 00010000:00010000:0.0:1746144654.544407:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 13 pid: 4758 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746144654.544415:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746478080 00000100:00100000:0.0:1746144654.544417:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746478080 00010000:00010000:0.0:1746144654.544429:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacc400/0xa7c849b16e0190da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e252 expref: 39 pid: 8388 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.544437:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746476800 00000100:00100000:0.0:1746144654.544438:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746476800 00010000:00010000:0.0:1746144654.544445:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bade800/0xa7c849b16e01914a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2b4 expref: 14 pid: 29370 timeout: 733 lvb_type: 1 00000100:00100000:0.0:1746144654.544452:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746477568 00000100:00100000:0.0:1746144654.544454:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746477568 00010000:00010000:0.0:1746144654.544462:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 27 pid: 10724 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.544471:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5631 00000100:00100000:0.0:1746144654.544476:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746477184:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.544488:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.544508:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a2e6800/0xa7c849b16e019040 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1f0 expref: 23 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544523:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a2e6800/0xa7c849b16e019040 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1f0 expref: 23 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544542:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a2e6800/0xa7c849b16e019040 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1f0 expref: 23 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544559:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.544591:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746477184:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 115us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.544597:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5631 00000100:00100000:0.0:1746144654.544610:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5632 00000100:00100000:0.0:1746144654.544615:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746477696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.544621:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.544631:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 14 pid: 4758 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544640:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 14 pid: 4758 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544651:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009badf400/0xa7c849b16e019166 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2c9 expref: 14 pid: 4758 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544659:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.544672:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746477696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 57us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.544680:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5632 00000100:00100000:0.0:1746144654.544689:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5633 00000100:00100000:0.0:1746144654.544693:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746478080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.544701:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.544714:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dacc400/0xa7c849b16e0190da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e252 expref: 39 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.544721:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dacc400/0xa7c849b16e0190da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e252 expref: 39 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.544733:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacc400/0xa7c849b16e0190da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e252 expref: 39 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.544742:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.544756:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746478080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 62us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.544762:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5633 00000100:00100000:0.0:1746144654.544772:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5634 00000100:00100000:0.0:1746144654.544776:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1370050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746476800:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.544782:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.544789:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bade800/0xa7c849b16e01914a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2b4 expref: 12 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544796:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bade800/0xa7c849b16e01914a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2b4 expref: 12 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544810:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bade800/0xa7c849b16e01914a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2b4 expref: 12 pid: 29370 timeout: 733 lvb_type: 1 00010000:00010000:0.0:1746144654.544819:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.544835:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1370050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746476800:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 59us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.544841:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5634 00000100:00100000:0.0:1746144654.544871:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5635 00000100:00100000:0.0:1746144654.544876:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746477568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.544882:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.544889:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 27 pid: 10724 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.544897:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 27 pid: 10724 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.544907:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0600/0xa7c849b16e01901d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e1db expref: 27 pid: 10724 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.544916:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.544917:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.544922:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.544930:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.544954:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.544971:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746477568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 95us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.544976:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5635 00010000:00010000:0.0:1746144654.544994:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545002:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545021:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545029:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545041:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545047:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacdc00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144654.545051:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545058:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545071:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545077:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e0191a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.545115:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746476160:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 18194us (18376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.545124:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11340 00000100:00100000:0.0:1746144654.545159:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5637 00000100:00100000:0.0:1746144654.545165:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746478208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.545171:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.545179:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920c7200/0xa7c849b16e0190c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e23d expref: 21 pid: 8451 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.545187:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920c7200/0xa7c849b16e0190c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e23d expref: 21 pid: 8451 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.545198:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920c7200/0xa7c849b16e0190c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e23d expref: 21 pid: 8451 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.545217:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.545218:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.545221:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545231:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545244:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144654.545261:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746478208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.545267:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5637 00010000:00010000:0.0:1746144654.545286:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545292:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545304:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545308:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545313:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545318:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009badf800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144654.545320:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545328:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545336:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545341:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009badf800/0xa7c849b16e0191ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.545376:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746476416:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 17341us (17692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.545381:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11341 00000100:00100000:0.0:1746144654.545396:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746478336 00000100:00100000:0.0:1746144654.545399:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746478336 00010000:00010000:0.0:1746144654.545409:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 22 pid: 8388 timeout: 733 lvb_type: 0 00000100:00100000:0.0:1746144654.545433:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5638 00000100:00100000:0.0:1746144654.545437:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746478336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144654.545443:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144654.545450:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 22 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.545457:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 22 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.545471:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e0190e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e259 expref: 22 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.545478:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.545479:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.545482:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545488:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144654.545506:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144654.545519:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545527:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545538:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545544:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545550:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545554:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d461200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144654.545556:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545560:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545572:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.545578:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d461200/0xa7c849b16e0191ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144654.546954:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746478336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1510us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.546962:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5638 00000100:00100000:1.0:1746144654.548372:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746476544:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 20037us (20077us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.548382:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11344 00000100:00100000:0.0:1746144654.548995:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746477056:12345-192.168.204.23@tcp:4:cat.0 Request processed in 15488us (15674us total) trans 21474840411 rc 0/0 00000100:00100000:0.0:1746144654.549004:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 817 00002000:00100000:0.0:1746144654.549016:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1433599) req@ffff88009b483800 x1830964746477056/t21474840411(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:295/0 lens 488/448 e 0 to 0 dl 1746144665 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144654.549025:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483800 with x1830964746477056 ext(1048576->1433599) 00010000:00010000:0.0:1746144654.549035:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 21 pid: 8388 timeout: 733 lvb_type: 0 00010000:00010000:0.0:1746144654.549047:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009badfe00/0xa7c849b16e0190f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e26e expref: 21 pid: 8388 timeout: 733 lvb_type: 0 00002000:00010000:0.0:1746144654.549054:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b483800 00000100:00100000:0.0:1746144654.549507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144654.549797:0:8388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549806:0:8388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549825:0:8388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549833:0:8388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549840:0:8388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549847:0:8388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d460e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144654.549851:0:8388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549859:0:8388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549869:0:8388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.549874:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d460e00/0xa7c849b16e01919e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144654.550665:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746475904:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 23772us (23982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.550673:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11339 00000100:00100000:0.0:1746144654.553803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.559169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.559257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.559550:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746479232 00000100:00100000:1.0:1746144654.559558:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746479232 00000100:00100000:1.0:1746144654.559612:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4000 00000100:00100000:1.0:1746144654.559621:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:27485:x1830964746479232:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144654.559836:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:27485:x1830964746479232:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 216us (677us total) trans 8589943846 rc 0/0 00000100:00100000:1.0:1746144654.559844:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4000 00000100:00100000:1.0:1746144654.559865:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746478976 00000100:00100000:1.0:1746144654.559868:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746478976 00010000:00010000:1.0:1746144654.559884:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e236 expref: 306 pid: 14709 timeout: 733 lvb_type: 0 00000100:00100000:1.0:1746144654.559910:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5641 00000100:00100000:1.0:1746144654.559916:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1371850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:1961:x1830964746478976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144654.559925:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144654.559931:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e236 expref: 306 pid: 14709 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.559941:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e236 expref: 306 pid: 14709 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.559962:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5345600/0xa7c849b16e0190b7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e236 expref: 306 pid: 14709 timeout: 733 lvb_type: 0 00010000:00010000:1.0:1746144654.559973:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144654.559977:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115e00/0xa7c849b16e0191c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144654.559986:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144654.560001:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1371850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:1961:x1830964746478976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 85us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.560006:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5641 00000100:00100000:0.0:1746144654.560658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.560693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.561463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144654.561839:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115e00/0xa7c849b16e0191c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144654.561846:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115e00/0xa7c849b16e0191c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000040:00080000:0.0:1746144654.562501:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2849, 88 off237656 00000004:00080000:0.0:1746144654.562509:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771374385ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562566:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2776, 88 off231224 00000004:00080000:0.0:1746144654.562571:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771436397ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562582:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2777, 88 off231312 00000004:00080000:0.0:1746144654.562586:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771451750ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562610:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2850, 88 off237744 00000004:00080000:0.0:1746144654.562613:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771478372ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562621:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2851, 88 off237832 00000004:00080000:0.0:1746144654.562624:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771489087ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562632:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2778, 88 off231400 00000004:00080000:0.0:1746144654.562635:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771500196ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562640:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2779, 88 off231488 00000004:00080000:0.0:1746144654.562643:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771509012ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562649:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2780, 88 off231576 00000004:00080000:0.0:1746144654.562651:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771516937ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562656:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2852, 88 off237920 00000004:00080000:0.0:1746144654.562659:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771524208ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562665:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2781, 88 off231664 00000004:00080000:0.0:1746144654.562667:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771532545ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562672:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2853, 88 off238008 00000004:00080000:0.0:1746144654.562674:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771539886ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562681:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2782, 88 off231752 00000004:00080000:0.0:1746144654.562684:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771549052ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144654.562689:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2854, 88 off238096 00000004:00080000:0.0:1746144654.562691:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771556857ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562697:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2855, 88 off238184 00000004:00080000:0.0:1746144654.562700:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771565422ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562706:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2856, 88 off238272 00000004:00080000:0.0:1746144654.562708:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771574006ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562715:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2857, 88 off238360 00000004:00080000:0.0:1746144654.562717:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633771582938ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144654.562724:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2783, 88 off231840 00000004:00080000:0.0:1746144654.562726:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633771591495ns, next at 593480289301ns, rc = 0 00000004:00010000:1.0:1746144654.592694:0:14709:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b483480 reply state ffff88009b8f1000 transno 8589943847 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115e00/0xa7c849b16e0191c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144654.592712:0:14709:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746144654.592827:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:28902:x1830964746478848:12345-192.168.204.23@tcp:36:mirror_io.0 Request processed in 38834us (39026us total) trans 8589943847 rc 0/0 00000100:00100000:1.0:1746144654.592836:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9985 00000001:00080000:0.0:1746144654.593154:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943847 is committed 00000004:00080000:0.0:1746144654.593162:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1969 committed 00000004:00080000:0.0:1746144654.593169:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2039 committed 00000004:00080000:0.0:1746144654.593175:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2038 committed 00000004:00080000:0.0:1746144654.593176:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2037 committed 00000004:00080000:0.0:1746144654.593178:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2036 committed 00000004:00080000:0.0:1746144654.593179:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1968 committed 00000004:00080000:0.0:1746144654.593181:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2035 committed 00000004:00080000:0.0:1746144654.593183:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1967 committed 00000004:00080000:0.0:1746144654.593185:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2034 committed 00000004:00080000:0.0:1746144654.593187:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746144654.593188:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1965 committed 00000004:00080000:0.0:1746144654.593191:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1964 committed 00000004:00080000:0.0:1746144654.593193:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2033 committed 00000004:00080000:0.0:1746144654.593195:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2032 committed 00000004:00080000:0.0:1746144654.593196:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1963 committed 00000004:00080000:0.0:1746144654.593198:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1962 committed 00000004:00080000:0.0:1746144654.593212:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2031 committed 00000001:00080000:0.0:1746144654.593224:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943842 is committed 00000001:00080000:0.0:1746144654.593229:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943841 is committed 00000001:00080000:0.0:1746144654.593242:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943846 is committed 00000001:00080000:0.0:1746144654.593245:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943843 is committed 00000100:00100000:0.0:1746144654.593361:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747413504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.593412:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.593456:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747414016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.593473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.593491:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746144654.593495:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747413888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.593510:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.593529:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747413760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.593546:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.593563:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747414144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.593577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.593587:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746144654.593591:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747414272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.593603:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.593620:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414016 00000100:00100000:0.0:1746144654.593623:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414016 00000100:00100000:0.0:1746144654.593642:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747413888 00000100:00100000:0.0:1746144654.593644:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747413888 00000100:00100000:0.0:1746144654.593653:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747413760 00000100:00100000:0.0:1746144654.593655:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747413760 00000100:00100000:0.0:1746144654.593665:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414144 00000100:00100000:0.0:1746144654.593666:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414144 00000100:00100000:0.0:1746144654.593675:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414272 00000100:00100000:0.0:1746144654.593677:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414272 00000100:00100000:0.0:1746144654.593689:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11347 00000100:00100000:0.0:1746144654.593693:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3294:x1830964747413888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.593725:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11348 00000100:00100000:0.0:1746144654.593730:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3295:x1830964747413760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.593829:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3295:x1830964747413760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (281us total) trans 21474840413 rc 0/0 00000100:00100000:0.0:1746144654.593835:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11348 00000100:00100000:0.0:1746144654.593845:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11350 00000100:00100000:0.0:1746144654.593849:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830964747414272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.593926:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3295:x1830964747414272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (321us total) trans 17179873167 rc 0/0 00000100:00100000:0.0:1746144654.593932:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11350 00000100:00100000:0.0:1746144654.593940:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747413632 00000100:00100000:0.0:1746144654.593943:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747413632 00000100:00100000:0.0:1746144654.593955:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11351 00000100:00100000:0.0:1746144654.593959:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3296:x1830964747413632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.594001:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747414400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144654.594021:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144654.594032:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747414912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.594040:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3296:x1830964747413632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (114us total) trans 17179873168 rc 0/0 00000100:00100000:1.0:1746144654.594046:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.594046:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11351 00000100:00100000:1.0:1746144654.594053:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747415424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.594053:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414400 00000100:00100000:0.0:1746144654.594056:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414400 00000100:00100000:1.0:1746144654.594064:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144654.594300:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746144654.594306:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747414528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.594322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.594338:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414912 00000100:00100000:0.0:1746144654.594341:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414912 00000100:00100000:0.0:1746144654.594354:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747415424 00000100:00100000:0.0:1746144654.594356:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747415424 00000100:00100000:0.0:1746144654.594369:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11353 00000100:00100000:0.0:1746144654.594373:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747414912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.594486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.594504:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747414656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.594593:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747413888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 899us (1081us total) trans 17179873169 rc 0/0 00000100:00100000:0.0:1746144654.594598:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11347 00000100:00100000:1.0:1746144654.594769:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747415040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.594769:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.594783:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747415168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144654.594787:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.594802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746144654.594814:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c1f80/2, rc 0, transno 21474840414 00000100:00100000:1.0:1746144654.594818:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747414400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144654.594820:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a3800/2, rc 0, transno 17179873167 00000004:00080000:1.0:1746144654.594826:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c3800/2, rc 0, transno 21474840416 00000100:00100000:0.0:1746144654.594827:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747414272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.594828:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747414912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144654.594836:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c2a00/2, rc 0, transno 21474840413 00000100:00100000:0.0:1746144654.594838:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747413760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144654.594845:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f445180/2, rc 0, transno 17179873166 00000100:00100000:1.0:1746144654.594847:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414528 00000100:00100000:0.0:1746144654.594848:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747414144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.594850:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414528 00000100:00100000:0.0:1746144654.594868:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414656 00000100:00100000:1.0:1746144654.594870:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747415040 00000100:00100000:0.0:1746144654.594871:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414656 00000100:00100000:1.0:1746144654.594872:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747415040 00000100:00100000:1.0:1746144654.594880:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747415168 00000100:00100000:1.0:1746144654.594881:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747415168 00000100:00100000:0.0:1746144654.594886:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11355 00000100:00100000:0.0:1746144654.594890:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3293:x1830964747414528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.594891:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11356 00000100:00100000:1.0:1746144654.594895:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3293:x1830964747415040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.594922:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11357 00000100:00100000:0.0:1746144654.594926:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3295:x1830964747414656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144654.594987:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3293:x1830964747415040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (198us total) trans 17179873170 rc 0/0 00000100:00100000:1.0:1746144654.594993:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11356 00002000:00010000:0.0:1746144654.594998:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746144654.595001:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00000100:00100000:1.0:1746144654.595002:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11358 00002000:00010000:0.0:1746144654.595003:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144654.595005:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00000100:00100000:1.0:1746144654.595007:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3295:x1830964747415168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144654.595007:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144654.595030:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3295:x1830964747414656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (260us total) trans 21474840417 rc 0/0 00000100:00100000:0.0:1746144654.595035:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11357 00000004:00080000:0.0:1746144654.595056:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c3480/2, rc 0, transno 21474840417 00000100:00100000:0.0:1746144654.595059:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747414656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144654.595085:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3295:x1830964747415168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (281us total) trans 21474840418 rc 0/0 00000100:00100000:1.0:1746144654.595090:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11358 00000100:00100000:1.0:1746144654.595106:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746479744 00000100:00100000:1.0:1746144654.595108:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746479744 00000100:00100000:0.0:1746144654.595126:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3293:x1830964747414528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (802us total) trans 17179873171 rc 0/0 00000100:00100000:1.0:1746144654.595129:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9986 00000100:00100000:0.0:1746144654.595131:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11355 00000100:00100000:1.0:1746144654.595150:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28902:x1830964746479744:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144654.595165:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:0.0:1746144654.595170:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c3b80/2, rc 0, transno 21474840418 00000100:00100000:0.0:1746144654.595174:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747415168:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746144654.595179:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e2e5 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.595235:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2e5 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.595248:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2e5 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144654.595264:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144654.595267:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144654.595269:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f176c00, rc 0) 00000100:00100000:1.0:1746144654.595299:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28902:x1830964746479744:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 165us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.595305:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9986 00000004:00080000:1.0:1746144654.595392:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a3480/2, rc 0, transno 17179873171 00000100:00100000:1.0:1746144654.595396:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747414528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144654.595403:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a3b80/2, rc 0, transno 17179873170 00000100:00100000:1.0:1746144654.595406:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747415040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.595410:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144654.595417:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747415552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144654.595436:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144654.595451:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747414784 00000100:00100000:0.0:1746144654.595455:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747414784 00000100:00100000:0.0:1746144654.595468:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747415552 00000100:00100000:0.0:1746144654.595470:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747415552 00000100:00100000:0.0:1746144654.595479:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11359 00000100:00100000:0.0:1746144654.595484:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3296:x1830964747414784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144654.595569:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3296:x1830964747414784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (164us total) trans 17179873172 rc 0/0 00000100:00100000:0.0:1746144654.595575:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11359 00000100:00100000:0.0:1746144654.595584:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11361 00000100:00100000:0.0:1746144654.595588:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747415296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.595666:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3296:x1830964747415296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (218us total) trans 21474840419 rc 0/0 00000100:00100000:0.0:1746144654.595671:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11361 00000004:00080000:0.0:1746144654.595691:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a0000/2, rc 0, transno 17179873172 00000100:00100000:0.0:1746144654.595695:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747414784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144654.595701:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c3100/2, rc 0, transno 21474840419 00000100:00100000:0.0:1746144654.595704:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747415296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144654.596125:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e32300/2, rc 0, transno 17179873173 00000100:00100000:1.0:1746144654.596130:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747415552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144654.596169:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0c0a80/2, rc 0, transno 21474840415 00000100:00100000:1.0:1746144654.596172:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747415424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144654.598558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.604453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144654.604520:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746480000 00000100:00100000:1.0:1746144654.604530:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746480000 00000100:00100000:1.0:1746144654.604599:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11362 00000100:00100000:1.0:1746144654.604608:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746480000:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144654.604628:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144654.604648:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e2f3 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144654.604675:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d8f, atime: 0x68140d8e, ctime: 0x68140d8f, blocks: 0x805 00010000:00010000:1.0:1746144654.604695:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.604697:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144654.604707:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 9 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.604724:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 9 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144654.604734:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f176e00, rc 0) 00000100:00100000:1.0:1746144654.604796:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746480000:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 189us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144654.604805:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11362 00000100:00100000:0.0:1746144654.605046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.605840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.605899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.606260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.606495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144654.606792:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11365 00000100:00100000:0.0:1746144654.606799:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746480512:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144654.606807:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.606817:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e30f expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144654.606836:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d8f, atime: 0x68140d8e, ctime: 0x68140d8f, blocks: 0x15ed 00010000:00010000:0.0:1746144654.606845:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.606846:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.606850:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e30f expref: 11 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.606860:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e30f expref: 11 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.606867:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009badfe00, rc 0) 00000100:00100000:0.0:1746144654.606893:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746480512:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 95us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.606901:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11365 00000100:00100000:0.0:1746144654.606914:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11367 00000100:00100000:0.0:1746144654.606919:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746480640:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144654.606925:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144654.607752:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e316 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144654.607772:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d8f, atime: 0x68140d8e, ctime: 0x68140d8f, blocks: 0x1029 00010000:00010000:0.0:1746144654.607784:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.607785:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144654.607790:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 11 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.607804:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 11 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144654.607811:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009badf000, rc 0) 00000100:00100000:0.0:1746144654.608260:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746480640:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 1339us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144654.608266:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11367 00010000:00010000:1.0:1746144654.693405:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144655.622816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.623053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.623085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.623115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.623236:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746481152 00000100:00100000:0.0:1746144655.623294:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746481152 00000100:00100000:0.0:1746144655.624818:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4258 00000100:00100000:0.0:1746144655.624830:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746481152:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:0.0:1746144655.624849:0:1570:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.624857:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.624859:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.624862:0:1570:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.624871:0:1570:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144655.627848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.628703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.628738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.628785:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746481024 00000100:00100000:0.0:1746144655.628794:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746481024 00000100:00100000:0.0:1746144655.628852:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746481792 00000100:00100000:0.0:1746144655.628854:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746481792 00000100:00100000:0.0:1746144655.628867:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746481920 00000100:00100000:0.0:1746144655.628869:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746481920 00000100:00100000:0.0:1746144655.628883:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4261 00000100:00100000:0.0:1746144655.628889:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746481024:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:0.0:1746144655.628918:0:31506:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fabc200/0xa7c849b16e01922a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.628928:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.628930:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.628934:0:31506:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fabc200/0xa7c849b16e01922a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.628950:0:31506:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fabc200/0xa7c849b16e01922a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144655.630041:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4262 00000100:00100000:1.0:1746144655.630051:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746481792:12345-192.168.204.23@tcp:3:mirror_io.0 00010000:00010000:1.0:1746144655.630073:0:31505:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.630081:0:31505:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.630083:0:31505:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.630085:0:31505:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.630095:0:31505:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654174:0:1570:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654201:0:1570:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654210:0:1570:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654217:0:1570:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fabca00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144655.654222:0:1570:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654230:0:1570:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654252:0:1570:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.654258:0:1570:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fabca00/0xa7c849b16e019215 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144655.654356:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746481152:12345-192.168.204.23@tcp:3:mirror_io.0 Request processed in 29525us (31547us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144655.654366:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4258 00010000:00010000:1.0:1746144655.672451:0:31505:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.672460:0:31505:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.672465:0:31505:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.672470:0:31505:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cb39c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144655.672473:0:31505:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.672478:0:31505:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.672489:0:31505:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.672494:0:31505:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb39c00/0xa7c849b16e019231 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144655.672546:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746481792:12345-192.168.204.23@tcp:3:mirror_io.0 Request processed in 42496us (43843us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144655.672552:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4262 00000100:00100000:0.0:1746144655.681805:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:0.0:1746144655.682430:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144655.683729:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746482560 00000100:00100000:0.0:1746144655.683734:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746482560 00000100:00100000:0.0:1746144655.683778:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4001 00000100:00100000:0.0:1746144655.683785:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28902:x1830964746482560:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:0.0:1746144655.684053:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28902:x1830964746482560:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 267us (350us total) trans 8589943848 rc 0/0 00000100:00100000:0.0:1746144655.684063:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4001 00000100:00100000:0.0:1746144655.685293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144655.695730:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144655.702443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.705651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.706962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.707000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.707096:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746483200 00000100:00100000:1.0:1746144655.707106:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746483200 00000100:00100000:1.0:1746144655.707535:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746483328 00000100:00100000:1.0:1746144655.707539:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746483328 00000100:00100000:1.0:1746144655.707566:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11368 00000100:00100000:1.0:1746144655.707574:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+5:1963:x1830964746483200:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.707594:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.707611:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e324 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.707633:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.707635:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.707643:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 6 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.707658:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 6 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.707671:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944c8600, rc 0) 00000100:00100000:1.0:1746144655.708065:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+6:1963:x1830964746483200:12345-192.168.204.23@tcp:101:cat.0 Request processed in 491us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.708071:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11368 00000100:00100000:0.0:1746144655.708128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.708173:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.708203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.711813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.718392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.718480:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746484352 00000100:00100000:1.0:1746144655.718488:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746484352 00000100:00100000:1.0:1746144655.718536:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9990 00000100:00100000:1.0:1746144655.718545:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:28916:x1830964746484352:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.718569:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.718586:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9200/0xa7c849b16e0192a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e355 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.718698:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718710:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718718:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718732:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718736:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718741:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718844:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e0192b6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718851:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e0192b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718856:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e0192b6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144655.718864:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144655.718946:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718953:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718959:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718963:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944c8800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144655.718967:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718973:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718980:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144655.718982:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144655.718986:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.718991:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c8800/0xa7c849b16e0192a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719006:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719010:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719014:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719017:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800944c9a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144655.719019:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719022:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719027:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041500) 00010000:00010000:1.0:1746144655.719028:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144655.719030:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719034:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9a00/0xa7c849b16e0192af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144655.719067:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800944c9200/0xa7c849b16e0192a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e355 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.719076:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e0192b6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e355 expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.719082:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144655.719084:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144655.719086:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69200, rc 0) 00000100:00100000:1.0:1746144655.719110:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28916:x1830964746484352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 566us (720us total) trans 8589943851 rc 0/0 00000100:00100000:1.0:1746144655.719116:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9990 00000100:00100000:0.0:1746144655.727048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.727421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.727547:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746484992 00000100:00100000:1.0:1746144655.727551:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746484992 00002000:00100000:1.0:1746144655.727592:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920afb80 x1830964746484992/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.727603:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920afb80 with x1830964746484992 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.727608:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920afb80 00000100:00100000:1.0:1746144655.727641:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4265 00000100:00100000:1.0:1746144655.727649:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746484992:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144655.734732:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746485888 00000100:00100000:0.0:1746144655.734738:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746485888 00000100:00100000:0.0:1746144655.734770:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4003 00000100:00100000:0.0:1746144655.734776:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b518450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28916:x1830964746485888:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144655.734985:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b518450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28916:x1830964746485888:12345-192.168.204.23@tcp:35:cat.0 Request processed in 208us (1606us total) trans 8589943853 rc 0/0 00000100:00100000:0.0:1746144655.734992:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4003 00000100:00100000:0.0:1746144655.735108:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4268 00000100:00100000:0.0:1746144655.735116:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746485376:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144655.741723:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746484992:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14062us (14290us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144655.741735:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4265 00000100:00100000:0.0:1746144655.741741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:1.0:1746144655.741748:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920afb80 x1830964746484992/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.741757:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920afb80 with x1830964746484992 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.741763:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920afb80 00000100:00100000:0.0:1746144655.741783:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746486016 00000100:00100000:0.0:1746144655.741792:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746486016 00000100:00100000:0.0:1746144655.741827:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11374 00000100:00100000:0.0:1746144655.741836:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746486016:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144655.743552:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144655.743575:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e35c expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.743602:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.743604:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.743615:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.743630:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.743640:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009badf600, rc 0) 00000100:00100000:0.0:1746144655.743673:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746486016:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1838us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144655.743680:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11374 00000100:00100000:1.0:1746144655.744339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.744383:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746486144 00000100:00100000:0.0:1746144655.744390:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746486144 00000100:00100000:1.0:1746144655.744405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.744439:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11375 00000100:00100000:1.0:1746144655.744447:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746486144:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.744461:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.744472:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e363 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.744485:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.744486:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.744492:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.744503:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.744511:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f3e00, rc 0) 00000100:00100000:1.0:1746144655.744531:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746486144:12345-192.168.204.23@tcp:101:cat.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.744537:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11375 00000100:00100000:1.0:1746144655.751701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.751725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.751745:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746486272 00000100:00100000:1.0:1746144655.751755:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746486272 00000100:00100000:1.0:1746144655.751805:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746486400 00000100:00100000:1.0:1746144655.751808:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746486400 00000100:00100000:1.0:1746144655.751822:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11376 00000100:00100000:1.0:1746144655.751831:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746486272:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.751848:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.751865:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e36a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.751893:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.751895:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.751905:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 27 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.751920:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 27 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.751931:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f2a00, rc 0) 00000100:00100000:1.0:1746144655.751980:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746486272:12345-192.168.204.23@tcp:101:cat.0 Request processed in 150us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.751987:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11376 00000100:00100000:1.0:1746144655.752017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.752053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.752922:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746486656 00000100:00100000:0.0:1746144655.752932:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746486656 00000100:00100000:1.0:1746144655.752942:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11378 00000100:00100000:1.0:1746144655.752950:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746486528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.752958:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144655.752961:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11379 00010000:00010000:1.0:1746144655.752966:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e378 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144655.752967:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746486656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144655.752974:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.752978:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.752979:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.752982:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e37f expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.752984:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 21 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.752995:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 21 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.753002:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f3a00, rc 0) 00010000:00010000:0.0:1746144655.753005:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.753006:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.753011:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 28 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.753022:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 28 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144655.753024:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746486528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 75us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.753028:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11378 00010000:00010000:0.0:1746144655.753029:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c222e00, rc 0) 00000100:00100000:0.0:1746144655.753047:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746486656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 80us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144655.753052:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11379 00000100:00100000:0.0:1746144655.757210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.761073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.765522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.765564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.765592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.765607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.765713:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746487808 00000100:00100000:1.0:1746144655.765723:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746487808 00002000:00100000:1.0:1746144655.765771:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920af800 x1830964746487808/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.765781:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af800 with x1830964746487808 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.765786:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920af800 00000100:00100000:1.0:1746144655.765805:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746487552 00000100:00100000:1.0:1746144655.765808:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746487552 00002000:00100000:1.0:1746144655.765825:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880093e30a80 x1830964746487552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.765832:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30a80 with x1830964746487552 ext(0->1048575) 00002000:00010000:1.0:1746144655.765835:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30a80 00000100:00100000:1.0:1746144655.765846:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746488192 00000100:00100000:1.0:1746144655.765848:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746488192 00002000:00100000:1.0:1746144655.765859:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093e31c00 x1830964746488192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.765865:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31c00 with x1830964746488192 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.765869:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e31c00 00000100:00100000:1.0:1746144655.765877:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746488320 00000100:00100000:1.0:1746144655.765878:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746488320 00002000:00100000:1.0:1746144655.765888:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88008f33e300 x1830964746488320/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.765895:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33e300 with x1830964746488320 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.765897:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f33e300 00000100:00100000:1.0:1746144655.765908:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4269 00000100:00100000:1.0:1746144655.765915:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746487808:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144655.769788:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4272 00000100:00100000:0.0:1746144655.769801:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746488320:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144655.770434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.771389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.771410:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746488576 00000100:00100000:1.0:1746144655.771417:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746488576 00010000:00010000:1.0:1746144655.771447:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2e5 expref: 9 pid: 14709 timeout: 734 lvb_type: 0 00000100:00100000:1.0:1746144655.771473:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5647 00000100:00100000:1.0:1746144655.771479:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746488576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144655.771489:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144655.771496:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2e5 expref: 9 pid: 14709 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746144655.771507:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2e5 expref: 9 pid: 14709 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746144655.774039:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e0191cf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2e5 expref: 9 pid: 14709 timeout: 734 lvb_type: 0 00010000:00010000:1.0:1746144655.774068:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144655.774074:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144655.774084:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144655.774090:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144655.774097:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.775895:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144655.775966:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746488576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4483us (4575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.775977:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5647 00000100:00100000:0.0:1746144655.782590:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746487552:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 15663us (17010us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144655.782603:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4270 00002000:00100000:0.0:1746144655.782617:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880093e30a80 x1830964746487552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.782632:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30a80 with x1830964746487552 ext(0->1048575) 00002000:00010000:0.0:1746144655.782638:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30a80 00000100:00100000:1.0:1746144655.792021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.792976:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746488320:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 23179us (27366us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144655.792984:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4272 00002000:00100000:0.0:1746144655.792993:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88008f33e300 x1830964746488320/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.793002:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f33e300 with x1830964746488320 ext(1048576->2097151) 00002000:00010000:0.0:1746144655.793007:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f33e300 00000100:00100000:1.0:1746144655.793275:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746487808:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 27359us (27762us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144655.793281:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4269 00002000:00100000:1.0:1746144655.793287:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920af800 x1830964746487808/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.793295:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af800 with x1830964746487808 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.793298:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920af800 00000001:00080000:0.0:1746144655.806769:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943853 is committed 00000001:00080000:0.0:1746144655.806784:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943848 is committed 00000001:00080000:0.0:1746144655.806798:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943850 is committed 00000001:00080000:0.0:1746144655.806803:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943849 is committed 00000001:00080000:0.0:1746144655.806807:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943855 is committed 00000004:00080000:0.0:1746144655.806810:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1977 committed 00000004:00080000:0.0:1746144655.806821:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2048 committed 00000004:00080000:0.0:1746144655.806827:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2047 committed 00000004:00080000:0.0:1746144655.806829:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2046 committed 00000004:00080000:0.0:1746144655.806830:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2045 committed 00000004:00080000:0.0:1746144655.806832:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746144655.806833:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2044 committed 00000004:00080000:0.0:1746144655.806835:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746144655.806836:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2043 committed 00000004:00080000:0.0:1746144655.806838:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1974 committed 00000004:00080000:0.0:1746144655.806839:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1973 committed 00000004:00080000:0.0:1746144655.806841:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1972 committed 00000004:00080000:0.0:1746144655.806843:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2042 committed 00000004:00080000:0.0:1746144655.806844:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2041 committed 00000004:00080000:0.0:1746144655.806846:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1971 committed 00000004:00080000:0.0:1746144655.806850:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1970 committed 00000004:00080000:0.0:1746144655.806852:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2040 committed 00000001:00080000:0.0:1746144655.806857:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943852 is committed 00000100:00100000:0.0:1746144655.806998:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144655.807050:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.807074:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144655.807090:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.807105:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746144655.807109:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144655.807268:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747416704 00000100:00100000:0.0:1746144655.807271:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747416704 00000100:00100000:0.0:1746144655.807298:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747416576 00000100:00100000:0.0:1746144655.807300:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747416576 00000100:00100000:1.0:1746144655.807426:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747417600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144655.807446:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144655.807458:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144655.807469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144655.807479:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746144655.807482:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747417728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144655.807492:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144655.807499:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747418240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144655.807509:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144655.807522:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747416448 00000100:00100000:1.0:1746144655.807525:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747416448 00000100:00100000:0.0:1746144655.808244:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747416960 00000100:00100000:0.0:1746144655.808248:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747416960 00000100:00100000:1.0:1746144655.808261:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747418112 00000100:00100000:0.0:1746144655.808261:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747417600 00000100:00100000:0.0:1746144655.808262:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747417600 00000100:00100000:1.0:1746144655.808263:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747418112 00000100:00100000:0.0:1746144655.808275:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747417728 00000100:00100000:0.0:1746144655.808277:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747417728 00000100:00100000:1.0:1746144655.808413:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11381 00000100:00100000:0.0:1746144655.808417:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11382 00000100:00100000:1.0:1746144655.808418:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1830964747416064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144655.808421:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3294:x1830964747416576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144655.808458:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11383 00000100:00100000:1.0:1746144655.808463:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3294:x1830964747416448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144655.808572:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11384 00000100:00100000:1.0:1746144655.808576:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747416960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144655.808610:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747416576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (1489us total) trans 17179873174 rc 0/0 00000100:00100000:0.0:1746144655.808616:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11382 00000100:00100000:0.0:1746144655.808629:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11385 00000100:00100000:0.0:1746144655.808634:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747417600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144655.808655:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747416960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (1420us total) trans 17179873176 rc 0/0 00000100:00100000:1.0:1746144655.808660:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11384 00000100:00100000:1.0:1746144655.808677:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11386 00000100:00100000:1.0:1746144655.808680:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3294:x1830964747417088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144655.808732:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144655.808736:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144655 -> 1746144655 00002000:00010000:0.0:1746144655.808738:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144655.808740:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144655 -> 1746144655 00002000:00010000:0.0:1746144655.808741:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144655.808748:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747417088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1578us total) trans 17179873177 rc 0/0 00000100:00100000:1.0:1746144655.808753:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11386 00000100:00100000:0.0:1746144655.808757:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747417600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (1311us total) trans 21474840420 rc 0/0 00000100:00100000:0.0:1746144655.808762:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11385 00000100:00100000:1.0:1746144655.808764:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11387 00000100:00100000:1.0:1746144655.808768:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747418112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.808769:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11388 00000100:00100000:0.0:1746144655.808773:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747417728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809086:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809108:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.809121:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809157:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.809170:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144655.809186:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809205:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.809216:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809231:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746144655.809238:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cea00/2, rc 0, transno 21474840421 00000100:00100000:0.0:1746144655.809241:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747417856 00000100:00100000:1.0:1746144655.809244:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747418240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809244:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747417856 00000004:00080000:1.0:1746144655.809252:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1ce680/2, rc 0, transno 21474840420 00000100:00100000:1.0:1746144655.809254:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747417600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809255:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11391 00000100:00100000:0.0:1746144655.809259:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747417984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144655.809281:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144655.809283:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144655 -> 1746144655 00002000:00010000:1.0:1746144655.809286:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144655.809288:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144655 -> 1746144655 00002000:00010000:1.0:1746144655.809289:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5613 -> 5611 00000100:00100000:1.0:1746144655.809307:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3294:x1830964747416448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 844us (2092us total) trans 17179873175 rc 0/0 00000100:00100000:1.0:1746144655.809312:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11383 00000100:00100000:1.0:1746144655.809321:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11392 00000100:00100000:1.0:1746144655.809325:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3296:x1830964747417344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144655.809336:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3296:x1830964747417472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (227us total) trans 21474840422 rc 0/0 00000100:00100000:0.0:1746144655.809339:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3296:x1830964747417984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (181us total) trans 21474840423 rc 0/0 00000100:00100000:3.0:1746144655.809343:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11390 00000100:00100000:0.0:1746144655.809347:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11391 00000100:00100000:3.0:1746144655.809354:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11393 00000100:00100000:3.0:1746144655.809359:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747417856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.809366:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.809381:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416832:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144655.809392:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144655.809394:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144655 -> 1746144655 00002000:00010000:1.0:1746144655.809396:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00000100:00100000:0.0:1746144655.809396:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746144655.809398:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144655 -> 1746144655 00002000:00010000:1.0:1746144655.809399:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144655.809410:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873173 gen 2 00000100:00100000:1.0:1746144655.809415:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747417344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (209us total) trans 21474840424 rc 0/0 00000004:00080000:0.0:1746144655.809415:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920adc00, transno 17179873105 00000100:00100000:1.0:1746144655.809419:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11392 00000004:00080000:0.0:1746144655.809419:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e15180, transno 17179873106 00000004:00080000:0.0:1746144655.809422:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ee4700, transno 17179873107 00000004:00080000:0.0:1746144655.809424:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e15500, transno 17179873108 00000100:00100000:1.0:1746144655.809426:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747416192 00000004:00080000:0.0:1746144655.809427:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093762680, transno 17179873109 00000100:00100000:1.0:1746144655.809428:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747416192 00000004:00080000:0.0:1746144655.809430:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ad500, transno 17179873110 00000004:00080000:0.0:1746144655.809432:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51edf80, transno 17179873111 00000004:00080000:0.0:1746144655.809435:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920aed80, transno 17179873112 00000100:00100000:1.0:1746144655.809438:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747416832 00000004:00080000:0.0:1746144655.809438:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801309d4380, transno 17179873113 00000100:00100000:1.0:1746144655.809439:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747416832 00000004:00080000:0.0:1746144655.809440:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ee5500, transno 17179873114 00000004:00080000:0.0:1746144655.809443:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e0380, transno 17179873115 00000004:00080000:0.0:1746144655.809445:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ee5180, transno 17179873116 00000100:00100000:1.0:1746144655.809446:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11394 00000004:00080000:0.0:1746144655.809447:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e0700, transno 17179873117 00000100:00100000:1.0:1746144655.809450:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747416192:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144655.809450:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ee7480, transno 17179873118 00000004:00080000:0.0:1746144655.809452:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e0a80, transno 17179873119 00000004:00080000:0.0:1746144655.809454:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e0000, transno 17179873120 00000004:00080000:0.0:1746144655.809457:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e0e00, transno 17179873121 00000004:00080000:0.0:1746144655.809459:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1fce00, transno 17179873122 00000004:00080000:0.0:1746144655.809461:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1fed80, transno 17179873129 00000004:00080000:0.0:1746144655.809464:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebd500, transno 17179873130 00000004:00080000:0.0:1746144655.809466:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1fdc00, transno 17179873131 00000004:00080000:0.0:1746144655.809468:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebf100, transno 17179873132 00000004:00080000:0.0:1746144655.809471:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1fe680, transno 17179873133 00000004:00080000:0.0:1746144655.809474:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb48000, transno 17179873134 00000004:00080000:0.0:1746144655.809476:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebdc00, transno 17179873135 00000004:00080000:0.0:1746144655.809478:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb48380, transno 17179873136 00000004:00080000:0.0:1746144655.809480:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb48700, transno 17179873137 00000004:00080000:0.0:1746144655.809483:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e3800, transno 17179873141 00000004:00080000:0.0:1746144655.809485:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b812300, transno 17179873142 00000004:00080000:0.0:1746144655.809488:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e31500, transno 17179873143 00000004:00080000:0.0:1746144655.809490:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e1c00, transno 17179873144 00000004:00080000:0.0:1746144655.809493:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b811f80, transno 17179873145 00000004:00080000:0.0:1746144655.809495:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb4e00, transno 17179873146 00000004:00080000:0.0:1746144655.809498:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e1500, transno 17179873147 00000004:00080000:0.0:1746144655.809500:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f5e3100, transno 17179873148 00000004:00080000:0.0:1746144655.809503:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ee00a80, transno 17179873149 00000004:00080000:0.0:1746144655.809505:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d29c00, transno 17179873150 00000004:00080000:0.0:1746144655.809507:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d29500, transno 17179873151 00000004:00080000:0.0:1746144655.809509:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d2a680, transno 17179873152 00000004:00080000:0.0:1746144655.809511:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d29880, transno 17179873153 00000004:00080000:0.0:1746144655.809514:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d29f80, transno 17179873154 00000004:00080000:0.0:1746144655.809516:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d2ad80, transno 17179873155 00000004:00080000:0.0:1746144655.809518:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d2a300, transno 17179873156 00000004:00080000:0.0:1746144655.809520:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d2aa00, transno 17179873157 00000004:00080000:0.0:1746144655.809522:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d2bb80, transno 17179873158 00000004:00080000:0.0:1746144655.809524:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f445c00, transno 17179873165 00000004:00080000:0.0:1746144655.809526:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f445180, transno 17179873166 00000004:00080000:0.0:1746144655.809528:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a3800, transno 17179873167 00000004:00080000:0.0:1746144655.809531:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f444e00, transno 17179873168 00000004:00080000:0.0:1746144655.809532:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f446300, transno 17179873169 00000004:00080000:0.0:1746144655.809535:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a3b80, transno 17179873170 00000004:00080000:0.0:1746144655.809537:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a3480, transno 17179873171 00000004:00080000:0.0:1746144655.809539:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a0000, transno 17179873172 00000004:00080000:0.0:1746144655.809542:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e32300, transno 17179873173 00000100:00100000:0.0:1746144655.809548:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008f33c380 x1830964747416704/t17179873178(17179873178) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144671 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746144655.809556:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33c380/2, rc 0, transno 17179873178 00000100:00100000:0.0:1746144655.809560:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416704:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144655.810043:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144655.810045:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144655.810047:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144655.810049:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144655.810051:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144655.810069:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747416192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 618us (702us total) trans 17179873179 rc 0/0 00000100:00100000:1.0:1746144655.810073:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11394 00000100:00100000:1.0:1746144655.810080:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11395 00000100:00100000:1.0:1746144655.810084:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747416832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144655.810194:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747416832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (796us total) trans 17179873180 rc 0/0 00000100:00080000:3.0:1746144655.810197:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144655.810199:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11395 00000100:00080000:3.0:1746144655.810201:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746144655.810223:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33ea00/2, rc 0, transno 17179873175 00000100:00100000:1.0:1746144655.810226:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747416448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144655.810233:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33ed80/2, rc 0, transno 17179873176 00000100:00100000:1.0:1746144655.810236:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747416960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144655.810242:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33c700/2, rc 0, transno 17179873174 00000100:00100000:1.0:1746144655.810245:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747416576:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144655.810252:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33d880/2, rc 0, transno 17179873177 00000100:00100000:1.0:1746144655.810254:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747417088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144655.810278:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747417856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 919us (1046us total) trans 21474840425 rc 0/0 00000100:00100000:3.0:1746144655.810284:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11393 00000100:00100000:1.0:1746144655.810328:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3293:x1830964747418112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1559us (2857us total) trans 21474840426 rc 0/0 00000100:00100000:1.0:1746144655.810337:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11387 00000004:00080000:1.0:1746144655.810355:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cf480/2, rc 0, transno 21474840426 00000100:00100000:1.0:1746144655.810358:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144655.810428:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747416320:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.810438:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747417216:192.168.204.23@tcp:105: 00002000:00010000:1.0:1746144655.810441:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746144655.810443:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144655 -> 1746144655 00002000:00010000:1.0:1746144655.810445:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:1.0:1746144655.810447:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144655 -> 1746144655 00002000:00010000:1.0:1746144655.810448:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2057 00000100:00100000:1.0:1746144655.810465:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747416064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2047us (3415us total) trans 17179873181 rc 0/0 00000100:00100000:1.0:1746144655.810470:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11381 00000100:00100000:1.0:1746144655.810486:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746488832 00000100:00100000:1.0:1746144655.810489:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746488832 00000100:00100000:1.0:1746144655.810510:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4004 00000100:00100000:1.0:1746144655.810515:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28916:x1830964746488832:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:1.0:1746144655.810596:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28916:x1830964746488832:12345-192.168.204.23@tcp:49:cat.0 Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.810602:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4004 00010000:00010000:3.0:1746144655.810608:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019318 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 300 pid: 14710 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746144655.810624:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.810643:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273200, rc 0) 00000100:00100000:3.0:1746144655.810671:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28914:x1830964746487296:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 49376us (49607us total) trans 8589943855 rc 0/0 00000100:00100000:3.0:1746144655.810677:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9992 00000100:00100000:1.0:1746144655.810857:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746488960 00000100:00100000:1.0:1746144655.810860:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746488960 00000100:00100000:1.0:1746144655.810877:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4005 00000100:00100000:1.0:1746144655.810882:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28912:x1830964746488960:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:1.0:1746144655.810919:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28912:x1830964746488960:12345-192.168.204.23@tcp:49:cat.0 Request processed in 37us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.810923:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4005 00000004:00080000:1.0:1746144655.811409:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33d500/2, rc 0, transno 17179873179 00000100:00100000:1.0:1746144655.811414:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144655.811421:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33f100/2, rc 0, transno 17179873180 00000004:00080000:0.0:1746144655.811713:0:14755:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 2 in flight, 54 done 00000100:00100000:1.0:1746144655.811867:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144655.811887:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33ce00/2, rc 0, transno 17179873181 00000100:00100000:1.0:1746144655.811890:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747416064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144655.811900:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747418368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144655.811928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144655.811980:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747418368 00000100:00100000:0.0:1746144655.811999:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747418368 00000100:00100000:0.0:1746144655.812025:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11396 00000100:00100000:0.0:1746144655.812030:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747418368:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144655.812148:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cf100/2, rc 0, transno 21474840424 00000100:00100000:3.0:1746144655.812151:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417344:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144655.812159:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cdf80/2, rc 0, transno 21474840425 00000100:00100000:3.0:1746144655.812162:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144655.812171:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cc380/2, rc 0, transno 21474840422 00000100:00100000:3.0:1746144655.812173:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144655.812190:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cd180/2, rc 0, transno 21474840423 00000100:00100000:3.0:1746144655.812192:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747417984:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144655.812277:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144655.812279:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144655.812281:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144655.812283:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144655.812284:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144655.812307:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3293:x1830964747417728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3534us (4813us total) trans 21474840427 rc 0/0 00000100:00100000:3.0:1746144655.812311:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11388 00000004:00080000:1.0:1746144655.812365:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cc700/2, rc 0, transno 21474840427 00000100:00100000:1.0:1746144655.812369:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747417728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144655.812454:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747418368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 424us (524us total) trans 17179873182 rc 0/0 00000100:00100000:0.0:1746144655.812459:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11396 00000004:00080000:1.0:1746144655.812462:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920adc00/2, rc 0, transno 17179873182 00000100:00100000:1.0:1746144655.812465:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747418368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144655.818662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.818699:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.818877:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746489216 00000100:00100000:0.0:1746144655.818881:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746489216 00000100:00100000:3.0:1746144655.818913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.819071:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11397 00000100:00100000:0.0:1746144655.819079:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:28914:x1830964746489216:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144655.819089:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144655.819108:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3a2 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.819283:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e30f expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.819293:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.819304:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 7 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.819310:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.819312:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144655.819315:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.819343:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 7 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.819353:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 7 pid: 29370 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144655.819364:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747418496:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144655.820115:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.820125:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144655.820146:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747418624:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144655.820185:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e30f expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144655.820198:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e30f expref: 7 pid: 7257 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144655.820205:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747418752:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144655.820220:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144655.820372:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746489472 00000100:00100000:1.0:1746144655.820376:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746489472 00002000:00100000:1.0:1746144655.820407:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fb47800 x1830964746489472/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.820417:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb47800 with x1830964746489472 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.820421:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb47800 00000100:00100000:1.0:1746144655.820437:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4273 00000100:00100000:1.0:1746144655.820442:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746489472:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144655.821592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.821609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.821654:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747418496:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144655.821662:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747418624:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144655.821668:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747418752:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144655.821695:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144655.821708:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941ede00, rc 0) 00000100:00100000:0.0:1746144655.821744:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:28914:x1830964746489216:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2667us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144655.821751:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11397 00000100:00100000:0.0:1746144655.822557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.822623:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746489728 00000100:00100000:3.0:1746144655.822630:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746489728 00010000:00010000:3.0:1746144655.822658:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144655.822676:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746489600 00000100:00100000:3.0:1746144655.822678:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746489600 00010000:00010000:3.0:1746144655.822687:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 8 pid: 29370 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144655.822698:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746489856 00000100:00100000:3.0:1746144655.822699:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746489856 00010000:00010000:3.0:1746144655.822708:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009badfe00/0xa7c849b16e0191f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e30f expref: 8 pid: 7257 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144655.822720:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5648 00000100:00100000:3.0:1746144655.822726:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746489728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.822742:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.822762:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.822771:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.822793:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01930a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e378 expref: 22 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.822805:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.822826:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746489728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 101us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.822831:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5648 00000100:00100000:3.0:1746144655.822842:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5649 00000100:00100000:3.0:1746144655.822847:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:1962:x1830964746489600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.822853:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.822859:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 8 pid: 29370 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.822867:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 8 pid: 29370 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.822878:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb400/0xa7c849b16e019285 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e340 expref: 8 pid: 29370 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.824023:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.824059:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+7:1962:x1830964746489600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1210us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.824065:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5649 00000100:00100000:3.0:1746144655.824954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.825251:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746489984 00000100:00100000:1.0:1746144655.825258:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746489984 00000100:00100000:1.0:1746144655.825481:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11398 00000100:00100000:1.0:1746144655.825488:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+7:28910:x1830964746489984:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144655.825508:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.825526:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3a9 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.825553:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 6 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.825561:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.825567:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4272200/0xa7c849b16e01927e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e339 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.825573:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.825575:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.825578:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1155072->1789951] (req 1155072->1789951) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.825603:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4272200/0xa7c849b16e01927e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e339 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.825614:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4272200/0xa7c849b16e01927e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e339 expref: 8 pid: 8453 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.825626:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747419008:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144655.825680:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.825692:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 20 pid: 8451 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.825700:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747419136:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144655.825726:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 6 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.825733:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 6 pid: 8388 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.825741:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747419264:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144655.825759:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093410840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144655.825808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.826338:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746490240 00000100:00100000:0.0:1746144655.826343:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746490240 00002000:00100000:0.0:1746144655.826372:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3043328->3047423) req@ffff88013695ad80 x1830964746490240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.826381:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695ad80 with x1830964746490240 ext(3043328->3047423) 00002000:00010000:0.0:1746144655.826386:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695ad80 00000100:00100000:0.0:1746144655.826403:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4274 00000100:00100000:0.0:1746144655.826410:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746490240:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144655.826574:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746490240:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 165us (765us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144655.826581:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4274 00002000:00100000:0.0:1746144655.826586:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3043328->3047423) req@ffff88013695ad80 x1830964746490240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.826594:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695ad80 with x1830964746490240 ext(3043328->3047423) 00002000:00010000:0.0:1746144655.826596:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695ad80 00000100:00100000:0.0:1746144655.827858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.831745:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747419008:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144655.834059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.834125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.834168:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746490880 00000100:00100000:3.0:1746144655.834171:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746490880 00000100:00100000:0.0:1746144655.834174:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.834210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144655.834212:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 7 pid: 8388 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144655.834239:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5651 00000100:00100000:3.0:1746144655.834245:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746490880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.834262:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144655.834281:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747419136:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144655.834286:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 7 pid: 8388 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.834292:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747419264:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144655.834296:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 7 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.834318:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e019200 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e308 expref: 7 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144655.834325:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [1155072->1789951] (req 1155072->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.834335:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144655.834338:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf5fa00, rc 0) 00000100:00100000:3.0:1746144655.834369:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746490880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.834370:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+9:28910:x1830964746489984:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8882us (9419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.834377:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5651 00000100:00100000:1.0:1746144655.834377:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11398 00000100:00100000:3.0:1746144655.834388:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746490752 00000100:00100000:3.0:1746144655.834389:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746490752 00000100:00100000:1.0:1746144655.834390:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746491008 00000100:00100000:1.0:1746144655.834393:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746491008 00010000:00010000:3.0:1746144655.834397:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 21 pid: 8451 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144655.834409:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5652 00000100:00100000:1.0:1746144655.834410:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11399 00000100:00100000:3.0:1746144655.834413:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746490752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144655.834414:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:28914:x1830964746491008:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144655.834418:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.834424:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 21 pid: 8451 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144655.834425:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144655.834431:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 21 pid: 8451 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144655.834437:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3b0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.834440:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273000/0xa7c849b16e019303 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e371 expref: 21 pid: 8451 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.834445:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144655.834454:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144655.834460:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746490752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 47us (287us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144655.834462:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 29 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144655.834465:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5652 00010000:00010000:1.0:1746144655.834469:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01928c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e347 expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.834475:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.834476:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144655.834479:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.834751:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01928c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e347 expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.834762:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01928c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e347 expref: 24 pid: 8453 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.834778:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747419392:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144655.834828:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 29 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.834835:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 29 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.834844:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747419520:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144655.834863:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.834871:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 10 pid: 7257 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144655.834879:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747419776:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144655.834893:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093410840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144655.836885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.836900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.837788:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746490496:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 9800us (9932us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144655.837797:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4275 00002000:00100000:3.0:1746144655.837804:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920aed80 x1830964746490496/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.837812:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aed80 with x1830964746490496 ext(1048576->2097151) 00002000:00010000:3.0:1746144655.837817:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920aed80 00000100:00100000:3.0:1746144655.837841:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5654 00000100:00100000:3.0:1746144655.837850:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746491264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.837861:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.837878:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 29 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.837887:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 29 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.837908:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c222e00/0xa7c849b16e019311 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e37f expref: 29 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.837919:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.837934:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746491264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 88us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.837939:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5654 00000100:00100000:0.0:1746144655.838887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.838970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.839084:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746491392 00000100:00100000:3.0:1746144655.839089:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746491392 00010000:00010000:3.0:1746144655.839108:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144655.839155:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5656 00000100:00100000:3.0:1746144655.839162:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746491392:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.839172:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.839193:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.839285:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.839300:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009badf000/0xa7c849b16e019207 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e316 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144655.839311:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.839313:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.839349:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.839357:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.839502:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.839514:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747419904:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.839756:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144655.839816:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746491648 00000100:00100000:3.0:1746144655.839820:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746491648 00002000:00100000:3.0:1746144655.839849:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1155072->1159167) req@ffff88012d0c4700 x1830964746491648/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.839857:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4700 with x1830964746491648 ext(1155072->1159167) 00002000:00010000:3.0:1746144655.839862:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4700 00000100:00100000:3.0:1746144655.839874:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4276 00000100:00100000:3.0:1746144655.839879:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+7:1960:x1830964746491648:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144655.840387:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+7:1960:x1830964746491648:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 506us (1414us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144655.840394:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4276 00002000:00100000:3.0:1746144655.840400:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1155072->1159167) req@ffff88012d0c4700 x1830964746491648/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.840407:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4700 with x1830964746491648 ext(1155072->1159167) 00002000:00010000:3.0:1746144655.840409:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4700 00000100:00100000:0.0:1746144655.840890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.841065:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746491904 00000100:00100000:3.0:1746144655.841069:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746491904 00002000:00100000:3.0:1746144655.841091:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012d0c6300 x1830964746491904/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.841099:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6300 with x1830964746491904 ext(1048576->2097151) 00002000:00010000:3.0:1746144655.841103:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c6300 00000100:00100000:3.0:1746144655.841242:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4277 00000100:00100000:3.0:1746144655.841248:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746491904:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144655.842926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.843785:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747419904:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.843808:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.843846:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746491392:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4684us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.843855:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5656 00000100:00100000:3.0:1746144655.843889:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746492160 00000100:00100000:3.0:1746144655.843894:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746492160 00002000:00100000:3.0:1746144655.843927:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012d0c4e00 x1830964746492160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.843936:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4e00 with x1830964746492160 ext(1048576->2097151) 00002000:00010000:3.0:1746144655.843940:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c4e00 00000100:00100000:3.0:1746144655.844602:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4278 00000100:00100000:3.0:1746144655.844612:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746492160:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144655.846550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.846574:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746492416 00000100:00100000:1.0:1746144655.846581:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746492416 00002000:00100000:1.0:1746144655.846618:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2134016->2138111) req@ffff88013695a300 x1830964746492416/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.846627:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a300 with x1830964746492416 ext(2134016->2138111) 00002000:00010000:1.0:1746144655.846632:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695a300 00000100:00100000:1.0:1746144655.846650:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4279 00000100:00100000:1.0:1746144655.846656:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746492416:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144655.847511:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746492416:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 852us (965us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144655.847519:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4279 00002000:00100000:1.0:1746144655.847525:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2134016->2138111) req@ffff88013695a300 x1830964746492416/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/4536 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.847533:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a300 with x1830964746492416 ext(2134016->2138111) 00002000:00010000:1.0:1746144655.847536:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695a300 00000100:00100000:1.0:1746144655.850294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.850765:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746491904:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 9516us (9873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144655.850772:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4277 00002000:00100000:3.0:1746144655.850777:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012d0c6300 x1830964746491904/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.850784:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6300 with x1830964746491904 ext(1048576->2097151) 00002000:00010000:3.0:1746144655.850787:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c6300 00000100:00100000:0.0:1746144655.854676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.859427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.859511:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746492160:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14898us (16588us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144655.859521:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4278 00002000:00100000:0.0:1746144655.859534:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012d0c4e00 x1830964746492160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.859542:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4e00 with x1830964746492160 ext(1048576->2097151) 00002000:00010000:0.0:1746144655.859548:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c4e00 00000100:00100000:3.0:1746144655.863715:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747420032:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144655.863747:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 21 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.863771:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273c00, rc 0) 00000100:00100000:3.0:1746144655.863823:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:28916:x1830964746493056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4302us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.863831:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11400 00000100:00100000:0.0:1746144655.865776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.865894:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746493184 00000100:00100000:3.0:1746144655.865902:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746493184 00000100:00100000:3.0:1746144655.866357:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11401 00000100:00100000:3.0:1746144655.866366:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+7:28912:x1830964746493184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144655.866385:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144655.866403:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3be expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.866429:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144655.866434:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.866444:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.866454:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd200, rc 0) 00000100:00100000:3.0:1746144655.866505:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:28912:x1830964746493184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 141us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.866511:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11401 00000100:00100000:0.0:1746144655.869793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.882408:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746493440:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 12359us (12609us total) trans 17179873183 rc 0/0 00000100:00100000:3.0:1746144655.882425:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 818 00002000:00100000:3.0:1746144655.882437:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1155072->1789951) req@ffff88012d0c7b80 x1830964746493440/t17179873183(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/448 e 0 to 0 dl 1746144666 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.882447:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7b80 with x1830964746493440 ext(1155072->1789951) 00010000:00010000:3.0:1746144655.882457:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 10 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.882476:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 10 pid: 30345 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144655.882484:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d0c7b80 00000100:00100000:0.0:1746144655.885971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.886099:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746493568 00000100:00100000:3.0:1746144655.886109:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746493568 00010000:00010000:3.0:1746144655.886284:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 10 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144655.886326:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5657 00000100:00100000:3.0:1746144655.886334:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746493568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.886348:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144655.886369:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144654 -> 1746144656 00002000:00010000:3.0:1746144655.886372:0:16008:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144654 -> 1746144656 00010000:00010000:3.0:1746144655.886377:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 10 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.886389:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->1789951) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 10 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.886413:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fa00/0xa7c849b16e01933b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->1789951) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a9 expref: 10 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.886445:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.886447:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.886455:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.886464:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.886472:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.886473:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.886475:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.886482:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.886515:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.886526:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420160:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.886611:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.886625:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420288:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.886640:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144655.888441:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420160:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.888451:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420288:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.888477:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.888524:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746493568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2189us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.888533:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5657 00000100:00100000:0.0:1746144655.889811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.890092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.890165:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746493824 00000100:00100000:1.0:1746144655.890174:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746493824 00000100:00100000:3.0:1746144655.890190:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746494080 00000100:00100000:3.0:1746144655.890200:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746494080 00002000:00100000:1.0:1746144655.890231:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012d0c6680 x1830964746493824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.890241:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6680 with x1830964746493824 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.890247:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c6680 00002000:00100000:3.0:1746144655.890248:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012d0c5f80 x1830964746494080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.890256:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5f80 with x1830964746494080 ext(1048576->2097151) 00002000:00010000:3.0:1746144655.890261:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c5f80 00000100:00100000:1.0:1746144655.890280:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4281 00000100:00100000:1.0:1746144655.890287:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746493824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144655.890297:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4282 00000100:00100000:3.0:1746144655.890305:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746494080:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144655.905109:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746494080:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14797us (15008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144655.905119:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4282 00002000:00100000:3.0:1746144655.905286:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012d0c5f80 x1830964746494080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.905295:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5f80 with x1830964746494080 ext(1048576->2097151) 00002000:00010000:3.0:1746144655.905301:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c5f80 00000100:00100000:1.0:1746144655.909088:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746493824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 18790us (19275us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144655.909100:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4281 00002000:00100000:1.0:1746144655.909113:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012d0c6680 x1830964746493824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.909128:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6680 with x1830964746493824 ext(1048576->2097151) 00002000:00010000:1.0:1746144655.909153:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c6680 00000100:00100000:0.0:1746144655.919718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.919756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.920115:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746494464 00000100:00100000:0.0:1746144655.920118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.920125:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746494464 00000100:00100000:0.0:1746144655.920165:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746494592 00000100:00100000:0.0:1746144655.920168:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746494592 00002000:00100000:0.0:1746144655.920205:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3248128->4194303) req@ffff88012d0c4000 x1830964746494592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.920206:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3248127) req@ffff88012d0c4a80 x1830964746494464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 504/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.920215:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4a80 with x1830964746494464 ext(2097152->3248127) 00002000:00100000:0.0:1746144655.920215:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4000 with x1830964746494592 ext(3248128->4194303) 00002000:00010000:1.0:1746144655.920220:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4a80 00002000:00010000:0.0:1746144655.920220:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4000 00000100:00100000:0.0:1746144655.920239:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746494976 00000100:00100000:0.0:1746144655.920240:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746494976 00002000:00100000:0.0:1746144655.920250:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3186688->4194303) req@ffff88012d0c5880 x1830964746494976/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.920257:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5880 with x1830964746494976 ext(3186688->4194303) 00002000:00010000:0.0:1746144655.920259:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c5880 00000100:00100000:1.0:1746144655.920287:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4283 00000100:00100000:1.0:1746144655.920295:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746494592:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144655.920411:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4284 00000100:00100000:0.0:1746144655.920418:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746494464:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144655.920570:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4285 00000100:00100000:3.0:1746144655.920582:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746494976:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144655.922447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.922489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.922522:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746494848 00000100:00100000:0.0:1746144655.922529:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746494848 00002000:00100000:0.0:1746144655.922568:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2138112->3186687) req@ffff88008b9a3480 x1830964746494848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.922578:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3480 with x1830964746494848 ext(2138112->3186687) 00002000:00010000:0.0:1746144655.922583:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3480 00000100:00100000:0.0:1746144655.922608:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4286 00000100:00100000:0.0:1746144655.922615:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746494848:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144655.925190:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746495232 00000100:00100000:1.0:1746144655.925205:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746495232 00000100:00100000:1.0:1746144655.925247:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746495360 00000100:00100000:1.0:1746144655.925250:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746495360 00000100:00100000:1.0:1746144655.925275:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11402 00000100:00100000:1.0:1746144655.925282:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746495232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.925300:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.925318:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e019357 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3c5 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144655.925379:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747420416:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144655.927239:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093410c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144655.928543:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746494592:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8242us (8778us total) trans 0 rc 946176/946176 00000100:00100000:1.0:1746144655.928558:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4283 00002000:00100000:1.0:1746144655.928572:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3248128->4194303) req@ffff88012d0c4000 x1830964746494592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.928581:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4000 with x1830964746494592 ext(3248128->4194303) 00002000:00010000:1.0:1746144655.928587:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4000 00002000:00010000:1.0:1746144655.932419:0:22208:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144655 -> 1746144656 00002000:00010000:1.0:1746144655.932424:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144654 -> 1746144656 00002000:00010000:1.0:1746144655.932426:0:22208:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144655 -> 1746144656 00000100:00100000:1.0:1746144655.932440:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747420416:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144655.932474:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e019357 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3c5 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.932487:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920c6000/0xa7c849b16e019357 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3c5 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144655.932503:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920c6000, rc 0) 00000100:00100000:1.0:1746144655.932547:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746495232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7265us (10100us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144655.932554:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11402 00000100:00100000:0.0:1746144655.933113:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746494464:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12695us (13405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144655.933123:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4284 00002000:00100000:0.0:1746144655.933131:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3248127) req@ffff88012d0c4a80 x1830964746494464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 504/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144655.933202:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4a80 with x1830964746494464 ext(2097152->3248127) 00002000:00010000:0.0:1746144655.933208:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4a80 00000100:00100000:0.0:1746144655.935837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.935922:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746495488 00000100:00100000:1.0:1746144655.935932:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746495488 00000100:00100000:1.0:1746144655.935988:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11404 00000100:00100000:1.0:1746144655.935996:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:28912:x1830964746495488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.936015:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.936033:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3d3 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.936062:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.936070:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144655.936072:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144655.936075:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 10 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.936103:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.936115:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 20 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144655.936127:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747420672:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144655.936221:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093410c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144655.936388:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746494976:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15809us (16267us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746144655.936398:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4285 00002000:00100000:3.0:1746144655.936406:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3186688->4194303) req@ffff88012d0c5880 x1830964746494976/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.936415:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5880 with x1830964746494976 ext(3186688->4194303) 00002000:00010000:3.0:1746144655.936420:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c5880 00000100:00100000:1.0:1746144655.937921:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747420672:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144655.938736:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 10 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.938757:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380e00, rc 0) 00000100:00100000:1.0:1746144655.938776:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+10:28912:x1830964746495488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2781us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.938782:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11404 00000100:00100000:0.0:1746144655.938945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.943025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.943365:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746495744 00000100:00100000:1.0:1746144655.943374:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746495744 00000100:00100000:1.0:1746144655.943432:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11405 00000100:00100000:1.0:1746144655.943439:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28916:x1830964746495744:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.943455:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.943469:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3da expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.943491:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144655.943493:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144655.943496:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.943508:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.943518:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f381400, rc 0) 00000100:00100000:1.0:1746144655.943550:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28916:x1830964746495744:12345-192.168.204.23@tcp:101:cat.0 Request processed in 111us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144655.943556:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11405 00000100:00100000:0.0:1746144655.946710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.946824:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746495872 00000100:00100000:3.0:1746144655.946834:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746495872 00010000:00010000:3.0:1746144655.947008:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144655.947054:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5658 00000100:00100000:3.0:1746144655.947063:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746495872:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.947079:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.947102:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.947115:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.947188:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941ede00/0xa7c849b16e019334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3a2 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.947220:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.947222:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.947231:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.947240:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.947248:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.947249:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.947252:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.947259:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.947292:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.947304:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420800:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.947397:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.947405:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420928:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.947426:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144655.952200:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420800:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.952213:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747420928:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.952243:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.952298:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746495872:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5235us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.952309:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5658 00000100:00100000:0.0:1746144655.952530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.956646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.958122:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746496384 00000100:00100000:3.0:1746144655.958165:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746496384 00002000:00100000:3.0:1746144655.958232:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88013695aa00 x1830964746496384/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.958243:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695aa00 with x1830964746496384 ext(3145728->4194303) 00002000:00010000:3.0:1746144655.958248:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695aa00 00000100:00100000:3.0:1746144655.958285:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4288 00000100:00100000:3.0:1746144655.958295:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746496384:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144655.966965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.967247:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746496512 00000100:00100000:1.0:1746144655.967256:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746496512 00000100:00100000:1.0:1746144655.967469:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11406 00000100:00100000:1.0:1746144655.967478:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:28912:x1830964746496512:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144655.967495:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144655.967513:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3e1 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.967547:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.967554:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144655.967556:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144655.967560:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.967589:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 27 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144655.967601:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 27 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144655.967612:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747421056:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144655.967613:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746496384:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9320us (10978us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144655.967623:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4288 00002000:00100000:3.0:1746144655.967632:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88013695aa00 x1830964746496384/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.967640:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695aa00 with x1830964746496384 ext(3145728->4194303) 00002000:00010000:3.0:1746144655.967644:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695aa00 00000100:00100000:1.0:1746144655.967665:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093410180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144655.970024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.970121:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746496640 00000100:00100000:3.0:1746144655.970128:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746496640 00000100:00100000:1.0:1746144655.970164:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747421056:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144655.970203:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746144655.970211:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2138111) req@ffff8801309d4a80 x1830964746496640/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746144655.970219:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5114800, rc 0) 00002000:00100000:3.0:1746144655.970226:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4a80 with x1830964746496640 ext(2097152->2138111) 00010000:00010000:3.0:1746144655.970233:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 28 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.970245:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 28 pid: 30345 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144655.970252:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801309d4a80 00000100:00100000:0.0:1746144655.970281:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+23:28912:x1830964746496512:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2804us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144655.970289:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11406 00000100:00100000:3.0:1746144655.970536:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 820 00000100:00100000:3.0:1746144655.970544:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746496640:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144655.971713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.972715:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746496640:12345-192.168.204.23@tcp:4:cat.0 Request processed in 2170us (2698us total) trans 21474840428 rc 0/0 00000100:00100000:3.0:1746144655.972723:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 820 00002000:00100000:3.0:1746144655.972731:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2138111) req@ffff8801309d4a80 x1830964746496640/t21474840428(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/448 e 0 to 0 dl 1746144666 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.972739:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4a80 with x1830964746496640 ext(2097152->2138111) 00010000:00010000:3.0:1746144655.972745:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 31 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.972757:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 31 pid: 30345 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144655.972764:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801309d4a80 00000100:00100000:0.0:1746144655.976005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.976067:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746496896 00000100:00100000:3.0:1746144655.976078:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746496896 00010000:00010000:3.0:1746144655.976121:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 31 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144655.976206:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5659 00000100:00100000:3.0:1746144655.976215:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746496896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144655.976230:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144655.976254:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 31 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.976266:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 31 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.976288:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eb000/0xa7c849b16e019342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b0 expref: 31 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144655.976319:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.976321:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.976328:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.976336:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.976344:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.976345:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144655.976348:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.976358:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144655.976388:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.976400:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747421184:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.976481:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144655.976489:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747421312:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.976505:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144655.979006:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747421184:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144655.979020:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747421312:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144655.979050:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144655.979099:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746496896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2885us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144655.979109:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5659 00000100:00100000:0.0:1746144655.984276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.985420:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746497152 00000100:00100000:3.0:1746144655.985431:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746497152 00002000:00100000:3.0:1746144655.985490:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d4e00 x1830964746497152/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.985499:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4e00 with x1830964746497152 ext(3145728->4194303) 00002000:00010000:3.0:1746144655.985505:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d4e00 00000100:00100000:3.0:1746144655.985541:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4289 00000100:00100000:3.0:1746144655.985551:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746497152:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144655.986329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144655.986374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144655.986541:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746497408 00000100:00100000:1.0:1746144655.986549:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746497408 00002000:00100000:1.0:1746144655.986588:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8801309d5180 x1830964746497408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144655.986602:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5180 with x1830964746497408 ext(2097152->3145727) 00002000:00010000:1.0:1746144655.986607:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d5180 00000100:00100000:1.0:1746144655.986625:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4290 00000100:00100000:1.0:1746144655.986632:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746497408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144655.987098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144655.987288:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746497920 00000100:00100000:3.0:1746144655.987292:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746497920 00002000:00100000:3.0:1746144655.987315:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8801309d7480 x1830964746497920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/0 e 0 to 0 dl 1746144666 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.987323:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d7480 with x1830964746497920 ext(3145728->4194303) 00002000:00010000:3.0:1746144655.987326:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d7480 00000100:00100000:3.0:1746144655.987341:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4292 00000100:00100000:3.0:1746144655.987347:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746497920:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144655.996653:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746497152:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11094us (12378us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144655.996667:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4289 00002000:00100000:3.0:1746144655.996677:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d4e00 x1830964746497152/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144655.996686:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4e00 with x1830964746497152 ext(3145728->4194303) 00002000:00010000:3.0:1746144655.996694:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d4e00 00000100:00100000:0.0:1746144656.005041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.005755:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746498176 00000100:00100000:3.0:1746144656.005765:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746498176 00002000:00100000:3.0:1746144656.005834:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8801309d6d80 x1830964746498176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.005845:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d6d80 with x1830964746498176 ext(4194304->4935679) 00002000:00010000:3.0:1746144656.005850:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d6d80 00000100:00100000:3.0:1746144656.005883:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4293 00000100:00100000:3.0:1746144656.005895:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746498176:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.006106:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746497408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19464us (19776us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.006116:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4290 00002000:00100000:1.0:1746144656.006125:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8801309d5180 x1830964746497408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.006153:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5180 with x1830964746497408 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.006158:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d5180 00000100:00100000:0.0:1746144656.008407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.008727:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746498432 00000100:00100000:3.0:1746144656.008736:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746498432 00000100:00100000:3.0:1746144656.008793:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9995 00000100:00100000:3.0:1746144656.008804:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:28920:x1830964746498432:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.008821:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.008840:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8200/0xa7c849b16e019381 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3ef expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.008943:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.008956:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.008968:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.008981:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.008987:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.008992:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009087:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009093:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009099:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144656.009106:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144656.009207:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009213:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009218:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009223:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e9a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.009226:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009232:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009251:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144656.009254:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144656.009258:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.009263:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e019388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144656.009838:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746497920:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22489us (22738us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144656.009846:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4292 00002000:00100000:0.0:1746144656.009853:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8801309d7480 x1830964746497920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:296/0 lens 488/440 e 0 to 0 dl 1746144666 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.009861:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d7480 with x1830964746497920 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.009864:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d7480 00010000:00010000:3.0:1746144656.010086:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010092:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010101:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010105:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e8600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.010108:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010113:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010121:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33f00) 00010000:00010000:3.0:1746144656.010123:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144656.010125:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010130:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01938f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.010197:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8200/0xa7c849b16e019381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.010208:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.010214:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.010216:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144656.010218:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e9000, rc 0) 00000100:00100000:3.0:1746144656.010250:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:28920:x1830964746498432:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1450us (1852us total) trans 8589943857 rc 0/0 00000100:00100000:3.0:1746144656.010256:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9995 00000100:00100000:1.0:1746144656.014512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.015851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.016291:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746498816 00000100:00100000:3.0:1746144656.016298:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746498816 00000100:00100000:3.0:1746144656.016343:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9996 00000100:00100000:3.0:1746144656.016350:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:28921:x1830964746498816:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144656.016377:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.016397:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e0193a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3f6 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.016460:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016473:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016484:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016497:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016502:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016507:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016619:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016629:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.016635:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.016673:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.016683:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 10 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.016693:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747421440:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.016815:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.020363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.020490:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747421440:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.020523:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00080000:0.0:1746144656.020598:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144656.020742:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4294 00000100:00100000:2.0:1746144656.020754:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746499072:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.020785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.020855:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746499200 00000100:00100000:3.0:1746144656.020860:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746499200 00010000:00010000:3.0:1746144656.020886:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 11 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.020918:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5660 00000100:00100000:3.0:1746144656.020925:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746499200:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.020938:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.020943:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 11 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.020953:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 11 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.020976:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1bba00/0xa7c849b16e01929a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e34e expref: 11 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.021007:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.021012:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021021:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021027:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021043:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.021080:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746499200:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 155us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.021086:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5660 00010000:00010000:3.0:1746144656.021124:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021130:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144656.021203:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144656.021208:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144656.021225:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021234:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021284:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021291:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021297:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021303:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e8400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.021306:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021313:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021321:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144656.021324:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144656.021327:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021332:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e0193ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021341:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021350:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021355:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021358:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e9a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.021360:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021365:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021375:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33800) 00010000:00010000:3.0:1746144656.021376:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144656.021379:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021382:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e0193b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.021413:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e0193a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.021425:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.021431:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.021433:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144656.021435:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e9800, rc 0) 00000100:00100000:3.0:1746144656.021470:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28921:x1830964746498816:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5121us (5622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.021476:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9996 00000100:00100000:3.0:1746144656.027576:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746499072:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6814us (7215us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144656.027587:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4294 00002000:00100000:3.0:1746144656.027597:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a4b60380 x1830964746499072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.027605:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60380 with x1830964746499072 ext(4194304->4935679) 00002000:00010000:3.0:1746144656.027610:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b60380 00000100:00100000:0.0:1746144656.030812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.030884:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746499328 00000100:00100000:2.0:1746144656.030894:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746499328 00000100:00100000:2.0:1746144656.030990:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11408 00000100:00100000:2.0:1746144656.030996:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746499328:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144656.031009:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.031023:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e3fd expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.031043:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.031045:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.031053:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 7 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.031066:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 7 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.031074:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4df200, rc 0) 00000100:00100000:2.0:1746144656.031125:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746499328:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.031131:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11408 00000100:00100000:0.0:1746144656.031768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.031808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.031883:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746499456 00000100:00100000:1.0:1746144656.031890:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746499456 00000100:00100000:1.0:1746144656.031920:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746499584 00000100:00100000:1.0:1746144656.031922:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746499584 00000100:00100000:1.0:1746144656.031938:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11409 00000100:00100000:1.0:1746144656.031944:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746499456:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144656.031958:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.031972:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e404 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.031991:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.031993:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.032000:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.032014:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.032023:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1252a00, rc 0) 00000100:00100000:1.0:1746144656.032056:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746499456:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 112us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.032061:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11409 00000100:00100000:1.0:1746144656.032074:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11410 00000100:00100000:1.0:1746144656.032079:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746499584:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144656.032086:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.032097:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e40b expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.032107:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.032108:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.032113:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 11 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.032122:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 11 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.032129:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1253000, rc 0) 00000100:00100000:1.0:1746144656.032168:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746499584:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 88us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.032184:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11410 00000100:00100000:0.0:1746144656.038510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.039025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.039100:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746499840 00000100:00100000:1.0:1746144656.039110:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746499840 00000100:00100000:3.0:1746144656.039113:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746500096 00000100:00100000:3.0:1746144656.039124:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746500096 00000100:00100000:1.0:1746144656.039194:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4009 00000100:00100000:1.0:1746144656.039203:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:28912:x1830964746499840:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144656.039221:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9997 00000100:00100000:3.0:1746144656.039230:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28921:x1830964746500096:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144656.039247:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.039267:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c800/0xa7c849b16e0193d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e412 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.039344:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.039355:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.039361:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.039388:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.039398:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 8 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.039448:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:28912:x1830964746499840:12345-192.168.204.23@tcp:35:cat.0 Request processed in 245us (2884us total) trans 8589943859 rc 0/0 00000100:00100000:1.0:1746144656.039455:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4009 00000100:00100000:3.0:1746144656.039587:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747421568:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.039662:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.047344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.047405:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746500224 00000100:00100000:2.0:1746144656.047415:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746500224 00010000:00010000:2.0:1746144656.047458:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.047489:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5661 00000100:00100000:3.0:1746144656.047494:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747421568:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.047497:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746500224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.047513:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.047518:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.047525:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.047528:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.047556:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e0193b9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3f6 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.047585:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.047590:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.047600:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.047606:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.047623:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.047675:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746500224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 179us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.047682:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5661 00010000:00010000:3.0:1746144656.047794:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.047801:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144656.047820:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144656.047967:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c800/0xa7c849b16e0193d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.047984:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.047991:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.047993:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144656.047995:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009447c000, rc 0) 00000100:00100000:3.0:1746144656.048021:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28921:x1830964746500096:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 8792us (8996us total) trans 8589943860 rc 0/0 00000100:00100000:3.0:1746144656.048027:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9997 00000100:00100000:1.0:1746144656.050677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.050757:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746500352 00000100:00100000:3.0:1746144656.050765:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746500352 00000100:00100000:3.0:1746144656.050929:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9998 00000100:00100000:3.0:1746144656.050938:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28921:x1830964746500352:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144656.050962:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.050979:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c400/0xa7c849b16e0193ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e419 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.051060:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.051072:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.051079:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.051108:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.051119:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.051130:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747421696:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.051253:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.056640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.056760:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747421696:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.056798:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144656.056866:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746500480 00000100:00100000:1.0:1746144656.056873:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746500480 00010000:00010000:1.0:1746144656.056908:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 10 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.056984:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5662 00000100:00100000:1.0:1746144656.056992:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746500480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.057007:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.057012:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 10 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.057022:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 10 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.057044:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c000/0xa7c849b16e0193dc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e412 expref: 10 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.057203:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.057208:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.057218:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.057225:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.057321:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.057370:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746500480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 378us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.057376:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5662 00010000:00010000:3.0:1746144656.057435:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.057441:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144656.057484:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144656.057489:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144656.057504:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.057534:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447c400/0xa7c849b16e0193ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.057633:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.057640:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.057642:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144656.057645:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009447d600, rc 0) 00000100:00100000:3.0:1746144656.057667:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28921:x1830964746500352:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6731us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.057673:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9998 00000100:00100000:0.0:1746144656.061602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.061704:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746500736 00000100:00100000:3.0:1746144656.061712:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746500736 00000100:00100000:3.0:1746144656.061755:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9999 00000100:00100000:3.0:1746144656.061763:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28921:x1830964746500736:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144656.061781:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.061796:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d200/0xa7c849b16e0193f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e420 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.061870:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061883:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061891:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061901:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061910:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061915:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061920:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009447d400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.061923:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061928:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061936:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.061939:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144656.061941:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061946:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d400/0xa7c849b16e0193ff lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.061967:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d200/0xa7c849b16e0193f8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e420 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.061973:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d200/0xa7c849b16e0193f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e420 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.061979:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009447d200, rc 0) 00000100:00100000:3.0:1746144656.062028:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28921:x1830964746500736:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 265us (603us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144656.062033:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9999 00000100:00100000:0.0:1746144656.065394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.065593:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746500992 00000100:00100000:1.0:1746144656.065605:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746500992 00000100:00100000:1.0:1746144656.065682:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4010 00000100:00100000:1.0:1746144656.065693:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28921:x1830964746500992:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1746144656.066425:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28921:x1830964746500992:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 730us (1038us total) trans 8589943861 rc 0/0 00000100:00100000:1.0:1746144656.066433:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4010 00000100:00100000:0.0:1746144656.093822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.093903:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746501248 00000100:00100000:2.0:1746144656.093914:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746501248 00000100:00100000:2.0:1746144656.094004:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10000 00000100:00100000:2.0:1746144656.094013:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28927:x1830964746501248:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.094041:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.094061:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e019406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e427 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.094218:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094232:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094244:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094256:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094261:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094266:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00080000:0.0:1746144656.094292:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746144656.094445:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094453:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094459:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144656.094467:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144656.094550:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094557:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094563:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094568:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e9a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.094572:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094578:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094589:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144656.094591:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144656.094596:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094600:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9a00/0xa7c849b16e01940d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094630:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094635:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094640:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094644:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e8400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.094646:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094652:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094662:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639100) 00010000:00010000:2.0:1746144656.094664:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144656.094666:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094669:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e019414 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.094706:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e019406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.094717:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.094722:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.094725:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144656.094727:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e8800, rc 0) 00000100:00100000:2.0:1746144656.094791:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28927:x1830964746501248:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 778us (978us total) trans 8589943862 rc 0/0 00000100:00100000:2.0:1746144656.094798:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10000 00000100:00100000:0.0:1746144656.102889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.103018:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746501376 00000100:00100000:2.0:1746144656.103028:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746501376 00000100:00100000:2.0:1746144656.103072:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11411 00000100:00100000:2.0:1746144656.103079:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28927:x1830964746501376:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.103098:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.103121:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e42e expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.103195:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.103203:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.103209:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.103214:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.103215:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.103218:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3162112->3276799] (req 3162112->3276799) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.103246:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.103256:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.103266:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747421824:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.103365:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.103373:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 7 pid: 30345 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.103380:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747421952:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.103400:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.103407:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.103413:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747422080:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.103425:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.107085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.107205:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747421824:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.107218:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747421952:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.107225:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747422080:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.107233:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746501504 00000100:00100000:1.0:1746144656.107238:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746501504 00010000:00010000:2.0:1746144656.107260:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3162112->3276799] (req 3162112->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.107265:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 8 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.107277:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e8200, rc 0) 00000100:00100000:1.0:1746144656.107297:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5663 00000100:00100000:1.0:1746144656.107302:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746501504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.107314:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.107333:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 8 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.107344:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 8 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.107360:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e0193c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e404 expref: 8 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.107378:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.107400:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746501504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.107405:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5663 00000100:00100000:2.0:1746144656.107625:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28927:x1830964746501376:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4545us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.107633:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11411 00000100:00100000:0.0:1746144656.108714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.108933:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746501632 00000100:00100000:1.0:1746144656.108938:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746501632 00010000:00010000:1.0:1746144656.108956:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.109042:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5664 00000100:00100000:1.0:1746144656.109049:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746501632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.109060:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.109074:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.109084:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.109100:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f381400/0xa7c849b16e01936c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3da expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.109111:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.109169:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746501632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 120us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.109185:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5664 00000100:00100000:0.0:1746144656.109930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.111107:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746501760 00000100:00100000:3.0:1746144656.111116:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746501760 00010000:00010000:3.0:1746144656.111165:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 10 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.111210:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5665 00000100:00100000:3.0:1746144656.111218:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746501760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.111229:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.111252:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 10 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.111263:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 10 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.111284:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f380e00/0xa7c849b16e019365 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3d3 expref: 10 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.111310:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.111312:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.111320:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.111329:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.111362:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.111380:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747422208:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144656.111827:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.114762:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747422208:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144656.114793:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.114849:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746501760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3630us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.114858:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5665 00000100:00100000:0.0:1746144656.117117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.117260:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746502016 00000100:00100000:3.0:1746144656.117270:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746502016 00002000:00100000:3.0:1746144656.117325:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3162112->3166207) req@ffff88009ee0a300 x1830964746502016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.117335:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0a300 with x1830964746502016 ext(3162112->3166207) 00002000:00010000:3.0:1746144656.117341:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0a300 00000100:00100000:3.0:1746144656.117888:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4295 00000100:00100000:3.0:1746144656.117898:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746502016:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144656.118122:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746502016:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 225us (1012us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144656.118129:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4295 00002000:00100000:3.0:1746144656.118162:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3162112->3166207) req@ffff88009ee0a300 x1830964746502016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.118177:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0a300 with x1830964746502016 ext(3162112->3166207) 00002000:00010000:3.0:1746144656.118180:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0a300 00000100:00100000:0.0:1746144656.124756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.124827:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746502272 00000100:00100000:1.0:1746144656.124836:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746502272 00002000:00100000:1.0:1746144656.124879:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3272704->3276799) req@ffff88009ee08380 x1830964746502272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.124889:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08380 with x1830964746502272 ext(3272704->3276799) 00002000:00010000:1.0:1746144656.124894:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee08380 00000100:00100000:1.0:1746144656.125009:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4296 00000100:00100000:1.0:1746144656.125017:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746502272:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144656.125258:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746502272:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 240us (512us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144656.125263:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4296 00002000:00100000:1.0:1746144656.125269:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3272704->3276799) req@ffff88009ee08380 x1830964746502272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.125274:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08380 with x1830964746502272 ext(3272704->3276799) 00002000:00010000:1.0:1746144656.125276:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee08380 00000100:00100000:0.0:1746144656.128111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.128252:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746502528 00000100:00100000:1.0:1746144656.128262:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746502528 00000100:00100000:1.0:1746144656.128325:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4011 00000100:00100000:1.0:1746144656.128334:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28927:x1830964746502528:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144656.128582:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28927:x1830964746502528:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 248us (479us total) trans 8589943863 rc 0/0 00000100:00100000:1.0:1746144656.128589:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4011 00000100:00100000:0.0:1746144656.135114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.135194:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746502656 00000100:00100000:2.0:1746144656.135205:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746502656 00000100:00100000:2.0:1746144656.135251:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11412 00000100:00100000:2.0:1746144656.135258:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:28920:x1830964746502656:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.135279:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.135297:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e435 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.135328:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.135336:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144656.135338:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144656.135341:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 10 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.135369:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.135381:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 22 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.135394:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747422336:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.135490:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.140452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.140531:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747422336:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.140562:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 10 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.140581:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e8a00, rc 0) 00000100:00100000:2.0:1746144656.140627:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+10:28920:x1830964746502656:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5369us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.140636:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11412 00000100:00100000:3.0:1746144656.140694:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746502784 00000100:00100000:3.0:1746144656.140701:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746502784 00002000:00100000:3.0:1746144656.140743:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3162112->3276799) req@ffff88009ee0b800 x1830964746502784/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.140752:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b800 with x1830964746502784 ext(3162112->3276799) 00010000:00010000:3.0:1746144656.140759:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 23 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.140771:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 23 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.140777:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee0b800 00000100:00100000:3.0:1746144656.140807:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 821 00000100:00100000:3.0:1746144656.140814:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746502784:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1746144656.146586:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746502784:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 5761us (6135us total) trans 17179873185 rc 0/0 00000100:00100000:3.0:1746144656.146598:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 821 00002000:00100000:3.0:1746144656.146610:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3162112->3276799) req@ffff88009ee0b800 x1830964746502784/t17179873185(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.146619:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b800 with x1830964746502784 ext(3162112->3276799) 00010000:00010000:3.0:1746144656.146628:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.146644:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.146651:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee0b800 00000100:00100000:0.0:1746144656.147286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.147387:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746502912 00000100:00100000:3.0:1746144656.147395:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746502912 00000100:00100000:3.0:1746144656.147430:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11413 00000100:00100000:3.0:1746144656.147436:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746502912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.147462:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.147476:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2dca00/0xa7c849b16e019437 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e43c expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.147524:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747422464:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144656.148961:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.149211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.149306:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746503040 00000100:00100000:2.0:1746144656.149313:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746503040 00010000:00010000:2.0:1746144656.149344:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 27 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.149572:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5666 00000100:00100000:2.0:1746144656.149580:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746503040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.149594:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.149617:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 27 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.149628:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 27 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.149651:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.149653:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.149661:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.149669:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.149696:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.149706:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747422592:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.150030:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00010000:00010000:2.0:1746144656.150884:0:22208:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88009fb45f80 x1830964747422464) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 27 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.150905:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8200/0xa7c849b16e019429 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3162112->3276799) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e42e expref: 27 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.150919:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747422464:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144656.150950:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2dca00/0xa7c849b16e019437 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e43c expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.150962:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2dca00/0xa7c849b16e019437 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e43c expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.150969:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2dca00, rc 0) 00000100:00100000:2.0:1746144656.150998:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746502912:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3561us (3712us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144656.151005:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11413 00000100:00100000:0.0:1746144656.154845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.154991:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747422592:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.155011:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.155055:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746503040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5476us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.155065:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5666 00000100:00100000:3.0:1746144656.155229:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746503296 00000100:00100000:3.0:1746144656.155236:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746503296 00002000:00100000:3.0:1746144656.155284:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3117056->3121151) req@ffff88009ee09f80 x1830964746503296/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.155294:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09f80 with x1830964746503296 ext(3117056->3121151) 00002000:00010000:3.0:1746144656.155298:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09f80 00000100:00100000:3.0:1746144656.155416:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4297 00000100:00100000:3.0:1746144656.155423:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746503296:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144656.155957:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746503296:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 532us (1124us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144656.155963:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4297 00002000:00100000:3.0:1746144656.155969:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3117056->3121151) req@ffff88009ee09f80 x1830964746503296/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.155976:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09f80 with x1830964746503296 ext(3117056->3121151) 00002000:00010000:3.0:1746144656.155979:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09f80 00000100:00100000:0.0:1746144656.156685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.156805:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746503552 00000100:00100000:3.0:1746144656.156810:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746503552 00002000:00100000:3.0:1746144656.156836:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ee09880 x1830964746503552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.156848:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09880 with x1830964746503552 ext(0->1048575) 00002000:00010000:3.0:1746144656.156852:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09880 00000100:00100000:3.0:1746144656.157012:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4298 00000100:00100000:3.0:1746144656.157020:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746503552:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.157844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.158112:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746503680 00000100:00100000:2.0:1746144656.158117:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746503680 00000100:00100000:2.0:1746144656.158187:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11414 00000100:00100000:2.0:1746144656.158193:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+23:28920:x1830964746503680:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.158205:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.158222:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e443 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.158247:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.158255:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 10 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.158261:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.158266:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.158267:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.158270:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2969599] (req 2097152->2969599) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.158296:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.158307:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 29 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.158318:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747422720:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.158402:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 10 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.158410:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 10 pid: 30345 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.158417:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747422848:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.158444:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.158452:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.158460:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747422976:192.168.204.23@tcp:104: 00000100:00080000:0.0:1746144656.158505:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144656.158830:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.161976:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747422720:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.161990:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747422848:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.162883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.163439:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746503808 00000100:00100000:2.0:1746144656.163446:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746503808 00010000:00010000:2.0:1746144656.163483:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 11 pid: 30345 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.163525:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5667 00000100:00100000:2.0:1746144656.163534:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746503808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.163549:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.163575:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 11 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.163585:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 11 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.163606:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1253000/0xa7c849b16e0193ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e40b expref: 11 pid: 30345 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.163626:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.163667:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746503808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 135us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.163673:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5667 00000100:00100000:2.0:1746144656.164775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.164813:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747422976:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.164846:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2969599] (req 2097152->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.164860:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e8600, rc 0) 00000100:00100000:2.0:1746144656.164886:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:28920:x1830964746503680:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6694us (7044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.164893:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11414 00000100:00100000:3.0:1746144656.164930:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746503936 00000100:00100000:3.0:1746144656.164934:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746503936 00010000:00010000:3.0:1746144656.164966:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.165955:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5668 00000100:00100000:3.0:1746144656.165964:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746503936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.165977:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.165999:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.166010:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.166029:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed05000/0xa7c849b16e01937a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e8 expref: 30 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.166057:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.166083:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746503936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.166089:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5668 00000100:00080000:2.0:1746144656.166376:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144656.166687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.166719:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746504064 00000100:00100000:1.0:1746144656.166724:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746504064 00010000:00010000:1.0:1746144656.166739:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.166755:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5669 00000100:00100000:1.0:1746144656.166759:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746504064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.166766:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.166774:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.166782:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.166793:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5114800/0xa7c849b16e019373 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3e1 expref: 24 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.166803:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.166804:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.166812:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.166820:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.167490:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746503552:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10469us (10803us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.167498:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4298 00002000:00100000:3.0:1746144656.167506:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ee09880 x1830964746503552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.167515:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09880 with x1830964746503552 ext(0->1048575) 00002000:00010000:3.0:1746144656.167520:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09880 00010000:00010000:1.0:1746144656.167598:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.167611:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747423104:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144656.167679:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093410840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.171185:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747423104:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144656.171210:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.171265:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746504064:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4503us (4577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.171275:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5669 00000100:00100000:0.0:1746144656.181699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.181743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.181769:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746504320 00000100:00100000:3.0:1746144656.181779:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746504320 00000100:00100000:0.0:1746144656.181787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:3.0:1746144656.181828:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2965504->2969599) req@ffff88009ee0aa00 x1830964746504320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.181842:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0aa00 with x1830964746504320 ext(2965504->2969599) 00002000:00010000:3.0:1746144656.181847:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee0aa00 00000100:00100000:3.0:1746144656.181867:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4299 00000100:00100000:2.0:1746144656.181873:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746504576 00000100:00100000:3.0:1746144656.181874:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746504320:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144656.181877:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746504576 00000100:00100000:2.0:1746144656.181899:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746504448 00000100:00100000:2.0:1746144656.181901:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746504448 00000100:00100000:2.0:1746144656.181924:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11415 00000100:00100000:2.0:1746144656.181929:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746504576:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144656.181939:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.181955:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009945e200/0xa7c849b16e019445 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e451 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.182003:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747423232:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144656.182078:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11416 00000100:00100000:0.0:1746144656.182091:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746504448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144656.182098:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.182108:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5114800/0xa7c849b16e01944c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e44a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.182163:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747423360:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144656.182305:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.182363:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144656.182367:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746504320:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 492us (677us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144656.182375:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4299 00002000:00100000:3.0:1746144656.182386:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2965504->2969599) req@ffff88009ee0aa00 x1830964746504320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.182394:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0aa00 with x1830964746504320 ext(2965504->2969599) 00002000:00010000:3.0:1746144656.182397:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee0aa00 00000100:00100000:2.0:1746144656.184291:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747423360:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144656.184333:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5114800/0xa7c849b16e01944c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e44a expref: 25 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.184346:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5114800/0xa7c849b16e01944c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e44a expref: 25 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.184359:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5114800, rc 0) 00000100:00100000:2.0:1746144656.184400:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746504448:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2315us (2611us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144656.184408:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11416 00000100:00100000:2.0:1746144656.185505:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747423232:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144656.185523:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009945e200/0xa7c849b16e019445 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e451 expref: 30 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.185729:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009945e200/0xa7c849b16e019445 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e451 expref: 30 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.185738:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009945e200, rc 0) 00000100:00100000:2.0:1746144656.185774:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746504576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3844us (4029us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144656.185781:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11415 00000100:00100000:0.0:1746144656.187252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.187287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.187367:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746504960 00000100:00100000:1.0:1746144656.187374:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746504960 00000100:00100000:1.0:1746144656.187501:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4012 00000100:00100000:1.0:1746144656.187509:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:28920:x1830964746504960:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144656.187576:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746504704 00000100:00100000:2.0:1746144656.187580:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746504704 00000100:00100000:2.0:1746144656.187602:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11417 00000100:00100000:2.0:1746144656.187606:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28931:x1830964746504704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144656.187616:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.187631:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e458 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.187653:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.187660:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144656.187661:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144656.187664:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 25 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.187691:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 9 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.187706:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.187717:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747423488:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.187725:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:28920:x1830964746504960:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 217us (437us total) trans 8589943864 rc 0/0 00000100:00100000:1.0:1746144656.187731:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4012 00000100:00100000:2.0:1746144656.188487:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.189471:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747423488:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.189497:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 25 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.189511:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009945ee00, rc 0) 00000100:00100000:2.0:1746144656.189542:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:28931:x1830964746504704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1934us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.189547:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11417 00000100:00100000:1.0:1746144656.191465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.192097:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746505088 00000100:00100000:3.0:1746144656.192106:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746505088 00002000:00100000:3.0:1746144656.192226:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3117056->3145727) req@ffff880136958380 x1830964746505088/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.192237:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958380 with x1830964746505088 ext(3117056->3145727) 00010000:00010000:3.0:1746144656.192246:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 10 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.192260:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 10 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.192267:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136958380 00000100:00100000:3.0:1746144656.192341:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 822 00000100:00100000:3.0:1746144656.192349:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746505088:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1746144656.195388:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746505088:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 3027us (3917us total) trans 17179873186 rc 0/0 00000100:00100000:3.0:1746144656.195402:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 822 00002000:00100000:3.0:1746144656.195414:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3117056->3145727) req@ffff880136958380 x1830964746505088/t17179873186(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.195424:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958380 with x1830964746505088 ext(3117056->3145727) 00010000:00010000:3.0:1746144656.195434:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 12 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.195448:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 12 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.195456:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136958380 00000100:00100000:0.0:1746144656.197248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.197323:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746505216 00000100:00100000:1.0:1746144656.197331:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746505216 00010000:00010000:1.0:1746144656.197362:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 12 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.197395:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5670 00000100:00100000:1.0:1746144656.197404:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746505216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.197417:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.197440:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 12 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.197452:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 12 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.197479:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7e8a00/0xa7c849b16e019430 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e435 expref: 12 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.197497:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.197499:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.197507:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.197515:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.197550:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.197562:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747423616:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144656.197636:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.200189:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747423616:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144656.200226:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.200587:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746505216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3181us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.200599:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5670 00000100:00100000:0.0:1746144656.200817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.200863:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746505472 00000100:00100000:3.0:1746144656.200871:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746505472 00002000:00100000:3.0:1746144656.200919:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009ee0bb80 x1830964746505472/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.200929:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0bb80 with x1830964746505472 ext(2097152->3145727) 00002000:00010000:3.0:1746144656.200934:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0bb80 00000100:00100000:3.0:1746144656.200951:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4300 00000100:00100000:3.0:1746144656.200958:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746505472:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144656.210697:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746505472:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9726us (9866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.210709:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4300 00002000:00100000:3.0:1746144656.210723:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009ee0bb80 x1830964746505472/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.210733:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0bb80 with x1830964746505472 ext(2097152->3145727) 00002000:00010000:3.0:1746144656.210740:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0bb80 00000100:00100000:0.0:1746144656.215685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.215723:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746505600 00000100:00100000:2.0:1746144656.215876:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746505600 00000100:00100000:2.0:1746144656.215923:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11418 00000100:00100000:2.0:1746144656.215931:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:28931:x1830964746505600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144656.215949:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.215969:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e45f expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.216001:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.216020:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144656.216022:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144656.216025:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 30 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.216056:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.216067:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 22 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.216080:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747423744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.216198:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.218940:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747423744:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.218968:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 30 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.218984:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009945fe00, rc 0) 00000100:00100000:2.0:1746144656.219037:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:28931:x1830964746505600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3106us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.219045:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11418 00000100:00100000:0.0:1746144656.222765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.222877:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746505728 00000100:00100000:3.0:1746144656.222888:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746505728 00002000:00100000:3.0:1746144656.222941:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2969599) req@ffff8800a51ece00 x1830964746505728/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.222952:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ece00 with x1830964746505728 ext(2097152->2969599) 00010000:00010000:3.0:1746144656.222963:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 23 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.222978:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 23 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.222991:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51ece00 00000100:00100000:3.0:1746144656.223011:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 823 00000100:00100000:3.0:1746144656.223018:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746505728:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1746144656.237345:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746505728:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 14316us (14580us total) trans 21474840429 rc 0/0 00000100:00100000:3.0:1746144656.237357:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 823 00002000:00100000:3.0:1746144656.237369:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2969599) req@ffff8800a51ece00 x1830964746505728/t21474840429(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.237378:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ece00 with x1830964746505728 ext(2097152->2969599) 00010000:00010000:3.0:1746144656.237389:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.237405:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.237412:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a51ece00 00000100:00100000:1.0:1746144656.240591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.240653:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746505856 00000100:00100000:0.0:1746144656.240666:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746505856 00010000:00010000:0.0:1746144656.240709:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.240749:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5671 00000100:00100000:0.0:1746144656.240758:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746505856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.240774:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.240799:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.240810:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.240830:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01943e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2969599) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e443 expref: 25 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.240846:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.240847:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.240853:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.240861:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.240891:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 29 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.240902:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747423872:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144656.240971:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.246306:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747423872:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144656.246334:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.246392:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746505856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5634us (5812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.246402:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5671 00000100:00100000:0.0:1746144656.257070:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.257096:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.257125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.257166:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746506112 00000100:00100000:0.0:1746144656.257185:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746506112 00002000:00100000:0.0:1746144656.257236:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a51ef100 x1830964746506112/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.257247:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ef100 with x1830964746506112 ext(2097152->3145727) 00002000:00010000:0.0:1746144656.257252:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ef100 00000100:00100000:0.0:1746144656.257272:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746506368 00000100:00100000:0.0:1746144656.257275:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746506368 00000100:00100000:3.0:1746144656.257285:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746506496 00000100:00100000:3.0:1746144656.257289:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746506496 00002000:00100000:0.0:1746144656.257289:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a51ed880 x1830964746506368/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.257296:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed880 with x1830964746506368 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.257300:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ed880 00002000:00100000:3.0:1746144656.257305:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a51ed180 x1830964746506496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.257310:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed180 with x1830964746506496 ext(3145728->4194303) 00000100:00100000:0.0:1746144656.257311:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4301 00002000:00010000:3.0:1746144656.257312:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ed180 00000100:00100000:0.0:1746144656.257318:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746506112:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144656.257323:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4302 00000100:00100000:3.0:1746144656.257327:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746506368:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144656.257334:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4303 00000100:00100000:2.0:1746144656.257344:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746506496:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.259657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.259820:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746506880 00000100:00100000:3.0:1746144656.259828:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746506880 00000100:00100000:3.0:1746144656.259865:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10001 00000100:00100000:3.0:1746144656.259872:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28934:x1830964746506880:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.259892:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.259910:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e466 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.260009:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.260023:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.260030:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.260036:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.260066:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.260079:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 303 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.260090:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747424000:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.260185:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.260193:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 8 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.260200:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747424128:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.260217:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.263512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.263539:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746507136 00000100:00100000:1.0:1746144656.263548:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746507136 00000100:00100000:1.0:1746144656.263591:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10002 00000100:00100000:1.0:1746144656.263600:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:28937:x1830964746507136:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.263626:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.263646:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e01946f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e46d expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.263748:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.263761:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.263771:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.263782:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.263786:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.263790:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264012:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019484 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264022:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019484 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264029:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019484 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144656.264038:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:2.0:1746144656.264086:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746506368:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6755us (6986us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144656.264096:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4302 00002000:00100000:2.0:1746144656.264106:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a51ed880 x1830964746506368/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.264115:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed880 with x1830964746506368 ext(3145728->4194303) 00002000:00010000:2.0:1746144656.264119:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ed880 00010000:00010000:1.0:1746144656.264119:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264126:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264149:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264155:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144656.264159:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264165:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264186:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144656.264189:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144656.264192:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264198:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5800/0xa7c849b16e019476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264206:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264215:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264219:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264223:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144656.264225:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264230:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264235:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041d00) 00010000:00010000:1.0:1746144656.264237:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144656.264240:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264245:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01947d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144656.264276:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e01946f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e46d expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.264287:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019484 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e46d expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.264294:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.264296:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144656.264300:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5c00, rc 0) 00000100:00100000:1.0:1746144656.264469:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:28937:x1830964746507136:12345-192.168.204.23@tcp:101:cat.0 Request processed in 870us (965us total) trans 8589943865 rc 0/0 00000100:00100000:1.0:1746144656.264477:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10002 00000100:00100000:0.0:1746144656.268393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.268421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.268442:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746507264 00000100:00100000:0.0:1746144656.268450:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746507264 00010000:00010000:0.0:1746144656.268483:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.268509:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746507392 00000100:00100000:0.0:1746144656.268511:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746507392 00010000:00010000:0.0:1746144656.268521:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.268535:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5672 00000100:00100000:0.0:1746144656.268543:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746507264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.268557:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.268563:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.268573:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.268595:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144656.268600:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.268608:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.268614:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.268652:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746507264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.268659:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5672 00000100:00100000:0.0:1746144656.268673:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5673 00000100:00100000:0.0:1746144656.268678:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1962:x1830964746507392:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.268685:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.268689:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.268697:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.268711:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144656.268714:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.268720:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.268726:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.268741:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.268756:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1962:x1830964746507392:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.268762:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5673 00010000:00010000:3.0:1746144656.268863:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8800/0xa7c849b16e01941b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e427 expref: 303 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.268880:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747424000:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.268891:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009447d600/0xa7c849b16e0193f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e419 expref: 8 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.268899:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747424128:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.268915:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.268923:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.268928:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144656.268952:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:2.0:1746144656.269034:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746506496:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11691us (11906us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144656.269043:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4303 00002000:00100000:2.0:1746144656.269052:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a51ed180 x1830964746506496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.269060:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed180 with x1830964746506496 ext(3145728->4194303) 00002000:00010000:2.0:1746144656.269064:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ed180 00010000:00010000:3.0:1746144656.269725:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0a00/0xa7c849b16e019461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 304 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.269737:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.269745:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.269747:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144656.269749:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0e00, rc 0) 00000100:00100000:3.0:1746144656.269772:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28934:x1830964746506880:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 9900us (10123us total) trans 8589943866 rc 0/0 00000100:00100000:3.0:1746144656.269778:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10001 00000100:00100000:1.0:1746144656.271354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.271379:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746507520 00000100:00100000:1.0:1746144656.271382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.271386:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746507520 00000100:00100000:1.0:1746144656.271406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.271422:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 620 00000100:00100000:2.0:1746144656.271429:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746507520:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.271441:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144656.271549:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746507648 00000100:00100000:0.0:1746144656.271553:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746507648 00000100:00100000:0.0:1746144656.271573:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746507776 00000100:00100000:0.0:1746144656.271575:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746507776 00000100:00100000:0.0:1746144656.271589:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11419 00000100:00100000:0.0:1746144656.271594:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746507648:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144656.271608:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144656.271611:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11420 00000100:00100000:1.0:1746144656.271621:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746507776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144656.271623:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e474 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.271631:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.271642:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.271644:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e47b expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.271644:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.271653:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.271658:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.271660:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.271666:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 25 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.271671:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 12 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.271678:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 25 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.271681:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a509a800, rc 0) 00010000:00010000:1.0:1746144656.271686:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5000, rc 0) 00000100:00100000:0.0:1746144656.271711:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746507648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.271713:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746507776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 93us (304us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144656.271715:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019484 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e46d expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.271717:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11419 00000100:00100000:1.0:1746144656.271720:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11420 00010000:00010000:2.0:1746144656.271734:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.271738:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.271756:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746507520:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 327us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.271765:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 620 00000100:00100000:0.0:1746144656.272565:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746506112:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15244us (15503us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144656.272573:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4301 00002000:00100000:0.0:1746144656.272582:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a51ef100 x1830964746506112/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.272590:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ef100 with x1830964746506112 ext(2097152->3145727) 00002000:00010000:0.0:1746144656.272594:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ef100 00000100:00100000:0.0:1746144656.275214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.275242:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746508032 00000100:00100000:0.0:1746144656.275249:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746508032 00002000:00100000:0.0:1746144656.275292:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a51ef800 x1830964746508032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.275302:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ef800 with x1830964746508032 ext(0->1048575) 00002000:00010000:0.0:1746144656.275307:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ef800 00000100:00100000:0.0:1746144656.275327:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4304 00000100:00100000:0.0:1746144656.275334:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746508032:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.280893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.280934:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746508288 00000100:00100000:0.0:1746144656.280943:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746508288 00002000:00100000:0.0:1746144656.280989:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a51ec000 x1830964746508288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.280999:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ec000 with x1830964746508288 ext(4194304->4935679) 00002000:00010000:0.0:1746144656.281004:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ec000 00000100:00100000:0.0:1746144656.281036:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4305 00000100:00100000:0.0:1746144656.281394:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746508288:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.288723:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746508032:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13379us (13506us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144656.288736:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4304 00002000:00100000:0.0:1746144656.288750:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a51ef800 x1830964746508032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.288760:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ef800 with x1830964746508032 ext(0->1048575) 00002000:00010000:0.0:1746144656.288766:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ef800 00000100:00100000:1.0:1746144656.293508:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746508288:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12454us (12613us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144656.293521:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4305 00002000:00100000:1.0:1746144656.293534:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a51ec000 x1830964746508288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.293544:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ec000 with x1830964746508288 ext(4194304->4935679) 00002000:00010000:1.0:1746144656.293550:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ec000 00000100:00100000:0.0:1746144656.299419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.299449:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746508416 00000100:00100000:0.0:1746144656.299457:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746508416 00000100:00100000:0.0:1746144656.299506:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11421 00000100:00100000:0.0:1746144656.299515:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:28934:x1830964746508416:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144656.299534:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.299554:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e482 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.299588:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.299595:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 31 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.299602:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.299607:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.299609:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.299612:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1134592->1540095] (req 1134592->1540095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 31 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.299642:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.299654:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 24 pid: 8453 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.299666:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424256:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144656.301269:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 31 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.301283:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 31 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.301296:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424384:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144656.301361:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.301370:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 9 pid: 8388 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.301378:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424512:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.301397:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.306967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.307000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.307044:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424256:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.307048:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746508672 00000100:00100000:0.0:1746144656.307054:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424384:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.307055:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746508672 00000100:00100000:0.0:1746144656.307062:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424512:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.307089:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 10 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.307091:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [1134592->1540095] (req 1134592->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 31 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.307106:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b40e8c00, rc 0) 00000100:00100000:2.0:1746144656.307111:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746508544 00000100:00100000:2.0:1746144656.307113:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746508544 00010000:00010000:2.0:1746144656.307121:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 32 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.307164:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:28934:x1830964746508416:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7650us (7754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.307180:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5674 00000100:00100000:0.0:1746144656.307182:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11421 00000100:00100000:3.0:1746144656.307189:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746508672:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144656.307195:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5675 00000100:00100000:2.0:1746144656.307201:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746508544:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.307203:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.307208:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.307224:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 31 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307226:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 10 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.307234:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 31 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307242:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 10 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.307262:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e0192d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e363 expref: 31 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307267:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800936dd200/0xa7c849b16e0191eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2fa expref: 10 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307289:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.307309:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746508672:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.307315:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5674 00000100:00100000:0.0:1746144656.307536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144656.307582:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.307588:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746508800 00000100:00100000:3.0:1746144656.307592:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746508800 00000100:00100000:2.0:1746144656.307605:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746508544:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 404us (604us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144656.307607:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 25 pid: 8453 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.307615:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5675 00000100:00100000:3.0:1746144656.307626:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5676 00000100:00100000:3.0:1746144656.307631:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746508800:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.307638:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.307646:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 25 pid: 8453 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307655:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 25 pid: 8453 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307667:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019270 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e32b expref: 25 pid: 8453 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.307675:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.307677:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.307683:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 29 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.307692:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 29 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.307722:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 29 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.307734:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747424640:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144656.307775:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.311241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.311314:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746509056 00000100:00100000:0.0:1746144656.311324:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746509056 00002000:00100000:0.0:1746144656.311810:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1134592->1138687) req@ffff88013695a680 x1830964746509056/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.311820:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a680 with x1830964746509056 ext(1134592->1138687) 00002000:00010000:0.0:1746144656.311826:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695a680 00000100:00100000:0.0:1746144656.311854:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4306 00000100:00100000:0.0:1746144656.311861:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746509056:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.312026:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746509056:12345-192.168.204.23@tcp:3:cat.0 Request processed in 164us (790us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144656.312032:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4306 00002000:00100000:0.0:1746144656.312038:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1134592->1138687) req@ffff88013695a680 x1830964746509056/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.312046:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a680 with x1830964746509056 ext(1134592->1138687) 00002000:00010000:0.0:1746144656.312049:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695a680 00000100:00100000:3.0:1746144656.312077:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747424640:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144656.312098:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.312123:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746508800:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4491us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.312131:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5676 00000100:00100000:0.0:1746144656.314627:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.315458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.315491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.315505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.315529:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746509312 00000100:00100000:0.0:1746144656.315529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.315544:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746509568 00000100:00100000:0.0:1746144656.315548:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746509568 00002000:00100000:0.0:1746144656.315584:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a51eea00 x1830964746509568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.315592:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51eea00 with x1830964746509568 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.315597:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51eea00 00000100:00100000:0.0:1746144656.315612:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746509824 00000100:00100000:0.0:1746144656.315614:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746509824 00002000:00100000:0.0:1746144656.315626:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a51eca80 x1830964746509824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.315632:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51eca80 with x1830964746509824 ext(2097152->3145727) 00002000:00010000:0.0:1746144656.315635:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51eca80 00000100:00100000:0.0:1746144656.315644:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746510336 00000100:00100000:0.0:1746144656.315646:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746510336 00000100:00100000:3.0:1746144656.315678:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746510208 00000100:00100000:3.0:1746144656.315682:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746510208 00000100:00100000:3.0:1746144656.315718:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10003 00000100:00100000:3.0:1746144656.315725:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:28940:x1830964746510208:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.315743:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.315760:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094514000/0xa7c849b16e0194ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e489 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.315772:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4307 00000100:00100000:1.0:1746144656.315779:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746509568:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:3.0:1746144656.315852:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.315864:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.315875:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.315885:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.315890:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.315894:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00002000:00100000:0.0:1746144656.315984:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a51ed500 x1830964746510336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.315991:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed500 with x1830964746510336 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.315993:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ed500 00000100:00100000:0.0:1746144656.316004:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4308 00000100:00100000:0.0:1746144656.316008:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746509824:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144656.316375:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746509312 00002000:00100000:2.0:1746144656.316395:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a51ef480 x1830964746509312/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.316402:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ef480 with x1830964746509312 ext(2097152->3145727) 00002000:00010000:2.0:1746144656.316405:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ef480 00000100:00100000:2.0:1746144656.316418:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4309 00000100:00100000:2.0:1746144656.316423:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746510336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.317237:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4310 00000100:00100000:0.0:1746144656.317246:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746509312:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:1.0:1746144656.318231:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e0194c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.318247:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e0194c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.318257:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e0194c3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144656.318269:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144656.318367:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.318374:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.318380:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.318386:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094514e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144656.318390:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.318397:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319085:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144656.319089:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144656.319094:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319099:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094514e00/0xa7c849b16e0194b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319551:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319555:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319615:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319619:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936dd200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144656.319622:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319627:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319635:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33f00) 00010000:00010000:1.0:1746144656.319637:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144656.319639:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319643:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936dd200/0xa7c849b16e0194bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.319693:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094514000/0xa7c849b16e0194ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e489 expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.319707:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e0194c3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e489 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.319713:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.319715:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144656.319718:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a4600, rc 0) 00000100:00100000:1.0:1746144656.319782:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:28940:x1830964746510208:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4056us (4324us total) trans 8589943867 rc 0/0 00000100:00100000:1.0:1746144656.319790:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10003 00000100:00100000:0.0:1746144656.320302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.320441:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746510592 00000100:00100000:1.0:1746144656.320450:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746510592 00002000:00100000:1.0:1746144656.320584:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1536000->1540095) req@ffff8800937a0a80 x1830964746510592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.320592:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0a80 with x1830964746510592 ext(1536000->1540095) 00002000:00010000:1.0:1746144656.320935:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a0a80 00000100:00100000:1.0:1746144656.320955:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4311 00000100:00100000:1.0:1746144656.320962:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746510592:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.321060:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746510592:12345-192.168.204.23@tcp:3:cat.0 Request processed in 98us (760us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144656.321066:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4311 00002000:00100000:1.0:1746144656.321071:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1536000->1540095) req@ffff8800937a0a80 x1830964746510592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.321078:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0a80 with x1830964746510592 ext(1536000->1540095) 00002000:00010000:1.0:1746144656.321081:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a0a80 00000100:00100000:2.0:1746144656.328235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.328260:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746510720 00000100:00100000:2.0:1746144656.328267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.328270:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746510720 00000100:00100000:3.0:1746144656.328327:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 621 00000100:00100000:3.0:1746144656.328337:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746510720:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.328353:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.328378:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e0194c3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e489 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.328393:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.328397:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.328437:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746510720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 102us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.328444:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 621 00000100:00100000:0.0:1746144656.328660:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746510848 00000100:00100000:0.0:1746144656.328669:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746510848 00000100:00100000:0.0:1746144656.328703:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11422 00000100:00100000:0.0:1746144656.328709:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:28940:x1830964746510848:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144656.328724:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.328738:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e490 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.328765:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 29 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.328773:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144656.328775:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144656.328779:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1470464->1540095] (req 1470464->1540095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 28 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.328804:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 29 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.328815:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 29 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.328828:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424768:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.328898:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.334216:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746509312:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16960us (19584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.334229:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4310 00002000:00100000:1.0:1746144656.334242:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a51ef480 x1830964746509312/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.334251:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ef480 with x1830964746509312 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.334257:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ef480 00000100:00100000:3.0:1746144656.338485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.338967:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746510976 00000100:00100000:0.0:1746144656.338973:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747424768:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.338975:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746510976 00010000:00010000:0.0:1746144656.339004:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1470464->1540095] (req 1470464->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 29 pid: 22208 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746144656.339015:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1134592->1540095) req@ffff88009fb46d80 x1830964746510976/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746144656.339021:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012febae00, rc 0) 00002000:00100000:1.0:1746144656.339024:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46d80 with x1830964746510976 ext(1134592->1540095) 00010000:00010000:1.0:1746144656.339031:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 30 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.339044:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 30 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746144656.339050:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb46d80 00000100:00100000:0.0:1746144656.339064:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:28940:x1830964746510848:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10354us (10795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.339070:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 824 00000100:00100000:0.0:1746144656.339072:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11422 00000100:00100000:1.0:1746144656.339077:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746510976:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144656.339128:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746510336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22703us (23596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.339152:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4309 00002000:00100000:3.0:1746144656.339158:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a51ed500 x1830964746510336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.339165:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed500 with x1830964746510336 ext(3145728->4194303) 00002000:00010000:3.0:1746144656.339178:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ed500 00000100:00100000:1.0:1746144656.339830:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746509568:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24050us (24337us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.339837:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4307 00002000:00100000:1.0:1746144656.339842:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a51eea00 x1830964746509568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.339850:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51eea00 with x1830964746509568 ext(3145728->4194303) 00002000:00010000:1.0:1746144656.339853:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51eea00 00000100:00100000:1.0:1746144656.346445:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746509824:12345-192.168.204.23@tcp:3:cat.0 Request processed in 30423us (30925us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.346457:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4308 00002000:00100000:1.0:1746144656.346470:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a51eca80 x1830964746509824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.346479:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51eca80 with x1830964746509824 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.346485:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51eca80 00000100:00100000:0.0:1746144656.346824:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746510976:12345-192.168.204.23@tcp:4:cat.0 Request processed in 7746us (8345us total) trans 21474840430 rc 0/0 00000100:00100000:0.0:1746144656.346832:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 824 00002000:00100000:0.0:1746144656.346836:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1134592->1540095) req@ffff88009fb46d80 x1830964746510976/t21474840430(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.346842:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46d80 with x1830964746510976 ext(1134592->1540095) 00010000:00010000:0.0:1746144656.346850:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 32 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.346864:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 32 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:0.0:1746144656.346870:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb46d80 00000001:00080000:2.0:1746144656.348024:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840423 is committed 00000001:00080000:2.0:1746144656.348060:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840388 is committed 00000001:00080000:2.0:1746144656.348075:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840379 is committed 00000001:00080000:2.0:1746144656.348096:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840426 is committed 00000001:00080000:2.0:1746144656.348106:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840411 is committed 00000001:00080000:2.0:1746144656.348113:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840409 is committed 00000001:00080000:2.0:1746144656.348180:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840410 is committed 00000001:00080000:2.0:1746144656.348204:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840389 is committed 00000001:00080000:2.0:1746144656.348223:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840429 is committed 00000001:00080000:2.0:1746144656.348229:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840428 is committed 00000001:00080000:2.0:1746144656.348234:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840427 is committed 00000001:00080000:2.0:1746144656.348273:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840390 is committed 00000100:00100000:0.0:1746144656.350612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.350701:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746511104 00000100:00100000:3.0:1746144656.350710:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746511104 00010000:00010000:3.0:1746144656.350759:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 18 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.350795:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5677 00000100:00100000:3.0:1746144656.350804:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746511104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.350819:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144656.350837:0:7101:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144655 -> 1746144657 00002000:00010000:3.0:1746144656.350840:0:7101:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144655 -> 1746144657 00010000:00010000:3.0:1746144656.350845:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 18 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.350857:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 18 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.350878:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b40e8c00/0xa7c849b16e0194a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1540095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e482 expref: 18 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.350895:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.350897:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.350904:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.350913:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.351004:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.351017:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747424896:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144656.351803:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.354970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.355364:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746511232 00000100:00100000:2.0:1746144656.355374:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746511232 00000100:00100000:2.0:1746144656.355436:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11423 00000100:00100000:2.0:1746144656.355443:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746511232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144656.355463:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.355483:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c00c400/0xa7c849b16e0194d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e497 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.355536:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747425024:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144656.355625:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144656.356088:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747424896:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144656.356118:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.357111:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746511104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6305us (6502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.357123:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5677 00000100:00100000:0.0:1746144656.357464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.357529:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746511488 00000100:00100000:1.0:1746144656.357534:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746511488 00002000:00100000:1.0:1746144656.357567:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1470464->1474559) req@ffff8800937a1500 x1830964746511488/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.357575:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a1500 with x1830964746511488 ext(1470464->1474559) 00002000:00010000:1.0:1746144656.357580:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a1500 00000100:00100000:1.0:1746144656.357685:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4312 00000100:00100000:1.0:1746144656.357692:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746511488:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144656.357859:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746511488:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 167us (396us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144656.357864:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4312 00002000:00100000:1.0:1746144656.357869:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1470464->1474559) req@ffff8800937a1500 x1830964746511488/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.357876:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a1500 with x1830964746511488 ext(1470464->1474559) 00002000:00010000:1.0:1746144656.357879:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a1500 00002000:00010000:2.0:1746144656.359208:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144654 -> 1746144657 00000100:00100000:2.0:1746144656.359227:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747425024:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144656.359256:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c00c400/0xa7c849b16e0194d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e497 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.359269:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c00c400/0xa7c849b16e0194d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e497 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.359292:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c00c400, rc 0) 00000100:00100000:2.0:1746144656.359316:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746511232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3873us (4357us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144656.359323:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11423 00000100:00100000:0.0:1746144656.366346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.366400:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746511744 00000100:00100000:2.0:1746144656.366409:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746511744 00002000:00100000:2.0:1746144656.366458:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1536000->1540095) req@ffff8800937a2d80 x1830964746511744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.366468:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a2d80 with x1830964746511744 ext(1536000->1540095) 00002000:00010000:2.0:1746144656.366474:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a2d80 00000100:00100000:2.0:1746144656.366508:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4313 00000100:00100000:2.0:1746144656.366516:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746511744:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144656.366699:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746511744:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 183us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144656.366706:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4313 00002000:00100000:2.0:1746144656.366711:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1536000->1540095) req@ffff8800937a2d80 x1830964746511744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.366717:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a2d80 with x1830964746511744 ext(1536000->1540095) 00002000:00010000:2.0:1746144656.366720:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a2d80 00000100:00100000:0.0:1746144656.370248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.370302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.370307:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746512000 00000100:00100000:2.0:1746144656.370317:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746512000 00000100:00100000:3.0:1746144656.370360:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746512256 00000100:00100000:3.0:1746144656.370366:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746512256 00002000:00100000:2.0:1746144656.370370:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800937a3480 x1830964746512000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.370380:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a3480 with x1830964746512000 ext(4194304->4935679) 00002000:00010000:2.0:1746144656.370385:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937a3480 00000100:00100000:2.0:1746144656.370405:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4314 00000100:00100000:2.0:1746144656.370412:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746512000:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144656.370421:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4013 00000100:00100000:3.0:1746144656.370427:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:28940:x1830964746512256:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144656.370789:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:28940:x1830964746512256:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 360us (485us total) trans 8589943868 rc 0/0 00000100:00100000:3.0:1746144656.370797:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4013 00000100:00100000:0.0:1746144656.380236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.380287:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746512384 00000100:00100000:1.0:1746144656.380297:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746512384 00000100:00100000:2.0:1746144656.380801:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746512000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10379us (10553us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144656.380813:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4314 00002000:00100000:2.0:1746144656.380825:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800937a3480 x1830964746512000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.380834:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a3480 with x1830964746512000 ext(4194304->4935679) 00002000:00010000:2.0:1746144656.380840:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800937a3480 00000100:00100000:1.0:1746144656.380915:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10004 00000100:00100000:1.0:1746144656.380924:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28942:x1830964746512384:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144656.380946:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.380964:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e0194df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e49e expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.381027:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381039:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381050:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381062:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381067:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381072:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381221:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381231:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.381242:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.381272:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.381282:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 302 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.381294:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747425152:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.381907:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.386063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.386102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.386125:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746512640 00000100:00100000:0.0:1746144656.386153:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746512896 00000100:00100000:0.0:1746144656.386157:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746512896 00000100:00100000:0.0:1746144656.386218:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4014 00000100:00100000:0.0:1746144656.386225:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:28937:x1830964746512896:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144656.386227:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746512640 00000100:00100000:3.0:1746144656.386385:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4015 00000100:00100000:3.0:1746144656.386393:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:27208:x1830964746512640:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144656.386500:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747425152:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.386522:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144656.386623:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:28937:x1830964746512896:12345-192.168.204.23@tcp:35:cat.0 Request processed in 397us (518us total) trans 8589943869 rc 0/0 00000100:00100000:0.0:1746144656.386631:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4014 00000100:00100000:3.0:1746144656.386826:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:27208:x1830964746512640:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 433us (771us total) trans 8589943870 rc 0/0 00000100:00100000:3.0:1746144656.386832:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4015 00000100:00100000:0.0:1746144656.389478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.390006:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746513024 00000100:00100000:3.0:1746144656.390015:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746513024 00010000:00010000:3.0:1746144656.390059:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.390697:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5678 00000100:00100000:3.0:1746144656.390708:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1961:x1830964746513024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.390721:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.390728:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.390739:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.390761:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0e00/0xa7c849b16e019468 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e466 expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.390773:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.390778:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.390788:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.390795:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.390828:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.390868:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1961:x1830964746513024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 164us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.390874:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5678 00010000:00010000:1.0:1746144656.390939:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.390947:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144656.390990:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:1.0:1746144656.390995:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144656.391012:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391021:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391031:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391037:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391043:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391048:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f62e000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144656.391051:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391058:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391066:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144656.391068:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144656.391071:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391075:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e000/0xa7c849b16e0194e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391086:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391091:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391095:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391099:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f62fa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144656.391101:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391108:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391113:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaf00) 00010000:00010000:1.0:1746144656.391115:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144656.391117:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391121:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e0194ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.391175:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e0194df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.391187:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.391192:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.391194:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144656.391196:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62f400, rc 0) 00000100:00100000:1.0:1746144656.391222:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28942:x1830964746512384:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 10300us (10997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.391229:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10004 00000100:00100000:0.0:1746144656.393862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.394014:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746513152 00000100:00100000:0.0:1746144656.394017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.394024:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746513152 00000100:00100000:0.0:1746144656.394054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.394069:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746513280 00000100:00100000:1.0:1746144656.394073:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746513280 00000100:00100000:0.0:1746144656.394080:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746513408 00000100:00100000:0.0:1746144656.394083:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746513408 00000100:00100000:0.0:1746144656.394115:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11424 00000100:00100000:0.0:1746144656.394122:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746513408:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144656.394156:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144656.394190:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11425 00010000:00010000:0.0:1746144656.394193:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4b3 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.394196:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746513152:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144656.394202:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.394210:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e46d600/0xa7c849b16e019502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4a5 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.394216:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.394218:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.394225:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.394239:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144656.394246:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747425280:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144656.394248:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3600, rc 0) 00000100:00100000:2.0:1746144656.394829:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.394854:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746513408:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 731us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.394860:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11424 00000100:00100000:0.0:1746144656.394878:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11426 00000100:00100000:0.0:1746144656.394883:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746513280:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144656.394891:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.394900:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4ac expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.394910:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.394912:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.394915:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.394928:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.394935:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3400, rc 0) 00000100:00100000:0.0:1746144656.394949:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746513280:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 66us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.394952:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11426 00000100:00100000:2.0:1746144656.396459:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747425280:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144656.396487:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e46d600/0xa7c849b16e019502 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4a5 expref: 8 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.396498:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e46d600/0xa7c849b16e019502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4a5 expref: 8 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.396523:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46d600, rc 0) 00000100:00100000:2.0:1746144656.396560:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746513152:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 2363us (2705us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144656.396566:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11425 00000100:00100000:0.0:1746144656.398229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.398320:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746513664 00000100:00100000:1.0:1746144656.398329:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746513664 00000100:00100000:1.0:1746144656.398372:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10005 00000100:00100000:1.0:1746144656.398379:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28942:x1830964746513664:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144656.398398:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.398416:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f200/0xa7c849b16e019510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4ba expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.398503:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.398517:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.398523:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.398551:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.398563:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 10 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.398574:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747425408:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.398729:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.400230:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747425408:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.400248:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144656.400396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.400450:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746513792 00000100:00100000:2.0:1746144656.400455:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746513792 00010000:00010000:2.0:1746144656.400620:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 11 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.400657:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5679 00000100:00100000:2.0:1746144656.400663:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746513792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.400673:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.400678:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 11 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.400687:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 11 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.400709:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e0194f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e49e expref: 11 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.400720:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.400724:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.400732:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.400737:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.400886:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.400926:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746513792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 263us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.400933:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5679 00010000:00010000:1.0:1746144656.400999:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.401005:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144656.401025:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144656.401314:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f200/0xa7c849b16e019510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ba expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.401344:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ba expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.401350:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.401352:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746144656.401354:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62f600, rc 0) 00000100:00100000:1.0:1746144656.401379:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:28942:x1830964746513664:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3001us (3161us total) trans 8589943871 rc 0/0 00000100:00100000:1.0:1746144656.401384:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10005 00000100:00100000:0.0:1746144656.402713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.402759:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514048 00000100:00100000:1.0:1746144656.402763:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514048 00000100:00100000:1.0:1746144656.402817:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10006 00000100:00100000:1.0:1746144656.402823:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:28942:x1830964746514048:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144656.402841:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.402843:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144656.402856:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f600/0xa7c849b16e019517 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ba expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.402865:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.402868:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144656.402878:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fe00/0xa7c849b16e019525 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4c1 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.402947:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e01952c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.402957:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e01952c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144656.402964:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e01952c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144656.402971:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144656.403034:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fe00/0xa7c849b16e019525 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4c1 expref: 12 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.403044:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e01952c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4c1 expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.403050:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.403052:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144656.403053:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62e400, rc 0) 00000100:00100000:1.0:1746144656.403091:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:28942:x1830964746514048:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 267us (381us total) trans 8589943872 rc 0/0 00000100:00100000:1.0:1746144656.403096:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10006 00000100:00100000:0.0:1746144656.404847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.405291:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514176 00000100:00100000:2.0:1746144656.405506:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514176 00000100:00100000:2.0:1746144656.405558:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10007 00000100:00100000:2.0:1746144656.405567:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:28942:x1830964746514176:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144656.405592:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.405607:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01953a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4c8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.405666:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01953a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4c8 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.405906:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01953a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4c8 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.405926:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.405929:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144656.405932:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51c400, rc 0) 00000100:00100000:2.0:1746144656.405985:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:28942:x1830964746514176:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 419us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.405991:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10007 00000100:00100000:0.0:1746144656.407878:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.407901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.407915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.407937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.407960:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514432 00000100:00100000:3.0:1746144656.407969:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514432 00000100:00100000:3.0:1746144656.408024:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514304 00000100:00100000:3.0:1746144656.408027:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514304 00000100:00100000:3.0:1746144656.408041:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514688 00000100:00100000:3.0:1746144656.408043:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514688 00000100:00100000:0.0:1746144656.408047:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514944 00000100:00100000:0.0:1746144656.408054:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514944 00000100:00100000:3.0:1746144656.408059:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11427 00000100:00100000:3.0:1746144656.408073:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746514432:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:3.0:1746144656.408210:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.408228:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.408236:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.408237:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.408241:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.408257:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11428 00000100:00100000:2.0:1746144656.408273:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746514304:12345-192.168.204.23@tcp:1:mirror_io.0 00000100:00100000:0.0:1746144656.408299:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11429 00000100:00100000:0.0:1746144656.408307:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746514688:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144656.408312:0:22208:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.408323:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408328:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 9 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144656.408332:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11430 00010000:00010000:0.0:1746144656.408333:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408335:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 24 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.408340:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.408342:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144656.408342:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746514944:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:0.0:1746144656.408346:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408347:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.408349:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.408351:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.408351:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.408352:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.408354:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.408362:0:8389:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.408373:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408375:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.408375:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.408381:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.408386:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.408388:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.408392:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 11 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.408393:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.408394:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.408396:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.408398:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747425664:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.408399:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.408400:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130928a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747425536:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.408410:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 8 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.408410:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408417:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 8 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.408421:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747425792:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.408423:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747425920:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.408464:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 24 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144656.408466:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9840 going to sleep for 11 seconds 00010000:00010000:0.0:1746144656.408466:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.408473:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 24 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.408473:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144656.408475:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 9 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.408480:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 8 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.408480:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130928e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747426176:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.408481:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747426048:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.408488:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747426304:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144656.408498:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.408502:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 24 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.408507:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747426432:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.408508:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 9 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408518:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.408518:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c600 going to sleep for 11 seconds 00010000:00010000:2.0:1746144656.408520:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 9 pid: 7257 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.408527:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.408528:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747426560:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.408534:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747426688:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.408540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.408543:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.408553:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144656.408567:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514560 00000100:00100000:1.0:1746144656.408570:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514560 00000100:00100000:1.0:1746144656.408601:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11431 00000100:00100000:1.0:1746144656.408607:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746514560:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144656.408622:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.408632:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408644:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408651:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408658:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.408659:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.408661:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.408669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.408682:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746514816 00000100:00100000:2.0:1746144656.408686:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746514816 00000100:00100000:2.0:1746144656.408719:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11432 00000100:00100000:2.0:1746144656.408725:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746514816:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:1.0:1746144656.408729:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408737:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.408745:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747426816:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.408789:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 16 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408796:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 16 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.408808:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747426944:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.408832:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.408840:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.408847:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747427072:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.408864:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746144656.408916:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408927:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408935:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.408942:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.408946:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.408947:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.408949:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.408966:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.408974:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 11 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.408981:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747427200:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.409005:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.409012:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 10 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.409019:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747427328:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.409034:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 24 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.409040:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 24 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.409047:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747427456:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.409064:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.413373:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130928a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747425536:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.413396:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747425664:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.413403:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747426048:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.413416:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130928e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747426176:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.413423:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747426432:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.413436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144656.413447:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.413463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.413469:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747426560:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.413483:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.413517:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747427200:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.413517:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515456 00000100:00100000:0.0:1746144656.413523:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515456 00010000:00010000:0.0:1746144656.413547:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 9 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.413579:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515584 00000100:00100000:0.0:1746144656.413582:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515584 00010000:00010000:0.0:1746144656.413592:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 10 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.413597:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5680 00000100:00100000:2.0:1746144656.413605:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746515456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144656.413613:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5681 00010000:00010000:2.0:1746144656.413615:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144656.413619:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746515584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.413625:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.413634:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 9 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.413634:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 10 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.413644:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 9 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.413652:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 10 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.413672:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.413706:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746515456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.413709:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747425792:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.413712:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5680 00010000:00010000:3.0:1746144656.413730:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.413769:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.413790:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746515584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 171us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.413796:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5681 00010000:00010000:1.0:1746144656.413919:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0194a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e47b expref: 8 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.413953:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747425920:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.413965:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edd3600/0xa7c849b16e0194fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4b3 expref: 9 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.413972:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747426304:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.413982:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747426688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.414004:0:8389:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.414059:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747426816:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.414067:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747426944:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.414075:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747427072:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.414093:0:30345:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.415232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.415261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.415306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.415379:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747427328:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.415387:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747427456:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.415406:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.415453:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515712 00000100:00100000:2.0:1746144656.415457:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515712 00010000:00010000:2.0:1746144656.415475:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 25 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.415499:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515840 00000100:00100000:2.0:1746144656.415501:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515840 00010000:00010000:2.0:1746144656.415510:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.415520:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516096 00000100:00100000:2.0:1746144656.415522:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516096 00010000:00010000:2.0:1746144656.415530:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.415542:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5682 00000100:00100000:2.0:1746144656.415548:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746515712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.415556:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.415571:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 25 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.415579:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 25 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.415594:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273c00/0xa7c849b16e019349 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3b7 expref: 25 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.415613:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.415628:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5683 00000100:00100000:2.0:1746144656.415634:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746515712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.415639:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746515840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144656.415640:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5682 00000100:00100000:2.0:1746144656.415652:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5684 00010000:00010000:1.0:1746144656.415653:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144656.415657:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746516096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.415664:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.415674:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.415675:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.415683:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.415684:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.415695:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e0191f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e301 expref: 9 pid: 8388 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.415703:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144656.415708:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f176e00/0xa7c849b16e0191e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e2f3 expref: 11 pid: 7257 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.415715:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746516096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 59us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.415720:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5684 00010000:00010000:1.0:1746144656.415720:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.415752:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746515840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 117us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.415758:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5683 00000100:00100000:0.0:1746144656.417614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.417671:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516480 00000100:00100000:3.0:1746144656.417678:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516480 00010000:00010000:3.0:1746144656.417712:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 12 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.417740:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5685 00000100:00100000:3.0:1746144656.417746:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746516480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.417754:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.417767:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 12 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.417775:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 12 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.417788:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd200/0xa7c849b16e019350 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3be expref: 12 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.417809:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.417836:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746516480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.417841:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5685 00000100:00100000:0.0:1746144656.418875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.418921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.418947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.418974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.418989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.419001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.419012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.419061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.419077:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515968 00000100:00100000:0.0:1746144656.419083:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515968 00010000:00010000:0.0:1746144656.419107:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 24 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419124:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516352 00000100:00100000:0.0:1746144656.419126:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516352 00010000:00010000:0.0:1746144656.419157:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 10 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419176:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515072 00000100:00100000:0.0:1746144656.419178:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515072 00010000:00010000:0.0:1746144656.419187:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419194:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515328 00000100:00100000:0.0:1746144656.419195:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515328 00010000:00010000:0.0:1746144656.419202:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 11 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419208:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516224 00000100:00100000:0.0:1746144656.419209:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516224 00010000:00010000:0.0:1746144656.419219:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.419220:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516608 00000100:00100000:3.0:1746144656.419224:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516608 00000100:00100000:0.0:1746144656.419226:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516736 00000100:00100000:0.0:1746144656.419227:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516736 00010000:00010000:0.0:1746144656.419234:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 25 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.419247:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5686 00010000:00010000:3.0:1746144656.419250:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 17 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419253:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746515968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.419265:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144656.419273:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5687 00000100:00100000:3.0:1746144656.419279:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746516352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.419283:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 25 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419286:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.419293:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 25 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419297:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 11 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419306:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 11 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.419310:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e0192cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e35c expref: 25 pid: 10724 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419318:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019509 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4ac expref: 11 pid: 10724 timeout: 735 lvb_type: 1 00000100:00100000:2.0:1746144656.419321:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5688 00010000:00010000:3.0:1746144656.419327:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144656.419327:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.419332:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746515072:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.419345:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144656.419355:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746515968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 102us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.419357:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746516352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 79us (409us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144656.419360:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419362:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5686 00000100:00100000:3.0:1746144656.419365:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5687 00010000:00010000:2.0:1746144656.419371:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.419378:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5689 00000100:00100000:1.0:1746144656.419383:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5690 00000100:00100000:3.0:1746144656.419384:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746515328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.419390:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.419390:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944c8600/0xa7c849b16e019269 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e324 expref: 11 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.419390:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746516224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.419397:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.419399:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 9 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.419401:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5691 00000100:00100000:0.0:1746144656.419404:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746516736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.419407:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 9 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.419410:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.419411:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.419415:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 23 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.419419:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419422:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4df200/0xa7c849b16e0193c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3fd expref: 9 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.419422:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 23 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.419431:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.419431:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019277 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e332 expref: 8 pid: 8453 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419433:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.419435:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009945ee00/0xa7c849b16e019453 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e458 expref: 23 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.419437:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.419440:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144656.419442:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144656.419446:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419451:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.419453:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144656.419454:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+7:1961:x1830964746516224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 66us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.419454:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746516736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 49us (393us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144656.419457:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.419459:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5691 00000100:00100000:1.0:1746144656.419461:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5690 00010000:00010000:2.0:1746144656.419465:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419466:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.419466:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5692 00000100:00100000:0.0:1746144656.419470:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746516608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.419476:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144656.419480:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746515328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (490us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144656.419483:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 17 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.419486:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5689 00010000:00010000:2.0:1746144656.419487:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144656.419491:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 17 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.419502:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e0192fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e36a expref: 17 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.419503:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.419510:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.419511:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.419512:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.419512:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746515072:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 184us (536us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144656.419514:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.419517:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5688 00010000:00010000:0.0:1746144656.419521:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419531:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419539:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419540:0:22208:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.419544:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144656.419547:0:22208:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419551:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419557:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edd2e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144656.419560:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419563:0:22208:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.419563:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746516608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 91us (548us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144656.419567:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.419568:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5692 00010000:00010000:2.0:1746144656.419575:0:22208:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419576:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.419581:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2e00/0xa7c849b16e01954f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419581:0:22208:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419586:0:22208:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b51d200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144656.419590:0:22208:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419596:0:22208:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.419596:0:30345:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419604:0:22208:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.419609:0:30345:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.419610:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e019548 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.419618:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746514688:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 11312us (11701us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144656.419622:0:30345:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.419624:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11429 00010000:00010000:1.0:1746144656.419628:0:30345:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.419633:0:30345:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.419639:0:30345:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094515e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144656.419642:0:30345:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.419648:0:30345:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.419655:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746514304:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 11390us (11752us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144656.419656:0:30345:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.419662:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11428 00010000:00010000:1.0:1746144656.419662:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094515e00/0xa7c849b16e01955d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.419678:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746515200 00000100:00100000:2.0:1746144656.419683:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746515200 00000100:00100000:1.0:1746144656.419704:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746514560:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 11096us (11162us total) trans 0 rc 0/0 00002000:00100000:2.0:1746144656.419705:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1470464->1540095) req@ffff88013092ad80 x1830964746515200/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144656.419713:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11431 00002000:00100000:2.0:1746144656.419719:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092ad80 with x1830964746515200 ext(1470464->1540095) 00010000:00010000:2.0:1746144656.419724:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 7 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.419733:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 7 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:2.0:1746144656.419738:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013092ad80 00000100:00100000:2.0:1746144656.419765:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 825 00000100:00100000:2.0:1746144656.419770:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+7:1961:x1830964746515200:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144656.422376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.422411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.422544:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516864 00000100:00100000:0.0:1746144656.422551:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516864 00010000:00010000:0.0:1746144656.422574:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.422593:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746516992 00000100:00100000:0.0:1746144656.422594:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746516992 00010000:00010000:0.0:1746144656.422602:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 10 pid: 4758 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.422616:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5693 00000100:00100000:0.0:1746144656.422621:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746516864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.422631:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.422648:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.422658:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.422674:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009945fe00/0xa7c849b16e01945a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e45f expref: 16 pid: 30345 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.422689:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.422691:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.422695:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.422702:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.422735:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.422750:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5694 00000100:00100000:0.0:1746144656.422763:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1963:x1830964746516864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 142us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.422769:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5693 00000100:00100000:3.0:1746144656.422778:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746516992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.422786:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.422799:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 10 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.422813:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 10 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.422825:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a509a800/0xa7c849b16e019499 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e474 expref: 10 pid: 4758 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.422834:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.422835:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.422838:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422844:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422858:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.422880:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746516992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 124us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.422885:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5694 00010000:00010000:3.0:1746144656.422903:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422910:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422925:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422937:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422943:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422947:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eb00a00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144656.422950:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422956:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422965:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.422975:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eb00a00/0xa7c849b16e019564 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.423012:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746514816:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 14287us (14342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.423018:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11432 00010000:00010000:1.0:1746144656.423123:0:8389:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423131:0:8389:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423174:0:8389:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423180:0:8389:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423186:0:8389:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423190:0:8389:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f62f400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144656.423193:0:8389:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423198:0:8389:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423206:0:8389:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.423212:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e019556 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.423245:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746514944:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 14906us (15306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.423251:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11430 00000100:00100000:2.0:1746144656.424900:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746515200:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5126us (6023us total) trans 21474840431 rc 0/0 00000100:00100000:2.0:1746144656.424910:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 825 00002000:00100000:2.0:1746144656.424918:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1470464->1540095) req@ffff88013092ad80 x1830964746515200/t21474840431(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.424927:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092ad80 with x1830964746515200 ext(1470464->1540095) 00010000:00010000:2.0:1746144656.424934:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.424946:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00002000:00010000:2.0:1746144656.424956:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013092ad80 00000100:00100000:0.0:1746144656.426846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.426938:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746517120 00000100:00100000:2.0:1746144656.426945:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746517120 00010000:00010000:2.0:1746144656.426971:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.427002:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5695 00000100:00100000:2.0:1746144656.427008:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746517120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.427020:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.427034:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.427044:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.427062:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012febae00/0xa7c849b16e0194d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->1540095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e490 expref: 9 pid: 22208 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.427075:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.427076:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.427080:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.427087:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.427117:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.427178:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:1963:x1830964746517120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 169us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.427183:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5695 00010000:00010000:0.0:1746144656.427265:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427273:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427288:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427295:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427301:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427311:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4d34800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144656.427315:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427320:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427329:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.427334:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d34800/0xa7c849b16e019541 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.427369:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746514432:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 19298us (19498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.427376:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11427 00000100:00100000:0.0:1746144656.428804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.428866:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746517376 00000100:00100000:2.0:1746144656.428870:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746517376 00000100:00100000:2.0:1746144656.429021:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10008 00000100:00100000:2.0:1746144656.429028:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:28942:x1830964746517376:12345-192.168.204.23@tcp:36:mirror_io.0 00010000:00010000:2.0:1746144656.429061:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.429077:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01953a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4c8 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429090:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.429093:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144656.429113:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.429124:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 302 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429130:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 15 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429179:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 302 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429186:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429195:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 7/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.429218:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429227:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 15 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.429239:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427584:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.429311:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 302 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429318:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 302 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.429325:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427712:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.429344:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 15 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429351:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 15 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.429357:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427840:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.429373:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 302 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.429384:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 302 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.429390:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427968:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.429402:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.432396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.432426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.432438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.432506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.432588:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746517504 00000100:00100000:2.0:1746144656.432595:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746517504 00010000:00010000:2.0:1746144656.432623:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 303 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.432635:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746517760 00000100:00100000:3.0:1746144656.432639:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746517760 00000100:00100000:2.0:1746144656.432643:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746517632 00000100:00100000:2.0:1746144656.432645:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746517632 00010000:00010000:2.0:1746144656.432652:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 17 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.432661:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746517888 00000100:00100000:2.0:1746144656.432663:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746517888 00010000:00010000:3.0:1746144656.432664:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 17 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.432669:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 304 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.432679:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5696 00000100:00100000:3.0:1746144656.432683:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5697 00000100:00100000:2.0:1746144656.432684:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1960:x1830964746517504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144656.432690:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746517632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.432694:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.432697:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.432699:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 304 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.432701:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 17 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.432707:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 304 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.432716:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 17 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.432777:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.432781:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.432789:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.432789:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144656.432793:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.432798:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.432823:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746517632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 133us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.432830:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5698 00000100:00100000:3.0:1746144656.432835:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5697 00000100:00100000:0.0:1746144656.432837:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1961:x1830964746517888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.432844:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.432848:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 304 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.432849:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5699 00000100:00100000:3.0:1746144656.432855:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746517760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.432855:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 304 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.432861:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.432864:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.432866:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 16 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.432867:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.432872:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144656.432874:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 16 pid: 14708 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.432886:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.432890:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.432895:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144656.432898:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1960:x1830964746517504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 213us (509us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144656.432901:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144656.432904:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5696 00010000:00010000:3.0:1746144656.432914:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.432929:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746517760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 75us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.432934:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5699 00010000:00010000:2.0:1746144656.432937:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9000/0xa7c849b16e019396 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e3ef expref: 16 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.432948:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427584:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.432956:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69200/0xa7c849b16e01932d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e39b expref: 303 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.432965:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427712:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.432972:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e019326 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e394 expref: 14 pid: 14708 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.432979:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427840:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.432986:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e01931f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e38d expref: 302 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.432992:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747427968:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.433011:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.433018:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.433022:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144656.433218:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1961:x1830964746517888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 381us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.433224:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5698 00000040:00080000:2.0:1746144656.434120:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2867, 88 off239240 00000004:00080000:2.0:1746144656.434128:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635642992725ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434549:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2792, 88 off232632 00000004:00080000:2.0:1746144656.434554:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643419536ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434578:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2793, 88 off232720 00000004:00080000:2.0:1746144656.434581:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643446568ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434588:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2868, 88 off239328 00000004:00080000:2.0:1746144656.434590:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643455595ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434596:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2869, 88 off239416 00000004:00080000:2.0:1746144656.434599:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643464095ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434609:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2794, 88 off232808 00000004:00080000:2.0:1746144656.434611:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643476920ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434754:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2795, 88 off232896 00000004:00080000:2.0:1746144656.434759:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643624468ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434772:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2796, 88 off232984 00000004:00080000:2.0:1746144656.434775:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643640187ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434781:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2870, 88 off239504 00000004:00080000:2.0:1746144656.434783:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643648685ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434864:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2797, 88 off233072 00000004:00080000:2.0:1746144656.434867:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643732520ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434882:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2871, 88 off239592 00000004:00080000:2.0:1746144656.434886:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643751238ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434892:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2798, 88 off233160 00000004:00080000:2.0:1746144656.434894:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643759441ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.434912:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2872, 88 off239680 00000004:00080000:2.0:1746144656.434915:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643780772ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434921:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2873, 88 off239768 00000004:00080000:2.0:1746144656.434923:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643789020ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434930:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2874, 88 off239856 00000004:00080000:2.0:1746144656.434932:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643797690ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434938:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2875, 88 off239944 00000004:00080000:2.0:1746144656.434940:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635643805388ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.434946:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2799, 88 off233248 00000004:00080000:2.0:1746144656.434949:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635643814105ns, next at 593480289301ns, rc = 0 00000004:00010000:2.0:1746144656.464326:0:14710:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008c7d1880 reply state ffff88009a2e0c00 transno 8589943873 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144656.464337:0:14710:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144656.464437:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:28942:x1830964746517376:12345-192.168.204.23@tcp:36:mirror_io.0 Request processed in 35407us (35633us total) trans 8589943873 rc 0/0 00000100:00100000:2.0:1746144656.464444:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10008 00000001:00080000:0.0:1746144656.464534:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943869 is committed 00000001:00080000:0.0:1746144656.464547:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943872 is committed 00000001:00080000:0.0:1746144656.464558:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943863 is committed 00000001:00080000:0.0:1746144656.464568:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943873 is committed 00000004:00080000:0.0:1746144656.464571:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746144656.464577:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2057 committed 00000004:00080000:0.0:1746144656.464581:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2056 committed 00000004:00080000:0.0:1746144656.464583:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2055 committed 00000004:00080000:0.0:1746144656.464584:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2054 committed 00000004:00080000:0.0:1746144656.464585:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746144656.464586:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2053 committed 00000004:00080000:0.0:1746144656.464587:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746144656.464589:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2052 committed 00000004:00080000:0.0:1746144656.464590:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746144656.464591:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746144656.464593:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746144656.464594:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2051 committed 00000004:00080000:0.0:1746144656.464596:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2050 committed 00000004:00080000:0.0:1746144656.464598:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746144656.464599:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1978 committed 00000004:00080000:0.0:1746144656.464600:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2049 committed 00000001:00080000:0.0:1746144656.464610:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943870 is committed 00000100:00100000:1.0:1746144656.464707:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.464742:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.464763:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428480 00000100:00100000:0.0:1746144656.464768:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428480 00000100:00100000:1.0:1746144656.464776:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.464790:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.464793:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11433 00000100:00100000:0.0:1746144656.464798:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747428480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.464800:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747429504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.464811:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.464820:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747430016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.464830:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.464842:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746144656.464845:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.464856:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.464864:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.464875:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.464883:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747429120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.464893:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.464901:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747429632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.464912:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.464927:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.464939:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.464944:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3295:x1830964747428480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (201us total) trans 17179873187 rc 0/0 00000100:00100000:1.0:1746144656.464949:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.464950:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11433 00000100:00100000:0.0:1746144656.464958:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428992 00000100:00100000:1.0:1746144656.464960:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.464960:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428992 00000100:00100000:1.0:1746144656.464968:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.464970:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429504 00000100:00100000:0.0:1746144656.464972:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429504 00000100:00100000:0.0:1746144656.464979:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747430016 00000100:00100000:0.0:1746144656.464980:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747430016 00000100:00100000:0.0:1746144656.464986:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428096 00000100:00100000:0.0:1746144656.464987:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428096 00000100:00100000:0.0:1746144656.464993:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428608 00000100:00100000:0.0:1746144656.464994:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428608 00000100:00100000:0.0:1746144656.465000:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429120 00000100:00100000:0.0:1746144656.465001:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429120 00000100:00100000:0.0:1746144656.465006:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429632 00000100:00100000:0.0:1746144656.465008:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429632 00000100:00100000:0.0:1746144656.465013:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428224 00000100:00100000:0.0:1746144656.465014:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428224 00010000:00010000:2.0:1746144656.465017:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144656.465019:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428736 00000100:00100000:0.0:1746144656.465020:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428736 00010000:00010000:2.0:1746144656.465024:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144656.465027:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11434 00000100:00100000:0.0:1746144656.465031:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3295:x1830964747428992:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746144656.465034:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.465039:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eef1e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.465047:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.465052:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.465067:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.465070:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144656.465077:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.465082:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1e00/0xa7c849b16e01956b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144656.465102:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11435 00000100:00100000:0.0:1746144656.465103:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3295:x1830964747428992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (312us total) trans 17179873188 rc 0/0 00000100:00100000:2.0:1746144656.465108:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747429504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.465108:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11434 00000100:00100000:0.0:1746144656.465116:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11436 00000100:00100000:0.0:1746144656.465120:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747430016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.465242:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1830964747430016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (410us total) trans 21474840432 rc 0/0 00000100:00100000:2.0:1746144656.465246:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3295:x1830964747429504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (434us total) trans 21474840433 rc 0/0 00000100:00100000:0.0:1746144656.465248:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11436 00000100:00100000:2.0:1746144656.465251:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11435 00000100:00100000:0.0:1746144656.465257:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11437 00000100:00100000:0.0:1746144656.465260:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747428096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.465338:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3295:x1830964747428096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (481us total) trans 21474840434 rc 0/0 00000100:00100000:1.0:1746144656.465372:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.465388:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144656.465642:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429248 00000100:00100000:3.0:1746144656.465646:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429248 00000100:00100000:1.0:1746144656.465710:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.465720:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746144656.465724:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.465735:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.465740:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144656.465750:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.465755:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.465765:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.465771:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.465783:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.465798:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429760 00000100:00100000:1.0:1746144656.465801:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429760 00000100:00100000:2.0:1746144656.465829:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11438 00000100:00100000:2.0:1746144656.465835:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3295:x1830964747428608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.465947:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747428608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (1070us total) trans 21474840435 rc 0/0 00000100:00100000:2.0:1746144656.465953:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11438 00000100:00100000:2.0:1746144656.465962:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428352 00000100:00100000:2.0:1746144656.465964:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428352 00000100:00100000:2.0:1746144656.465972:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747428864 00000100:00100000:2.0:1746144656.465973:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747428864 00000100:00100000:2.0:1746144656.465978:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429376 00000100:00100000:2.0:1746144656.465980:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429376 00000100:00100000:2.0:1746144656.465985:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747429888 00000100:00100000:2.0:1746144656.465987:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747429888 00000100:00100000:2.0:1746144656.465993:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11439 00000100:00100000:2.0:1746144656.465997:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747429120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.466070:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747429120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1175us total) trans 21474840436 rc 0/0 00000100:00100000:2.0:1746144656.466076:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11439 00000100:00100000:2.0:1746144656.466083:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11440 00000100:00100000:2.0:1746144656.466087:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747429632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.466172:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747429632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1250us total) trans 17179873189 rc 0/0 00000100:00100000:2.0:1746144656.466177:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11440 00000100:00100000:2.0:1746144656.466185:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11441 00000100:00100000:2.0:1746144656.466188:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747428224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.466254:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747428224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1313us total) trans 17179873190 rc 0/0 00000100:00100000:2.0:1746144656.466259:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11441 00000100:00100000:2.0:1746144656.466265:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11442 00000100:00100000:2.0:1746144656.466269:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747428736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.466810:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747428736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 540us (1848us total) trans 17179873191 rc 0/0 00000100:00100000:2.0:1746144656.466815:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11442 00000100:00100000:2.0:1746144656.466825:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11443 00000100:00100000:2.0:1746144656.466829:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747428352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.466924:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747428352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (1188us total) trans 21474840437 rc 0/0 00000100:00100000:2.0:1746144656.466930:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11443 00000100:00100000:2.0:1746144656.466938:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11444 00000100:00100000:2.0:1746144656.466942:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747428864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144656.467004:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746144656.467006:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:2.0:1746144656.467008:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:2.0:1746144656.467010:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:2.0:1746144656.467011:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746144656.467027:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747428864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1276us total) trans 21474840438 rc 0/0 00000100:00100000:2.0:1746144656.467032:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11444 00000100:00100000:2.0:1746144656.467039:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11445 00000100:00100000:2.0:1746144656.467043:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747429376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.467109:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747429376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1343us total) trans 17179873192 rc 0/0 00000100:00100000:2.0:1746144656.467114:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11445 00000100:00100000:2.0:1746144656.467121:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11446 00000100:00100000:2.0:1746144656.467125:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747429888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.467309:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11437 00000100:00100000:0.0:1746144656.467502:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840427 gen 2 00000004:00080000:0.0:1746144656.467507:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c946a00, transno 21474840364 00000004:00080000:0.0:1746144656.467512:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013092b100, transno 21474840365 00000004:00080000:0.0:1746144656.467514:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c944e00, transno 21474840366 00000004:00080000:0.0:1746144656.467516:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013092bb80, transno 21474840367 00000004:00080000:0.0:1746144656.467518:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013092aa00, transno 21474840368 00000004:00080000:0.0:1746144656.467520:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130928380, transno 21474840369 00000004:00080000:0.0:1746144656.467522:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013092a300, transno 21474840370 00000004:00080000:0.0:1746144656.467523:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013092a680, transno 21474840371 00000004:00080000:0.0:1746144656.467525:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cfb80, transno 21474840380 00000004:00080000:0.0:1746144656.467527:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b63800, transno 21474840381 00000004:00080000:0.0:1746144656.467529:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cf800, transno 21474840382 00000004:00080000:0.0:1746144656.467531:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4b61c00, transno 21474840383 00000004:00080000:0.0:1746144656.467533:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cd500, transno 21474840384 00000004:00080000:0.0:1746144656.467535:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1fc380, transno 21474840385 00000004:00080000:0.0:1746144656.467537:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cca80, transno 21474840386 00000004:00080000:0.0:1746144656.467540:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f1fdf80, transno 21474840387 00000004:00080000:0.0:1746144656.467542:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33dc00, transno 21474840391 00000004:00080000:0.0:1746144656.467544:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd90700, transno 21474840392 00000004:00080000:0.0:1746144656.467546:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd92a00, transno 21474840393 00000004:00080000:0.0:1746144656.467548:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801309d7800, transno 21474840394 00000004:00080000:0.0:1746144656.467551:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd90380, transno 21474840395 00000004:00080000:0.0:1746144656.467553:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd90a80, transno 21474840396 00000004:00080000:0.0:1746144656.467554:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd93800, transno 21474840397 00000004:00080000:0.0:1746144656.467556:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801309d4000, transno 21474840398 00000004:00080000:0.0:1746144656.467559:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32fb80, transno 21474840399 00000004:00080000:0.0:1746144656.467561:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32df80, transno 21474840400 00000004:00080000:0.0:1746144656.467562:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d28380, transno 21474840401 00000004:00080000:0.0:1746144656.467564:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d28000, transno 21474840402 00000004:00080000:0.0:1746144656.467566:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d28e00, transno 21474840403 00000004:00080000:0.0:1746144656.467568:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d28a80, transno 21474840404 00000004:00080000:0.0:1746144656.467571:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d28700, transno 21474840405 00000004:00080000:0.0:1746144656.467572:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d29180, transno 21474840406 00000004:00080000:0.0:1746144656.467575:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c2d80, transno 21474840412 00000004:00080000:0.0:1746144656.467577:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c2a00, transno 21474840413 00000004:00080000:0.0:1746144656.467579:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c1f80, transno 21474840414 00000004:00080000:0.0:1746144656.467581:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c0a80, transno 21474840415 00000004:00080000:0.0:1746144656.467583:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c3800, transno 21474840416 00000004:00080000:0.0:1746144656.467585:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c3480, transno 21474840417 00000004:00080000:0.0:1746144656.467587:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c3b80, transno 21474840418 00000004:00080000:0.0:1746144656.467589:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0c3100, transno 21474840419 00000004:00080000:0.0:1746144656.467591:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1ce680, transno 21474840420 00000004:00080000:0.0:1746144656.467592:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cea00, transno 21474840421 00000004:00080000:0.0:1746144656.467595:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cc380, transno 21474840422 00000004:00080000:0.0:1746144656.467597:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cd180, transno 21474840423 00000004:00080000:0.0:1746144656.467599:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cf100, transno 21474840424 00000004:00080000:0.0:1746144656.467601:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cdf80, transno 21474840425 00000004:00080000:0.0:1746144656.467602:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cf480, transno 21474840426 00000004:00080000:0.0:1746144656.467604:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cc700, transno 21474840427 00000100:00100000:0.0:1746144656.467609:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008f33f480 x1830964747428096/t21474840434(21474840434) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144672 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746144656.467617:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33f480/2, rc 0, transno 21474840434 00000100:00100000:0.0:1746144656.467621:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144656.467631:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33e680/2, rc 0, transno 21474840435 00000100:00100000:0.0:1746144656.467634:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144656.467641:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33f800/2, rc 0, transno 21474840436 00000100:00100000:0.0:1746144656.467643:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747429120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144656.467651:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d3800/2, rc 0, transno 17179873189 00000100:00100000:0.0:1746144656.467657:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747429632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144656.467664:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d2d80/2, rc 0, transno 17179873187 00000100:00100000:0.0:1746144656.467666:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144656.467673:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d3b80/2, rc 0, transno 17179873188 00000100:00100000:0.0:1746144656.467675:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747428992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144656.467681:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33df80/2, rc 0, transno 21474840433 00000100:00100000:0.0:1746144656.467684:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747429504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144656.467690:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33d180/2, rc 0, transno 21474840432 00000100:00100000:0.0:1746144656.467692:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747430016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144656.467877:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11447 00000100:00100000:1.0:1746144656.467882:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11448 00000100:00100000:1.0:1746144656.467888:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1830964747429760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144656.467890:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747429248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144656.467970:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747429248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (2598us total) trans 17179873193 rc 0/0 00000100:00100000:1.0:1746144656.467970:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1830964747429760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (2259us total) trans 21474840439 rc 0/0 00000100:00100000:1.0:1746144656.467975:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11448 00000100:00100000:3.0:1746144656.468058:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11447 00000100:00100000:2.0:1746144656.468281:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747429888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1155us (2496us total) trans 17179873194 rc 0/0 00000100:00100000:2.0:1746144656.468285:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11446 00000004:00080000:2.0:1746144656.468348:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33fb80/2, rc 0, transno 21474840437 00000100:00100000:2.0:1746144656.468352:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428352:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144656.468358:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33c000/2, rc 0, transno 21474840438 00000100:00100000:2.0:1746144656.468361:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144656.468367:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d0e00/2, rc 0, transno 17179873192 00000100:00100000:2.0:1746144656.468370:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.468373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000004:00080000:2.0:1746144656.468375:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d1180/2, rc 0, transno 17179873194 00000100:00100000:2.0:1746144656.468377:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.468384:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d1f80/2, rc 0, transno 17179873190 00000100:00100000:2.0:1746144656.468387:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.468393:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d3100/2, rc 0, transno 17179873191 00000100:00100000:2.0:1746144656.468395:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747428736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.468409:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d0380/2, rc 0, transno 17179873193 00000100:00100000:2.0:1746144656.468411:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429248:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.468417:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f33ca80/2, rc 0, transno 21474840439 00000100:00100000:2.0:1746144656.468419:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747429760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.468653:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747430144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.468676:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.468708:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747430144 00000100:00100000:2.0:1746144656.468712:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747430144 00000100:00100000:2.0:1746144656.468727:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11449 00000100:00100000:2.0:1746144656.468731:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3296:x1830964747430144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.468805:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3296:x1830964747430144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (129us total) trans 17179873195 rc 0/0 00000100:00100000:2.0:1746144656.468810:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11449 00000004:00080000:2.0:1746144656.468826:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c7d2a00/2, rc 0, transno 17179873195 00000100:00100000:2.0:1746144656.468829:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747430144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144656.468872:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746518016 00000100:00100000:3.0:1746144656.468876:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746518016 00000100:00100000:3.0:1746144656.468906:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10009 00000100:00100000:3.0:1746144656.468913:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28942:x1830964746518016:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144656.468924:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.468938:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4cf expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.468981:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.468992:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.469005:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.469008:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144656.469010:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d35200, rc 0) 00000100:00100000:3.0:1746144656.469036:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28942:x1830964746518016:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 124us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.469041:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10009 00000004:00080000:0.0:1746144656.470237:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 48 done 00000100:00100000:0.0:1746144656.479385:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.479480:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746518144 00000100:00100000:1.0:1746144656.479488:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746518144 00000100:00100000:1.0:1746144656.479530:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 622 00000100:00100000:1.0:1746144656.479537:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28942:x1830964746518144:12345-192.168.204.23@tcp:103:mirror_io.0 00010000:00010000:1.0:1746144656.479551:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.479572:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e01952c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4c1 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.479604:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144656.479608:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.479644:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28942:x1830964746518144:12345-192.168.204.23@tcp:103:mirror_io.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.479650:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 622 00000100:00100000:0.0:1746144656.481965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.482048:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746518400 00000100:00100000:3.0:1746144656.482054:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746518400 00000100:00100000:3.0:1746144656.482093:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4016 00000100:00100000:3.0:1746144656.482100:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28942:x1830964746518400:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:3.0:1746144656.482351:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28942:x1830964746518400:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 251us (391us total) trans 8589943874 rc 0/0 00000100:00100000:3.0:1746144656.482362:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4016 00000100:00100000:0.0:1746144656.486418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.486485:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746518656 00000100:00100000:2.0:1746144656.486495:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746518656 00000100:00100000:2.0:1746144656.486552:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4017 00000100:00100000:2.0:1746144656.486559:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28942:x1830964746518656:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:2.0:1746144656.487124:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28942:x1830964746518656:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 564us (716us total) trans 8589943875 rc 0/0 00000100:00100000:2.0:1746144656.487131:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4017 00000100:00100000:1.0:1746144656.498476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.498597:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746518912 00000100:00100000:2.0:1746144656.498607:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746518912 00000100:00100000:2.0:1746144656.498815:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10010 00000100:00100000:2.0:1746144656.498824:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+6:28947:x1830964746518912:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.498851:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.498872:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a7200/0xa7c849b16e019579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4d6 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.498988:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499001:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499011:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499026:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499031:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499040:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499159:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499176:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499182:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144656.499192:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144656.499267:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499274:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499280:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499286:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a6c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.499289:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499295:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499304:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144656.499307:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144656.499310:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499319:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a6c00/0xa7c849b16e019580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499336:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499340:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499345:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499349:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009418ee00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.499351:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499355:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499360:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f204f00) 00010000:00010000:2.0:1746144656.499362:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144656.499364:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499368:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ee00/0xa7c849b16e019587 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.499400:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a7200/0xa7c849b16e019579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.499410:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.499422:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.499424:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144656.499426:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418ec00, rc 0) 00000100:00100000:2.0:1746144656.499486:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28947:x1830964746518912:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 663us (1020us total) trans 8589943876 rc 0/0 00000100:00100000:2.0:1746144656.499492:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10010 00000100:00100000:0.0:1746144656.522718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.522786:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746519168 00000100:00100000:3.0:1746144656.522797:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746519168 00000100:00100000:3.0:1746144656.522878:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10011 00000100:00100000:3.0:1746144656.522887:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:28951:x1830964746519168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.522913:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.522933:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d34800/0xa7c849b16e01959c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4dd expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.523046:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523059:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523070:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523082:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523087:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523093:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523238:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523246:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523252:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144656.523260:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144656.523335:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523341:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523353:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523358:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b62e000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.523362:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523368:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523377:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144656.523379:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144656.523384:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523388:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b62e000/0xa7c849b16e0195a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523409:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523413:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523418:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523422:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b43c4800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144656.523424:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523428:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523436:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33e00) 00010000:00010000:3.0:1746144656.523438:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144656.523440:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523445:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4800/0xa7c849b16e0195aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.523476:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d34800/0xa7c849b16e01959c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.523486:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.523492:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.523494:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144656.523497:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b43c5000, rc 0) 00000100:00100000:3.0:1746144656.523550:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28951:x1830964746519168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 665us (845us total) trans 8589943877 rc 0/0 00000100:00100000:3.0:1746144656.523555:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10011 00000100:00100000:0.0:1746144656.526557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.526814:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746519424 00000100:00100000:3.0:1746144656.526824:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746519424 00000100:00100000:3.0:1746144656.527308:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4018 00000100:00100000:3.0:1746144656.527320:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28951:x1830964746519424:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144656.527535:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28951:x1830964746519424:12345-192.168.204.23@tcp:35:cat.0 Request processed in 217us (987us total) trans 8589943878 rc 0/0 00000100:00100000:3.0:1746144656.527542:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4018 00000100:00100000:0.0:1746144656.529508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.530792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.530829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.531078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.531197:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746519552 00000100:00100000:2.0:1746144656.531207:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746519552 00000100:00100000:0.0:1746144656.531212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.531248:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746519808 00000100:00100000:2.0:1746144656.531250:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746519808 00000100:00100000:2.0:1746144656.531261:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746520064 00000100:00100000:2.0:1746144656.531263:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746520064 00000100:00100000:2.0:1746144656.531272:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746519680 00000100:00100000:2.0:1746144656.531273:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746519680 00000100:00100000:0.0:1746144656.531290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.531511:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746519936 00000100:00100000:2.0:1746144656.531511:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746520192 00000100:00100000:2.0:1746144656.531513:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746520192 00000100:00100000:3.0:1746144656.531516:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746519936 00000100:00100000:2.0:1746144656.531528:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11450 00000100:00100000:2.0:1746144656.531535:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746519552:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144656.531551:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11451 00010000:00010000:2.0:1746144656.531555:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144656.531557:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746519808:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.531565:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.531576:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4e4 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.531577:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4f2 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144656.531601:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d8e, atime: 0x68140d8e, ctime: 0x68140d8e, blocks: 0x821 00002000:00010000:2.0:1746144656.531601:0:29370:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d8f, atime: 0x68140d8e, ctime: 0x68140d8f, blocks: 0x809 00010000:00010000:3.0:1746144656.531620:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.531620:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.531622:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.531622:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.531631:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 18 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.531631:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.531646:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 18 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.531648:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.531656:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b43c4400, rc 0) 00010000:00010000:2.0:1746144656.531656:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a6800, rc 0) 00000100:00100000:1.0:1746144656.531690:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11452 00000100:00100000:1.0:1746144656.531697:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746520064:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144656.531703:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746519808:12345-192.168.204.23@tcp:101:cat.0 Request processed in 147us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.531703:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746519552:12345-192.168.204.23@tcp:101:cat.0 Request processed in 169us (2201us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144656.531705:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144656.531708:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11451 00000100:00100000:2.0:1746144656.531712:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11450 00010000:00010000:1.0:1746144656.531714:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e500 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144656.531727:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d90, atime: 0x68140d90, ctime: 0x68140d90, blocks: 0x15eb 00000100:00100000:2.0:1746144656.531729:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11453 00000100:00100000:3.0:1746144656.531732:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11454 00000100:00100000:2.0:1746144656.531734:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746519680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.531735:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.531736:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144656.531738:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746520192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144656.531739:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.531741:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.531743:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.531750:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4eb expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.531750:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.531751:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e507 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.531757:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51ca00, rc 0) 00002000:00010000:2.0:1746144656.531762:0:29370:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d91, atime: 0x68140d91, ctime: 0x68140d91, blocks: 0x821 00002000:00010000:3.0:1746144656.531767:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d90, atime: 0x68140d90, ctime: 0x68140d90, blocks: 0x1029 00010000:00010000:2.0:1746144656.531768:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.531770:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.531774:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.531774:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 19 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.531775:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144656.531775:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746520064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 79us (946us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144656.531778:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 19 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144656.531779:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11452 00010000:00010000:2.0:1746144656.531783:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 19 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.531787:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 19 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.531790:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b42fe000, rc 0) 00000100:00100000:1.0:1746144656.531790:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11455 00010000:00010000:3.0:1746144656.531794:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b43c4200, rc 0) 00000100:00100000:1.0:1746144656.531794:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746519936:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.531799:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144656.531804:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746519680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 70us (726us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144656.531805:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e4f9 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.531807:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746520192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 71us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.531812:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11454 00000100:00100000:2.0:1746144656.531815:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11453 00002000:00010000:1.0:1746144656.531816:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d90, atime: 0x68140d8e, ctime: 0x68140d90, blocks: 0x821 00010000:00010000:1.0:1746144656.531823:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.531824:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.531828:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.531835:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.531842:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51d200, rc 0) 00000100:00100000:1.0:1746144656.531854:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746519936:12345-192.168.204.23@tcp:101:cat.0 Request processed in 60us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.531859:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11455 00000100:00100000:0.0:1746144656.548335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.548583:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746520960 00000100:00100000:2.0:1746144656.548593:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746520960 00002000:00100000:2.0:1746144656.548644:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130928380 x1830964746520960/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.548653:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928380 with x1830964746520960 ext(1048576->2097151) 00000100:00100000:0.0:1746144656.548653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:2.0:1746144656.548658:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130928380 00000100:00100000:0.0:1746144656.549103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.549199:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746521216 00000100:00100000:2.0:1746144656.549203:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746521216 00000100:00100000:3.0:1746144656.549230:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746520576 00000100:00100000:3.0:1746144656.549235:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746520576 00000100:00100000:0.0:1746144656.549277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.549292:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746520832 00000100:00100000:0.0:1746144656.549295:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746520832 00002000:00100000:0.0:1746144656.549311:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880130929180 x1830964746520832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.549318:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929180 with x1830964746520832 ext(1048576->2097151) 00002000:00010000:0.0:1746144656.549322:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130929180 00000100:00100000:0.0:1746144656.549332:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4315 00000100:00100000:0.0:1746144656.549339:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746520960:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:3.0:1746144656.550229:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88013092a680 x1830964746520576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.550239:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092a680 with x1830964746520576 ext(0->1048575) 00002000:00010000:3.0:1746144656.550243:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092a680 00000100:00100000:3.0:1746144656.550265:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4316 00000100:00100000:3.0:1746144656.550274:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746520832:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144656.550445:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88013092a300 x1830964746521216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.550453:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092a300 with x1830964746521216 ext(1048576->2097151) 00002000:00010000:2.0:1746144656.550457:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092a300 00000100:00100000:2.0:1746144656.550473:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4317 00000100:00100000:2.0:1746144656.550481:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746520576:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.550739:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4318 00000100:00100000:1.0:1746144656.550748:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746521216:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.561122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.561188:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746521472 00000100:00100000:2.0:1746144656.561199:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746521472 00000100:00100000:2.0:1746144656.561259:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10012 00000100:00100000:2.0:1746144656.561268:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28953:x1830964746521472:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.561295:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.561314:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e0195e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e50e expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.561411:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.561429:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.561437:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.561443:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.561473:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.561484:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 300 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.561496:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747430272:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.561600:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.561607:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 7 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.561615:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747430400:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.561635:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.572891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.572969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.573000:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746521600 00000100:00100000:0.0:1746144656.573008:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746521600 00010000:00010000:0.0:1746144656.573049:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 301 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.573076:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746521728 00000100:00100000:0.0:1746144656.573078:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746521728 00010000:00010000:0.0:1746144656.573089:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 8 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.573119:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5700 00000100:00100000:0.0:1746144656.573127:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1962:x1830964746521600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.573181:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.573188:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 301 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.573199:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 301 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.573221:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144656.573226:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.573478:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e0195b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4dd expref: 301 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.573499:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747430272:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144656.573510:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747430400:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.573587:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5701 00000100:00100000:3.0:1746144656.573608:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:1962:x1830964746521728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.573616:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.573622:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 8 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.575288:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746521216:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24360us (26452us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.575307:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4318 00002000:00100000:1.0:1746144656.575322:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88013092a300 x1830964746521216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.575332:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092a300 with x1830964746521216 ext(1048576->2097151) 00002000:00010000:1.0:1746144656.575337:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092a300 00010000:00010000:0.0:1746144656.576715:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.576740:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.576781:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1962:x1830964746521600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3652us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.576791:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5700 00000100:00100000:1.0:1746144656.577320:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746520576:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26839us (28215us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.577327:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4317 00002000:00100000:1.0:1746144656.577335:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88013092a680 x1830964746520576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.577343:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092a680 with x1830964746520576 ext(0->1048575) 00000100:00100000:0.0:1746144656.577666:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746520832:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27391us (28385us total) trans 0 rc 1048576/1048576 00002000:00010000:1.0:1746144656.577673:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092a680 00000100:00100000:0.0:1746144656.577673:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4316 00002000:00100000:0.0:1746144656.577681:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880130929180 x1830964746520832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.577688:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929180 with x1830964746520832 ext(1048576->2097151) 00002000:00010000:0.0:1746144656.577692:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130929180 00010000:00010000:2.0:1746144656.578038:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.578539:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 8 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.578563:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009418ec00/0xa7c849b16e01958e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4d6 expref: 8 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.578590:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.578594:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.578601:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.578606:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.578651:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.578702:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:1962:x1830964746521728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5107us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.578710:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5701 00010000:00010000:2.0:1746144656.578852:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144656.578858:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144656.578873:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144656.578984:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e0195e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.578998:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.579003:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.579005:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144656.579007:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3ebc00, rc 0) 00000100:00100000:2.0:1746144656.579033:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28953:x1830964746521472:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 17766us (17923us total) trans 8589943879 rc 0/0 00000100:00100000:2.0:1746144656.579038:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10012 00000100:00100000:1.0:1746144656.584828:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746520960:12345-192.168.204.23@tcp:3:cat.0 Request processed in 35474us (36489us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.584842:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4315 00002000:00100000:1.0:1746144656.584856:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880130928380 x1830964746520960/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.584865:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928380 with x1830964746520960 ext(1048576->2097151) 00002000:00010000:1.0:1746144656.584871:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130928380 00000100:00100000:0.0:1746144656.590220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.590392:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746521856 00000100:00100000:3.0:1746144656.590401:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746521856 00000100:00100000:3.0:1746144656.590468:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10013 00000100:00100000:3.0:1746144656.590478:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28951:x1830964746521856:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.590516:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.590537:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0195fe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e515 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.590605:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0195fe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e515 expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.590619:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0195fe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e515 expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.590638:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.590641:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144656.590644:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a5a00, rc 0) 00000100:00100000:3.0:1746144656.590707:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28951:x1830964746521856:12345-192.168.204.23@tcp:101:cat.0 Request processed in 231us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.590713:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10013 00000100:00100000:0.0:1746144656.596196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.596263:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746522112 00000100:00100000:2.0:1746144656.596274:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746522112 00000100:00100000:0.0:1746144656.596291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.596325:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746522240 00000100:00100000:2.0:1746144656.596327:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746522240 00000100:00100000:2.0:1746144656.596349:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10014 00000100:00100000:2.0:1746144656.596356:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28953:x1830964746522112:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.596382:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.596386:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144656.596415:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0195fe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e515 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.596436:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.596441:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144656.596451:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019605 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e51c expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.596506:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.596518:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.596525:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.596556:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.596568:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 8 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.596580:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747430528:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.596591:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10015 00000100:00100000:3.0:1746144656.596615:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28951:x1830964746522240:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.596623:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.596631:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e523 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.596661:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746144656.596663:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.596670:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.596680:0:14709:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.596717:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.596727:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.596730:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144656.596732:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.596738:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a5200, rc 0) 00000100:00100000:3.0:1746144656.596764:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28951:x1830964746522240:12345-192.168.204.23@tcp:101:cat.0 Request processed in 165us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.596770:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10015 00000100:00100000:0.0:1746144656.597823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.597844:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747430528:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144656.597860:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00000100:00100000:3.0:1746144656.597876:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746522368 00000100:00100000:3.0:1746144656.597881:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746522368 00010000:00010000:3.0:1746144656.597906:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.597940:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5702 00000100:00100000:3.0:1746144656.597948:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746522368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144656.597959:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144656.597964:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.597972:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.597987:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e019572 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4cf expref: 9 pid: 14710 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.598000:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.598003:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.598010:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.598016:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144656.598022:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.598042:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.598081:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746522368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 133us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.598086:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5702 00010000:00010000:2.0:1746144656.600118:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.600131:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00000040:00080000:2.0:1746144656.602218:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2876, 88 off240032 00000004:00080000:2.0:1746144656.602229:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811094337ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602262:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2800, 88 off233336 00000004:00080000:2.0:1746144656.602265:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811130485ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602290:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2801, 88 off233424 00000004:00080000:2.0:1746144656.602294:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811159311ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602302:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2877, 88 off240120 00000004:00080000:2.0:1746144656.602304:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811169342ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602310:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2878, 88 off240208 00000004:00080000:2.0:1746144656.602312:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811177570ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602318:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2802, 88 off233512 00000004:00080000:2.0:1746144656.602320:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811185747ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602325:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2803, 88 off233600 00000004:00080000:2.0:1746144656.602329:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811194312ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602334:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2804, 88 off233688 00000004:00080000:2.0:1746144656.602337:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811202532ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602343:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2879, 88 off240296 00000004:00080000:2.0:1746144656.602345:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811210602ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602351:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2805, 88 off233776 00000004:00080000:2.0:1746144656.602353:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811218758ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602360:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2880, 88 off240384 00000004:00080000:2.0:1746144656.602363:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811228971ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602370:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2806, 88 off233864 00000004:00080000:2.0:1746144656.602372:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811237651ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144656.602379:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2881, 88 off240472 00000004:00080000:2.0:1746144656.602382:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811247225ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602387:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2882, 88 off240560 00000004:00080000:2.0:1746144656.602390:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811255546ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602395:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2883, 88 off240648 00000004:00080000:2.0:1746144656.602398:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811263178ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602403:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2884, 88 off240736 00000004:00080000:2.0:1746144656.602406:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635811271170ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144656.602411:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2807, 88 off233952 00000004:00080000:2.0:1746144656.602414:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635811279257ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144656.611126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.611188:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746522624 00000100:00100000:0.0:1746144656.611197:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746522624 00000100:00100000:0.0:1746144656.611246:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10016 00000100:00100000:0.0:1746144656.611254:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+7:28956:x1830964746522624:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144656.611279:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.611297:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e01961a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e52a expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.611405:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611418:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611433:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611445:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611450:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611454:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611554:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611563:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611568:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000004:00200000:0.0:1746144656.611577:0:22257:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144656.611703:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611710:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611716:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611721:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edd3400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144656.611725:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611732:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611741:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144656.611744:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1746144656.611748:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611752:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3400/0xa7c849b16e01962f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611762:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611767:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611771:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611775:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edd2800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144656.611777:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611781:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611786:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144656.611801:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144656.611804:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611808:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd2800/0xa7c849b16e019621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611817:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611822:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611826:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.611830:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009edd3000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144656.614737:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.614748:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.614763:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8a00) 00010000:00010000:0.0:1746144656.614766:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144656.614769:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.614775:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3000/0xa7c849b16e019628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:0.0:1746144656.614838:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e01961a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e52a expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.614846:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edd3600/0xa7c849b16e01961a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e52a expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.614853:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3600, rc 0) 00000100:00100000:0.0:1746144656.614918:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+8:28956:x1830964746522624:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3664us (3798us total) trans 8589943881 rc 301/301 00000100:00100000:0.0:1746144656.614926:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10016 00000100:00100000:0.0:1746144656.620802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.620834:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746522752 00000100:00100000:0.0:1746144656.621253:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746522752 00000100:00100000:0.0:1746144656.621296:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10017 00000100:00100000:0.0:1746144656.621304:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28956:x1830964746522752:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144656.621327:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.621346:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273600/0xa7c849b16e01963d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e531 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.621422:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.621435:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.621442:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.621469:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.621479:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 303 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.621490:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747430656:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144656.621639:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.624386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.624411:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746522880 00000100:00100000:0.0:1746144656.624417:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746522880 00010000:00010000:0.0:1746144656.624450:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.624476:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5703 00000100:00100000:0.0:1746144656.624483:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1960:x1830964746522880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.624496:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.624501:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.624513:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 304 pid: 14709 timeout: 735 lvb_type: 0 00010000:00010000:0.0:1746144656.624534:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144656.624538:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.624546:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.624552:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 304 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.624558:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144656.624563:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.624599:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:1960:x1830964746522880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 117us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.624607:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5703 00010000:00010000:0.0:1746144656.624706:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ebc00/0xa7c849b16e0195f0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e50e expref: 303 pid: 14709 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.624722:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747430656:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144656.624739:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144656.636714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.637131:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523008 00000100:00100000:3.0:1746144656.637157:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523008 00000100:00100000:3.0:1746144656.637228:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10018 00000100:00100000:3.0:1746144656.637238:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:28947:x1830964746523008:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.637253:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.637332:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e538 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.637403:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 11 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.637418:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 11 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.637428:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.637431:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144656.637434:0:22257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.637439:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a4600, rc 0) 00000100:00100000:3.0:1746144656.637482:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:28947:x1830964746523008:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 246us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.637488:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10018 00000001:00080000:2.0:1746144656.638886:0:2743:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943880 is committed 00000004:00080000:2.0:1746144656.638893:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1993 committed 00000004:00080000:2.0:1746144656.638899:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2066 committed 00000004:00080000:2.0:1746144656.638904:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2065 committed 00000004:00080000:2.0:1746144656.638906:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2064 committed 00000004:00080000:2.0:1746144656.638907:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2063 committed 00000004:00080000:2.0:1746144656.638909:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1992 committed 00000004:00080000:2.0:1746144656.638910:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2062 committed 00000004:00080000:2.0:1746144656.638912:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1991 committed 00000004:00080000:2.0:1746144656.638913:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2061 committed 00000004:00080000:2.0:1746144656.638915:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1990 committed 00000004:00080000:2.0:1746144656.638916:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1989 committed 00000004:00080000:2.0:1746144656.638918:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1988 committed 00000004:00080000:2.0:1746144656.638919:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2060 committed 00000004:00080000:2.0:1746144656.638920:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2059 committed 00000004:00080000:2.0:1746144656.638923:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1987 committed 00000004:00080000:2.0:1746144656.638925:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1986 committed 00000004:00080000:2.0:1746144656.638926:0:2743:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2058 committed 00000001:00080000:2.0:1746144656.638932:0:2743:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943876 is committed 00000001:00080000:2.0:1746144656.638936:0:2743:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943875 is committed 00000100:00100000:2.0:1746144656.639028:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747430784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639052:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747431040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.639064:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.639077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639084:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639093:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747431552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.639099:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.639109:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639111:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.639120:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747432064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639126:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.639157:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747430784 00000100:00100000:0.0:1746144656.639169:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747430784 00000100:00100000:2.0:1746144656.639173:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747432320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.639189:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431040 00000100:00100000:0.0:1746144656.639191:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431040 00000100:00100000:2.0:1746144656.639193:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.639203:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431296 00000100:00100000:0.0:1746144656.639205:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431296 00000100:00100000:2.0:1746144656.639208:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746144656.639212:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747430912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639212:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431552 00000100:00100000:0.0:1746144656.639213:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431552 00000100:00100000:0.0:1746144656.639220:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431808 00000100:00100000:0.0:1746144656.639221:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431808 00000100:00100000:2.0:1746144656.639227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.639232:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747432320 00000100:00100000:0.0:1746144656.639233:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747432320 00000100:00100000:2.0:1746144656.639238:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639238:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747430912 00000100:00100000:0.0:1746144656.639240:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747430912 00000100:00100000:0.0:1746144656.639246:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11456 00000100:00100000:2.0:1746144656.639250:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144656.639251:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3293:x1830964747430784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.639258:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639269:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639276:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747432448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639287:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639300:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747431168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.639314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639320:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747431680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144656.639334:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639341:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747432192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639353:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144656.639359:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747432704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639371:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746144656.639380:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144656.639381:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144656.639385:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:0.0:1746144656.639387:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144657 -> 1746144657 00000100:00100000:2.0:1746144656.639388:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431424 00002000:00010000:0.0:1746144656.639388:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00010000:00010000:3.0:1746144656.639390:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:2.0:1746144656.639390:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431424 00002000:00010000:0.0:1746144656.639390:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00010000:00010000:3.0:1746144656.639393:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746144656.639395:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144656.639403:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144656.639403:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431936 00000100:00100000:2.0:1746144656.639404:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431936 00010000:00010000:3.0:1746144656.639408:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144656.639410:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747432448 00000100:00100000:2.0:1746144656.639411:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747432448 00010000:00010000:3.0:1746144656.639414:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.639416:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431168 00000100:00100000:0.0:1746144656.639416:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3293:x1830964747430784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (351us total) trans 21474840440 rc 0/0 00000100:00100000:2.0:1746144656.639417:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431168 00000100:00100000:0.0:1746144656.639422:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11456 00010000:00010000:3.0:1746144656.639425:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.639425:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747431680 00000100:00100000:2.0:1746144656.639427:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747431680 00010000:00010000:3.0:1746144656.639430:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.639432:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747432704 00000100:00100000:0.0:1746144656.639432:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747432192 00000100:00100000:2.0:1746144656.639434:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747432704 00000100:00100000:0.0:1746144656.639434:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747432192 00010000:00010000:3.0:1746144656.639437:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.639441:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11457 00010000:00010000:3.0:1746144656.639443:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.639445:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830964747431040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639447:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11458 00010000:00010000:3.0:1746144656.639448:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.639451:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747431296:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746144656.639467:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.639475:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747432832:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.639477:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11459 00000100:00100000:2.0:1746144656.639481:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830964747431552:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746144656.639533:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.639533:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747431296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (432us total) trans 21474840441 rc 0/0 00000100:00100000:0.0:1746144656.639538:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11458 00000100:00100000:3.0:1746144656.639540:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747432960:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144656.639547:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11460 00000100:00100000:0.0:1746144656.639551:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830964747431808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639558:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747431552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (447us total) trans 21474840442 rc 0/0 00000100:00100000:2.0:1746144656.639563:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11459 00000100:00100000:3.0:1746144656.639564:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.639573:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11461 00000100:00100000:2.0:1746144656.639576:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3293:x1830964747432320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144656.639630:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144656.639632:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144655 -> 1746144655 00002000:00010000:0.0:1746144656.639633:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:0.0:1746144656.639635:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144655 -> 1746144655 00010000:00010000:3.0:1746144656.639636:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00002000:00010000:0.0:1746144656.639636:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00010000:00010000:3.0:1746144656.639650:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144656.639654:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747432320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (459us total) trans 17179873197 rc 0/0 00000100:00100000:0.0:1746144656.639656:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747431808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (529us total) trans 17179873196 rc 0/0 00000100:00100000:2.0:1746144656.639659:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11461 00000100:00100000:0.0:1746144656.639664:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11460 00000100:00100000:2.0:1746144656.639669:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11462 00000100:00100000:2.0:1746144656.639673:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747430912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639674:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11463 00000004:00200000:3.0:1746144656.639676:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:0.0:1746144656.639677:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747431424:12345-0@lo:2:osp-syn-0-0.0 00000004:00200000:3.0:1746144656.639680:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144656.639702:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144656.639703:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11464 00000100:00100000:2.0:1746144656.639707:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3293:x1830964747431936:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746144656.639728:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273600/0xa7c849b16e01963d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.639739:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.639745:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144656.639747:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:0.0:1746144656.639748:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747431424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (496us total) trans 21474840443 rc 0/0 00010000:00010000:3.0:1746144656.639749:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273c00, rc 0) 00000100:00100000:0.0:1746144656.639753:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11463 00000100:00100000:0.0:1746144656.639766:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11465 00000100:00100000:3.0:1746144656.639769:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:28956:x1830964746522752:12345-192.168.204.23@tcp:101:cat.0 Request processed in 18465us (18976us total) trans 0 rc 0/0 00002000:00010000:2.0:1746144656.639769:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746144656.639770:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747432448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144656.639771:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144656 -> 1746144656 00002000:00010000:2.0:1746144656.639773:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00000100:00100000:3.0:1746144656.639774:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10017 00002000:00010000:2.0:1746144656.639774:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144656 -> 1746144656 00002000:00010000:2.0:1746144656.639776:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144656.639794:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747431936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (524us total) trans 17179873198 rc 0/0 00000100:00100000:2.0:1746144656.639799:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11464 00000100:00100000:2.0:1746144656.639810:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11466 00000100:00100000:2.0:1746144656.639814:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747431168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.639840:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747432448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (552us total) trans 17179873199 rc 0/0 00000100:00100000:0.0:1746144656.639845:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11465 00000100:00100000:0.0:1746144656.639856:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11467 00000100:00100000:0.0:1746144656.639860:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747431680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144656.639871:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746144656.639873:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:2.0:1746144656.639875:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00000100:00100000:1.0:1746144656.639875:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11468 00002000:00010000:2.0:1746144656.639877:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:2.0:1746144656.639878:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144656.639882:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3296:x1830964747432704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144656.639897:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747431168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (582us total) trans 21474840444 rc 0/0 00000100:00100000:2.0:1746144656.639901:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11466 00000100:00100000:2.0:1746144656.639910:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11469 00000100:00100000:2.0:1746144656.639915:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3296:x1830964747432192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144656.639930:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747431680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (594us total) trans 21474840445 rc 0/0 00000100:00100000:0.0:1746144656.639934:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11467 00000100:00100000:2.0:1746144656.639990:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3296:x1830964747432192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (636us total) trans 17179873201 rc 0/0 00000100:00100000:1.0:1746144656.639990:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3296:x1830964747432704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (617us total) trans 17179873200 rc 0/0 00000100:00100000:2.0:1746144656.639996:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11469 00000100:00100000:1.0:1746144656.639999:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11468 00000100:00100000:0.0:1746144656.640022:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.640035:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747432064 00000100:00100000:1.0:1746144656.640038:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747432064 00000100:00100000:0.0:1746144656.640039:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747432576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.640052:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11470 00000100:00100000:0.0:1746144656.640054:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144656.640057:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747432064:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144656.640079:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01d500/2, rc 0, transno 21474840442 00000100:00100000:0.0:1746144656.640083:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747431552:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144656.640090:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01f800/2, rc 0, transno 21474840444 00000100:00100000:0.0:1746144656.640093:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747432576 00000100:00100000:3.0:1746144656.640095:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747431168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.640096:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747432576 00002000:00010000:2.0:1746144656.640099:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:3.0:1746144656.640102:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01ea00/2, rc 0, transno 21474840445 00002000:00010000:2.0:1746144656.640102:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144656 -> 1746144656 00002000:00010000:2.0:1746144656.640103:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144656 -> 1746144656 00000100:00100000:3.0:1746144656.640105:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747431680:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144656.640105:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144656 -> 1746144656 00002000:00010000:2.0:1746144656.640106:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144656.640108:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11471 00000004:00080000:3.0:1746144656.640112:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01ce00/2, rc 0, transno 17179873201 00000100:00100000:0.0:1746144656.640113:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747432576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144656.640119:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747432192:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144656.640122:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144656.640124:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144656 -> 1746144656 00000004:00080000:3.0:1746144656.640125:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01c380/2, rc 0, transno 17179873200 00000100:00100000:2.0:1746144656.640125:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747431040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 679us (1047us total) trans 21474840446 rc 0/0 00002000:00010000:1.0:1746144656.640126:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144656 -> 1746144656 00000100:00100000:3.0:1746144656.640128:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747432704:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144656.640128:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144656 -> 1746144656 00000100:00100000:2.0:1746144656.640129:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11457 00002000:00010000:1.0:1746144656.640130:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5611 00000100:00100000:1.0:1746144656.640170:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747432064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (139us total) trans 17179873202 rc 0/0 00000100:00100000:1.0:1746144656.640175:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11470 00000100:00100000:3.0:1746144656.640182:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746144656.640188:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747433088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144656.640208:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746144656.640211:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144656.640213:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144654 -> 1746144654 00002000:00010000:2.0:1746144656.640214:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00000100:00100000:0.0:1746144656.640214:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747432576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (158us total) trans 17179873203 rc 0/0 00002000:00010000:2.0:1746144656.640216:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144654 -> 1746144654 00002000:00010000:2.0:1746144656.640217:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144656.640219:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747433088 00000100:00100000:0.0:1746144656.640219:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11471 00000100:00100000:1.0:1746144656.640222:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747433088 00000100:00100000:2.0:1746144656.640233:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747430912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 560us (1006us total) trans 21474840447 rc 0/0 00000100:00100000:1.0:1746144656.640235:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11472 00000100:00100000:2.0:1746144656.640238:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11462 00000100:00100000:1.0:1746144656.640238:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830964747433088:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144656.640248:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01f100/2, rc 0, transno 21474840446 00000100:00100000:0.0:1746144656.640251:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747431040:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144656.640256:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01d180/2, rc 0, transno 21474840447 00000100:00100000:2.0:1746144656.640259:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747430912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144656.640259:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01e680/2, rc 0, transno 17179873202 00000100:00100000:0.0:1746144656.640261:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747432064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.640266:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01d880/2, rc 0, transno 21474840443 00000004:00080000:0.0:1746144656.640267:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01f480/2, rc 0, transno 17179873203 00000100:00100000:2.0:1746144656.640269:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144656.640270:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747432576:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.640275:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01ed80/2, rc 0, transno 17179873198 00000100:00100000:2.0:1746144656.640278:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431936:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.640283:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01df80/2, rc 0, transno 17179873199 00000100:00100000:2.0:1746144656.640286:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747432448:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.640291:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01c000/2, rc 0, transno 17179873197 00000100:00100000:2.0:1746144656.640293:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747432320:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144656.640299:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01dc00/2, rc 0, transno 21474840440 00000100:00100000:2.0:1746144656.640301:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747430784:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144656.640306:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01ca80/2, rc 0, transno 21474840441 00000100:00100000:2.0:1746144656.640308:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431296:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144656.640314:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01fb80/2, rc 0, transno 17179873196 00000100:00100000:2.0:1746144656.640316:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747431808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144656.640319:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3294:x1830964747433088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (107us total) trans 17179873204 rc 0/0 00000100:00100000:1.0:1746144656.640324:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11472 00000004:00080000:3.0:1746144656.640486:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44700/2, rc 0, transno 17179873204 00000100:00100000:3.0:1746144656.640490:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747433088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144656.643755:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747432832:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144656.643765:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747432960:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144656.643773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144656.643806:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019605 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 299 pid: 14710 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746144656.643821:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.643829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144656.643844:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ad600, rc 0) 00000100:00100000:2.0:1746144656.643872:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523136 00000100:00100000:2.0:1746144656.643878:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523136 00000100:00100000:3.0:1746144656.643881:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28953:x1830964746522112:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 47526us (47695us total) trans 8589943880 rc 0/0 00000100:00100000:3.0:1746144656.643888:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10014 00000100:00100000:2.0:1746144656.643905:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523264 00000100:00100000:2.0:1746144656.643907:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523264 00000100:00100000:3.0:1746144656.643914:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4019 00000100:00100000:3.0:1746144656.643921:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28951:x1830964746523136:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144656.643923:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4020 00000100:00100000:2.0:1746144656.643928:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:28947:x1830964746523264:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:3.0:1746144656.643974:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28951:x1830964746523136:12345-192.168.204.23@tcp:49:cat.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.643979:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:28947:x1830964746523264:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.643980:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4019 00000100:00100000:2.0:1746144656.643984:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4020 00000100:00100000:0.0:1746144656.646234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.646277:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523392 00000100:00100000:2.0:1746144656.646282:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523392 00000100:00100000:2.0:1746144656.646320:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4021 00000100:00100000:2.0:1746144656.646326:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28956:x1830964746523392:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144656.646517:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28956:x1830964746523392:12345-192.168.204.23@tcp:49:cat.0 Request processed in 190us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.646523:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4021 00000100:00100000:0.0:1746144656.647796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.647839:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523520 00000100:00100000:1.0:1746144656.647845:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523520 00000100:00100000:1.0:1746144656.647979:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11473 00000100:00100000:1.0:1746144656.647985:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+8:28947:x1830964746523520:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144656.647997:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.648012:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e53f expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.648034:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 17 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.648041:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.648042:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.648045:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3600384->4194303] (req 3600384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 9 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.648068:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 17 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.648079:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 17 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.648090:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747433216:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.648216:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.649204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.649391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.649414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.649433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.649434:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523648 00000100:00100000:3.0:1746144656.649439:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523648 00000100:00100000:0.0:1746144656.649444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.649460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.649606:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523776 00000100:00100000:3.0:1746144656.649610:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523776 00000100:00100000:3.0:1746144656.649629:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746523904 00000100:00100000:3.0:1746144656.649630:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746523904 00000100:00100000:3.0:1746144656.649639:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746524032 00000100:00100000:3.0:1746144656.649641:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746524032 00000100:00100000:3.0:1746144656.649649:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746524160 00000100:00100000:3.0:1746144656.649651:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746524160 00000100:00100000:3.0:1746144656.649659:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746524288 00000100:00100000:3.0:1746144656.649661:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746524288 00000100:00100000:3.0:1746144656.649670:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11474 00000100:00100000:3.0:1746144656.649676:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746523648:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.649684:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.649694:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e546 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.649709:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.649710:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.649715:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649726:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649734:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3000, rc 0) 00000100:00100000:1.0:1746144656.649739:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11475 00000100:00100000:1.0:1746144656.649745:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746523776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.649752:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144656.649756:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746523648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 80us (555us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144656.649760:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e54d expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.649761:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11474 00010000:00010000:1.0:1746144656.649770:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144656.649771:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11476 00010000:00010000:1.0:1746144656.649772:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144656.649776:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746523904:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.649776:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649781:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.649784:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649786:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e554 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.649790:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdaca00, rc 0) 00010000:00010000:3.0:1746144656.649794:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.649795:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.649798:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649806:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144656.649807:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746523776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 63us (417us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144656.649811:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd2800, rc 0) 00000100:00100000:1.0:1746144656.649811:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11475 00000100:00100000:3.0:1746144656.649822:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746523904:12345-192.168.204.23@tcp:101:cat.0 Request processed in 46us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.649822:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11477 00000100:00100000:1.0:1746144656.649826:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746524032:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144656.649827:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11476 00010000:00010000:1.0:1746144656.649831:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144656.649834:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11478 00010000:00010000:1.0:1746144656.649837:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e55b expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.649839:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746524160:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.649843:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.649846:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.649847:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e562 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.649847:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.649850:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649854:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.649855:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.649857:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649858:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.649863:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdad400, rc 0) 00010000:00010000:3.0:1746144656.649869:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.649875:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd3400, rc 0) 00000100:00100000:1.0:1746144656.649876:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746524032:12345-192.168.204.23@tcp:101:cat.0 Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.649881:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11477 00000100:00100000:3.0:1746144656.649884:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746524160:12345-192.168.204.23@tcp:101:cat.0 Request processed in 45us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.649888:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11478 00000100:00100000:1.0:1746144656.649890:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11479 00000100:00100000:1.0:1746144656.649894:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746524288:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.649899:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.649903:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdada00/0xa7c849b16e01967c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e569 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.649912:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.649917:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdada00/0xa7c849b16e01967c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e569 expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.649923:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdada00/0xa7c849b16e01967c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e569 expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.649930:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdada00, rc 0) 00000100:00100000:1.0:1746144656.649943:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746524288:12345-192.168.204.23@tcp:101:cat.0 Request processed in 48us (483us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144656.649947:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11479 00000100:00100000:3.0:1746144656.653952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.654219:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747433216:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.654242:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3600384->4194303] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 11 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.654257:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdad200, rc 0) 00000100:00100000:1.0:1746144656.654291:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+11:28947:x1830964746523520:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6306us (6498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.654299:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11473 00000100:00100000:0.0:1746144656.654364:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746524416 00000100:00100000:0.0:1746144656.654369:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746524416 00010000:00010000:0.0:1746144656.654390:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 18 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.654418:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5704 00000100:00100000:0.0:1746144656.654424:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746524416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.654435:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.654452:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 18 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.654462:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 18 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.654478:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4200/0xa7c849b16e0195db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e507 expref: 18 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.654486:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.654487:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.654492:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.654500:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.654520:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.654530:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747433344:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144656.654582:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.656173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.656203:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746524544 00000100:00100000:1.0:1746144656.656209:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746524544 00000100:00100000:1.0:1746144656.656245:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11480 00000100:00100000:1.0:1746144656.656252:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:28953:x1830964746524544:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144656.656263:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.656275:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e570 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.656294:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.656301:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.656307:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.656308:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.656311:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1081344->1331199] (req 1081344->1331199) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.656328:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.656338:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 11 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.656346:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747433472:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.656418:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144656.656436:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.656444:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747433600:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.656462:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.658750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.658855:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746524800 00000100:00100000:1.0:1746144656.658860:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746524800 00002000:00100000:1.0:1746144656.658890:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093ee7800 x1830964746524800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.658899:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7800 with x1830964746524800 ext(1048576->2097151) 00010000:00010000:1.0:1746144656.658905:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.658914:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00002000:00010000:1.0:1746144656.658919:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ee7800 00000100:00100000:1.0:1746144656.658936:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 826 00000100:00100000:1.0:1746144656.658942:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746524800:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144656.660221:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747433344:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.660236:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.660275:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746524416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5849us (6329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.660282:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5704 00000100:00100000:0.0:1746144656.660978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.661546:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746525056 00000100:00100000:2.0:1746144656.661551:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746525056 00000100:00100000:0.0:1746144656.661558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.661580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:2.0:1746144656.661581:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3600384->3604479) req@ffff880093ee5f80 x1830964746525056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.661589:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5f80 with x1830964746525056 ext(3600384->3604479) 00000100:00100000:0.0:1746144656.661608:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746525440 00000100:00100000:0.0:1746144656.661611:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746525440 00000100:00100000:3.0:1746144656.661618:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746525568 00000100:00100000:3.0:1746144656.661621:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746525568 00002000:00100000:0.0:1746144656.661626:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880093ee4e00 x1830964746525440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.661633:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4e00 with x1830964746525440 ext(0->1048575) 00002000:00010000:0.0:1746144656.661636:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee4e00 00002000:00100000:3.0:1746144656.661641:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093ee6680 x1830964746525568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.661647:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6680 with x1830964746525568 ext(1048576->2097151) 00000100:00100000:0.0:1746144656.661649:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4319 00010000:00010000:3.0:1746144656.661652:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 13 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.661654:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746525440:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:3.0:1746144656.661670:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 13 pid: 22208 timeout: 735 lvb_type: 1 00002000:00010000:3.0:1746144656.661675:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ee6680 00000100:00100000:3.0:1746144656.661686:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 827 00000100:00100000:3.0:1746144656.661692:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746525568:12345-192.168.204.23@tcp:3:cat.0 00002000:00010000:2.0:1746144656.662615:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5f80 00000100:00100000:2.0:1746144656.662629:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4320 00000100:00100000:2.0:1746144656.662635:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746525056:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144656.662733:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746525056:12345-192.168.204.23@tcp:3:cat.0 Request processed in 99us (1757us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144656.662738:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4320 00002000:00100000:2.0:1746144656.662743:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3600384->3604479) req@ffff880093ee5f80 x1830964746525056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.662749:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5f80 with x1830964746525056 ext(3600384->3604479) 00002000:00010000:2.0:1746144656.662751:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5f80 00000100:00100000:1.0:1746144656.663193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.663229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.663246:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746525824 00000100:00100000:1.0:1746144656.663250:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746525824 00002000:00100000:1.0:1746144656.663271:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880099b8d500 x1830964746525824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.663278:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8d500 with x1830964746525824 ext(1048576->2097151) 00002000:00010000:1.0:1746144656.663281:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8d500 00000100:00100000:1.0:1746144656.663291:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746525952 00000100:00100000:1.0:1746144656.663292:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746525952 00002000:00100000:1.0:1746144656.663301:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880099b8f100 x1830964746525952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.663307:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8f100 with x1830964746525952 ext(1048576->2097151) 00002000:00010000:1.0:1746144656.663309:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8f100 00000100:00100000:1.0:1746144656.663317:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4321 00000100:00100000:1.0:1746144656.663321:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746525824:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.663741:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4322 00000100:00100000:0.0:1746144656.663747:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746525952:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.664277:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747433472:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.664287:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747433600:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.664308:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1081344->1331199] (req 1081344->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.664322:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdac400, rc 0) 00000100:00100000:1.0:1746144656.664341:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:28953:x1830964746524544:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8091us (8180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.664346:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11480 00000100:00100000:1.0:1746144656.671184:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746524800:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 12234us (12433us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.671195:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 826 00002000:00100000:1.0:1746144656.671206:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093ee7800 x1830964746524800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.671216:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7800 with x1830964746524800 ext(1048576->2097151) 00010000:00010000:1.0:1746144656.671225:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.671238:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00002000:00010000:1.0:1746144656.671245:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ee7800 00000100:00100000:3.0:1746144656.674619:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746525568:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12921us (13031us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.674632:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 827 00002000:00100000:3.0:1746144656.674641:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093ee6680 x1830964746525568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.674649:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6680 with x1830964746525568 ext(1048576->2097151) 00010000:00010000:3.0:1746144656.674657:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 14 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:3.0:1746144656.674669:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 14 pid: 22208 timeout: 735 lvb_type: 1 00002000:00010000:3.0:1746144656.674675:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ee6680 00000100:00100000:0.0:1746144656.683949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.684029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.684070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.684096:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526208 00000100:00100000:3.0:1746144656.684104:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526208 00000100:00100000:3.0:1746144656.684174:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526336 00000100:00100000:3.0:1746144656.684176:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526336 00000100:00100000:3.0:1746144656.684190:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526464 00000100:00100000:3.0:1746144656.684191:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526464 00000100:00100000:3.0:1746144656.684205:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11481 00000100:00100000:3.0:1746144656.684212:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+14:28947:x1830964746526208:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.684225:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.684241:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e577 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.684263:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 26 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.684274:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.684279:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.684281:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.684284:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4489215] (req 4194304->4489215) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 15 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.684306:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.684315:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 15 pid: 8450 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.684323:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747433728:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.684388:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 26 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.684395:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.684402:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747433856:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.684417:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144656.684432:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11482 00000100:00100000:3.0:1746144656.684438:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746526336:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.684445:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.684450:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e019691 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e57e expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.684459:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.684466:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e019691 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e57e expref: 27 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.684474:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e019691 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e57e expref: 27 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.684485:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51d000, rc 0) 00000100:00100000:0.0:1746144656.684487:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746525824:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21163us (21293us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144656.684494:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4321 00000100:00100000:3.0:1746144656.684499:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746526336:12345-192.168.204.23@tcp:101:cat.0 Request processed in 62us (470us total) trans 0 rc 301/301 00002000:00100000:0.0:1746144656.684501:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880099b8d500 x1830964746525824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746144656.684503:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11482 00002000:00100000:0.0:1746144656.684509:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8d500 with x1830964746525824 ext(1048576->2097151) 00002000:00010000:0.0:1746144656.684512:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8d500 00000100:00100000:3.0:1746144656.684514:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11483 00000100:00100000:3.0:1746144656.684519:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746526464:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.684524:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.684531:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b51de00/0xa7c849b16e019698 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e585 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144656.684550:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747433984:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144656.684566:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.685152:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746525440:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23479us (23575us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144656.685169:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4319 00002000:00100000:2.0:1746144656.685175:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880093ee4e00 x1830964746525440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.685182:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4e00 with x1830964746525440 ext(0->1048575) 00002000:00010000:2.0:1746144656.685185:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee4e00 00000100:00100000:1.0:1746144656.686746:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746525952:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22993us (23509us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.686754:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4322 00002000:00100000:1.0:1746144656.686762:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880099b8f100 x1830964746525952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.686769:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8f100 with x1830964746525952 ext(1048576->2097151) 00002000:00010000:1.0:1746144656.686773:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8f100 00000100:00100000:1.0:1746144656.689131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.689195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.689222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.689241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.689257:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526720 00000100:00100000:1.0:1746144656.689257:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526592 00000100:00100000:2.0:1746144656.689263:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526720 00000100:00100000:1.0:1746144656.689263:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526592 00010000:00010000:2.0:1746144656.689289:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.689289:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 14 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.689307:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526848 00000100:00100000:1.0:1746144656.689309:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526848 00000100:00100000:2.0:1746144656.689313:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746526976 00000100:00100000:2.0:1746144656.689315:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746526976 00010000:00010000:1.0:1746144656.689317:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 15 pid: 8450 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.689321:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00000100:00100000:1.0:1746144656.689326:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5705 00000100:00100000:2.0:1746144656.689331:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5706 00000100:00100000:1.0:1746144656.689332:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746526592:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144656.689335:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746526720:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.689341:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144656.689342:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.689357:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.689357:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 15 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.689366:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 15 pid: 22208 timeout: 735 lvb_type: 1 00000100:00100000:0.0:1746144656.689403:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5707 00000100:00100000:0.0:1746144656.689409:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746526848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.689418:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.689428:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 15 pid: 8450 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.689435:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 15 pid: 8450 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.689454:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144656.689487:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746526848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.689493:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5707 00000100:00100000:0.0:1746144656.689509:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5708 00000100:00100000:0.0:1746144656.689514:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746526976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144656.689519:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144656.689526:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.689533:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:0.0:1746144656.689543:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.689545:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144656.689551:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.689859:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd3400/0xa7c849b16e019675 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e562 expref: 14 pid: 8450 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.689878:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747433728:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.689886:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e0195cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e500 expref: 27 pid: 4760 timeout: 735 lvb_type: 1 00000100:00100000:3.0:1746144656.689893:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747433856:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144656.689993:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 13 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.690054:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 13 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.690062:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd2a00, rc 0) 00000100:00100000:3.0:1746144656.690086:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:28947:x1830964746526208:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5875us (6146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.690092:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11481 00010000:00010000:0.0:1746144656.690222:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 12 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144656.690233:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747434112:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144656.690269:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00010000:00010000:2.0:1746144656.690424:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.690436:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e0195e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f9 expref: 26 pid: 4760 timeout: 735 lvb_type: 1 00010000:00010000:2.0:1746144656.690451:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.690464:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746526720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1129us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.690469:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5706 00002000:00010000:3.0:1746144656.690585:0:8453:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144656 -> 1746144657 00002000:00010000:3.0:1746144656.690588:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144656 -> 1746144657 00002000:00010000:3.0:1746144656.690589:0:8453:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144656 -> 1746144657 00000100:00100000:3.0:1746144656.690601:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747433984:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144656.690622:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b51de00/0xa7c849b16e019698 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e585 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.690630:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b51de00/0xa7c849b16e019698 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e585 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.690638:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51de00, rc 0) 00000100:00100000:3.0:1746144656.690673:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746526464:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6153us (6602us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144656.690678:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11483 00010000:00010000:1.0:1746144656.690721:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01966e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e55b expref: 12 pid: 22208 timeout: 735 lvb_type: 1 00010000:00010000:1.0:1746144656.690742:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.690743:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.690747:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.690752:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.690770:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.690777:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747434240:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144656.690809:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.695222:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747434112:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.695239:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.695285:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746526976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5770us (6041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.695294:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5708 00000100:00100000:0.0:1746144656.695735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.695755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.695817:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747434240:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144656.695828:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144656.695850:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746526592:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6518us (6725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.695857:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5705 00000100:00100000:3.0:1746144656.696009:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746527232 00000100:00100000:3.0:1746144656.696015:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746527232 00000100:00100000:3.0:1746144656.696056:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11484 00000100:00100000:3.0:1746144656.696062:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28951:x1830964746527232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.696074:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.696087:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e58c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.696105:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 10 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.696111:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.696112:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.696115:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.696151:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 10 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.696172:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 10 pid: 4760 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.696183:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747434368:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.696225:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.696483:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746527360 00000100:00100000:0.0:1746144656.696487:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746527360 00002000:00100000:0.0:1746144656.696510:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1081344->1085439) req@ffff88012b5f6300 x1830964746527360/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.696518:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6300 with x1830964746527360 ext(1081344->1085439) 00002000:00010000:0.0:1746144656.696521:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6300 00000100:00100000:0.0:1746144656.696913:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4323 00000100:00100000:0.0:1746144656.696919:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746527360:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.697051:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746527360:12345-192.168.204.23@tcp:3:cat.0 Request processed in 131us (1294us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144656.697057:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4323 00002000:00100000:0.0:1746144656.697062:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1081344->1085439) req@ffff88012b5f6300 x1830964746527360/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.697069:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6300 with x1830964746527360 ext(1081344->1085439) 00002000:00010000:0.0:1746144656.697072:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6300 00000100:00100000:0.0:1746144656.697113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.697275:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746527616 00000100:00100000:1.0:1746144656.697278:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746527616 00002000:00100000:1.0:1746144656.697292:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4485120->4489215) req@ffff88012b5f4000 x1830964746527616/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.697299:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4000 with x1830964746527616 ext(4485120->4489215) 00010000:00010000:1.0:1746144656.697303:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 11 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.697313:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 11 pid: 4760 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746144656.697318:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f4000 00000100:00100000:1.0:1746144656.697329:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 828 00000100:00100000:1.0:1746144656.697333:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746527616:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.697397:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746527616:12345-192.168.204.23@tcp:3:cat.0 Request processed in 63us (283us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144656.697403:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 828 00002000:00100000:1.0:1746144656.697407:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4485120->4489215) req@ffff88012b5f4000 x1830964746527616/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.697418:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4000 with x1830964746527616 ext(4485120->4489215) 00010000:00010000:1.0:1746144656.697422:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 11 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.697430:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 11 pid: 4760 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746144656.697435:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f4000 00010000:00010000:1.0:1746144656.698237:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746144656.698880:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747434368:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.698916:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.698929:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd2600, rc 0) 00000100:00100000:3.0:1746144656.698964:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:28951:x1830964746527232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2901us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.698970:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11484 00000100:00100000:2.0:1746144656.700409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.700497:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746527872 00000100:00100000:1.0:1746144656.700504:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746527872 00002000:00100000:1.0:1746144656.700533:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1327104->1331199) req@ffff88009ee09500 x1830964746527872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.700540:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09500 with x1830964746527872 ext(1327104->1331199) 00002000:00010000:1.0:1746144656.700545:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09500 00000100:00100000:1.0:1746144656.700559:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4324 00000100:00100000:1.0:1746144656.700564:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746527872:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.700693:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746527872:12345-192.168.204.23@tcp:3:cat.0 Request processed in 128us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144656.700699:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4324 00002000:00100000:1.0:1746144656.700704:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1327104->1331199) req@ffff88009ee09500 x1830964746527872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.700709:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09500 with x1830964746527872 ext(1327104->1331199) 00002000:00010000:1.0:1746144656.700712:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09500 00000100:00100000:0.0:1746144656.701506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.701598:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746528384 00000100:00100000:2.0:1746144656.701603:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746528384 00000100:00100000:2.0:1746144656.701629:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4022 00000100:00100000:2.0:1746144656.701634:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:28947:x1830964746528384:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144656.702075:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:28947:x1830964746528384:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 439us (570us total) trans 8589943882 rc 0/0 00000100:00100000:2.0:1746144656.702081:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4022 00000100:00100000:0.0:1746144656.702250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.702327:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746528512 00000100:00100000:3.0:1746144656.702330:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746528512 00000100:00100000:3.0:1746144656.702358:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11485 00000100:00100000:3.0:1746144656.702363:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:28956:x1830964746528512:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.702372:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.702385:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e593 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.702405:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.702412:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.702414:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.702417:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 12 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.702438:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.702451:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 24 pid: 29370 timeout: 735 lvb_type: 0 00000100:00100000:3.0:1746144656.702461:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747434496:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.702518:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.703206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.703262:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746528128 00000100:00100000:3.0:1746144656.703266:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746528128 00002000:00100000:3.0:1746144656.703289:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4489215) req@ffff88012b5f5f80 x1830964746528128/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.703297:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5f80 with x1830964746528128 ext(4194304->4489215) 00010000:00010000:3.0:1746144656.703303:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 13 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.703312:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 13 pid: 4760 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.703317:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f5f80 00000100:00100000:3.0:1746144656.703330:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 829 00000100:00100000:3.0:1746144656.703338:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746528128:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144656.704756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.704815:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746528768 00000100:00100000:3.0:1746144656.704820:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746528768 00000100:00100000:3.0:1746144656.704850:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4023 00000100:00100000:3.0:1746144656.704857:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28953:x1830964746528768:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144656.705154:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28953:x1830964746528768:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 297us (399us total) trans 8589943883 rc 0/0 00000100:00100000:3.0:1746144656.705173:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4023 00000100:00100000:0.0:1746144656.705207:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747434496:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144656.705230:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.705242:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edd2c00, rc 0) 00000100:00100000:0.0:1746144656.705269:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:28956:x1830964746528512:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2906us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144656.705274:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11485 00000100:00100000:0.0:1746144656.706372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.706441:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746528896 00000100:00100000:1.0:1746144656.706446:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746528896 00002000:00100000:1.0:1746144656.706471:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1081344->1331199) req@ffff88012b5f6d80 x1830964746528896/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.706479:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6d80 with x1830964746528896 ext(1081344->1331199) 00010000:00010000:1.0:1746144656.706486:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 25 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.706497:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 25 pid: 29370 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746144656.706502:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f6d80 00000100:00100000:1.0:1746144656.706534:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 830 00000100:00100000:1.0:1746144656.706541:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746528896:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144656.709854:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746528128:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6509us (6640us total) trans 17179873205 rc 0/0 00000100:00100000:3.0:1746144656.709865:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 829 00002000:00100000:3.0:1746144656.709874:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4489215) req@ffff88012b5f5f80 x1830964746528128/t17179873205(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.709883:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5f80 with x1830964746528128 ext(4194304->4489215) 00010000:00010000:3.0:1746144656.709890:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.709901:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.709907:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f5f80 00000100:00100000:1.0:1746144656.713437:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746528896:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6888us (7059us total) trans 17179873206 rc 0/0 00000100:00100000:1.0:1746144656.713446:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 830 00002000:00100000:1.0:1746144656.713454:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1081344->1331199) req@ffff88012b5f6d80 x1830964746528896/t17179873206(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.713463:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6d80 with x1830964746528896 ext(1081344->1331199) 00010000:00010000:1.0:1746144656.713471:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 27 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.713482:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 27 pid: 29370 timeout: 735 lvb_type: 0 00002000:00010000:1.0:1746144656.713493:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f6d80 00000100:00100000:0.0:1746144656.714202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.714412:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746529024 00000100:00100000:1.0:1746144656.714419:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746529024 00010000:00010000:1.0:1746144656.714442:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.714476:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5709 00000100:00100000:1.0:1746144656.714482:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746529024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144656.714493:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144656.714506:0:7100:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144656 -> 1746144657 00002000:00010000:1.0:1746144656.714508:0:7100:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144656 -> 1746144657 00010000:00010000:1.0:1746144656.714512:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.714521:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.714539:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2a00/0xa7c849b16e01968a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4489215) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e577 expref: 14 pid: 4760 timeout: 735 lvb_type: 0 00010000:00010000:1.0:1746144656.714565:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.714566:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.714572:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.714579:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.714607:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144656.714617:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747434624:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144656.715350:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.716045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.716238:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746529152 00000100:00100000:2.0:1746144656.716243:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746529152 00010000:00010000:2.0:1746144656.716266:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 27 pid: 29370 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.716587:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747434624:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144656.716600:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.716667:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5710 00000100:00100000:2.0:1746144656.716673:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746529152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.716682:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144656.716694:0:15951:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144656 -> 1746144657 00002000:00010000:2.0:1746144656.716696:0:15951:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144656 -> 1746144657 00010000:00010000:2.0:1746144656.716701:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 27 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.716709:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 27 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.716724:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e019683 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1331199) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e570 expref: 27 pid: 29370 timeout: 735 lvb_type: 0 00000100:00100000:1.0:1746144656.716751:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746529024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2268us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.716757:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5709 00010000:00010000:2.0:1746144656.716961:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.716963:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.716968:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 12 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.716975:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 12 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.716997:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 12 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.717006:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747434752:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.717042:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.718286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.718364:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746529408 00000100:00100000:1.0:1746144656.718370:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746529408 00002000:00100000:1.0:1746144656.718408:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b5f7800 x1830964746529408/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.718417:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7800 with x1830964746529408 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.718421:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7800 00000100:00100000:1.0:1746144656.718509:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4325 00000100:00100000:1.0:1746144656.718519:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746529408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144656.718740:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747434752:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.718857:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.719089:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746529152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2414us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.719096:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5710 00000100:00100000:0.0:1746144656.720594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.720650:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746529664 00000100:00100000:3.0:1746144656.720656:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746529664 00002000:00100000:3.0:1746144656.720695:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b5f7480 x1830964746529664/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.720704:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7480 with x1830964746529664 ext(1048576->2097151) 00002000:00010000:3.0:1746144656.720708:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7480 00000100:00100000:3.0:1746144656.720734:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4326 00000100:00100000:3.0:1746144656.720741:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746529664:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.729054:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746529408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10528us (10764us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.729063:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4325 00002000:00100000:1.0:1746144656.729073:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b5f7800 x1830964746529408/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.729087:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7800 with x1830964746529408 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.729093:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7800 00000100:00100000:3.0:1746144656.733029:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746529664:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12277us (12428us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.733045:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4326 00002000:00100000:3.0:1746144656.733055:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012b5f7480 x1830964746529664/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.733064:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7480 with x1830964746529664 ext(1048576->2097151) 00002000:00010000:3.0:1746144656.733071:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7480 00000100:00100000:2.0:1746144656.734624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.734726:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746529792 00000100:00100000:0.0:1746144656.734917:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746529792 00000100:00100000:0.0:1746144656.735854:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11486 00000100:00100000:0.0:1746144656.735863:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:28951:x1830964746529792:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144656.735881:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.735900:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e59a expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.735929:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.735942:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144656.735944:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144656.735947:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.735978:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.735990:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 10 pid: 29370 timeout: 735 lvb_type: 0 00000100:00100000:0.0:1746144656.736002:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747434880:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144656.737929:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4dc6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.738298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.738435:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746529920 00000100:00100000:2.0:1746144656.738443:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746529920 00000100:00100000:1.0:1746144656.739026:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747434880:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144656.739053:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.739070:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1bcb200, rc 0) 00000100:00100000:1.0:1746144656.739114:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:28951:x1830964746529792:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3252us (4495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.739121:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11486 00000100:00100000:1.0:1746144656.739170:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11487 00000100:00100000:1.0:1746144656.739178:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:28956:x1830964746529920:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144656.739191:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144656.739207:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5a1 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.739225:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.739227:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144656.739233:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.739246:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 14 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144656.739259:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945dce00, rc 0) 00000100:00100000:1.0:1746144656.739276:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:28956:x1830964746529920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 100us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144656.739280:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11487 00000100:00100000:0.0:1746144656.739916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.741792:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746530048 00000100:00100000:3.0:1746144656.741807:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746530048 00002000:00100000:3.0:1746144656.741875:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3600384->4194303) req@ffff88012b5f6a00 x1830964746530048/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.741886:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6a00 with x1830964746530048 ext(3600384->4194303) 00010000:00010000:3.0:1746144656.741896:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 11 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.741911:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 11 pid: 29370 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.741918:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b5f6a00 00000100:00100000:3.0:1746144656.741957:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 831 00000100:00100000:3.0:1746144656.741966:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746530048:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144656.744876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.744975:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746530304 00000100:00100000:1.0:1746144656.744985:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746530304 00002000:00100000:1.0:1746144656.745022:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009ee0b480 x1830964746530304/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.745032:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b480 with x1830964746530304 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.745037:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0b480 00000100:00100000:1.0:1746144656.745061:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4327 00000100:00100000:1.0:1746144656.745068:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746530304:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144656.753335:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746530048:12345-192.168.204.23@tcp:4:cat.0 Request processed in 11358us (13415us total) trans 21474840448 rc 0/0 00000100:00100000:3.0:1746144656.753349:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 831 00002000:00100000:3.0:1746144656.753361:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3600384->4194303) req@ffff88012b5f6a00 x1830964746530048/t21474840448(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/448 e 0 to 0 dl 1746144667 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.753376:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6a00 with x1830964746530048 ext(3600384->4194303) 00010000:00010000:3.0:1746144656.753386:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 13 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:3.0:1746144656.753401:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 13 pid: 29370 timeout: 735 lvb_type: 0 00002000:00010000:3.0:1746144656.753408:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b5f6a00 00000100:00100000:1.0:1746144656.756350:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746530304:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11273us (11473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.756359:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4327 00002000:00100000:1.0:1746144656.756369:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009ee0b480 x1830964746530304/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.756377:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b480 with x1830964746530304 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.756381:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0b480 00000100:00100000:0.0:1746144656.761744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.761792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.761878:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746530560 00000100:00100000:3.0:1746144656.761891:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746530560 00000100:00100000:3.0:1746144656.761981:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11488 00000100:00100000:3.0:1746144656.761992:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+13:28956:x1830964746530560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144656.762013:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.762032:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5a8 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.762061:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144656.762068:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.762080:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.762089:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d450a00, rc 0) 00000100:00100000:3.0:1746144656.762198:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:28956:x1830964746530560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 208us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.762208:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11488 00000100:00100000:2.0:1746144656.762263:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746530432 00000100:00100000:2.0:1746144656.762268:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746530432 00010000:00010000:2.0:1746144656.762289:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 14 pid: 29370 timeout: 735 lvb_type: 0 00000100:00100000:2.0:1746144656.762307:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5711 00000100:00100000:2.0:1746144656.762311:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746530432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.762319:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.762345:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 14 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.762356:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 14 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.762377:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad200/0xa7c849b16e019652 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e53f expref: 14 pid: 29370 timeout: 735 lvb_type: 0 00010000:00010000:2.0:1746144656.762395:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.762396:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.762403:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.762410:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.762417:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.762418:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.762423:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.762429:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.762457:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.762470:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747435008:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.762536:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.762544:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747435136:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.762563:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.768702:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747435008:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.768715:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747435136:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.768737:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.768800:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746530432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6486us (7063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.768810:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5711 00000100:00100000:1.0:1746144656.774297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.774390:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746530944 00000100:00100000:2.0:1746144656.774397:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746530944 00002000:00100000:2.0:1746144656.774437:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880099b8c700 x1830964746530944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.774445:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8c700 with x1830964746530944 ext(2097152->3145727) 00002000:00010000:2.0:1746144656.774450:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8c700 00000100:00100000:2.0:1746144656.774477:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4328 00000100:00100000:2.0:1746144656.774484:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746530944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.775114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.775178:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746531072 00000100:00100000:3.0:1746144656.775189:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746531072 00002000:00100000:3.0:1746144656.775241:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b5f7b80 x1830964746531072/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.775250:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7b80 with x1830964746531072 ext(3145728->4194303) 00002000:00010000:3.0:1746144656.775256:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f7b80 00000100:00100000:3.0:1746144656.775297:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4329 00000100:00100000:3.0:1746144656.775306:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746531072:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.776669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.776807:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746531328 00000100:00100000:0.0:1746144656.776818:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746531328 00002000:00100000:0.0:1746144656.776850:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880099b8ed80 x1830964746531328/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.776859:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ed80 with x1830964746531328 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.776864:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8ed80 00000100:00100000:0.0:1746144656.776889:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4330 00000100:00100000:0.0:1746144656.776895:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746531328:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.777725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144656.777746:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746531584 00000100:00100000:1.0:1746144656.777752:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746531584 00002000:00100000:1.0:1746144656.777778:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880099b8fb80 x1830964746531584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.777787:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8fb80 with x1830964746531584 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.777791:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8fb80 00000100:00100000:1.0:1746144656.777805:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4331 00000100:00100000:1.0:1746144656.777810:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746531584:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144656.784223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.785173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.785329:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746531840 00000100:00100000:0.0:1746144656.785340:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746531840 00002000:00100000:0.0:1746144656.785386:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee09c00 x1830964746531840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.785396:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09c00 with x1830964746531840 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.785402:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee09c00 00000100:00100000:0.0:1746144656.785421:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746532096 00000100:00100000:0.0:1746144656.785423:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746532096 00002000:00100000:0.0:1746144656.785435:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee08000 x1830964746532096/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.785441:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08000 with x1830964746532096 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.785444:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee08000 00000100:00100000:0.0:1746144656.785457:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4332 00000100:00100000:0.0:1746144656.785464:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746531840:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144656.785465:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4333 00000100:00100000:3.0:1746144656.785489:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746532096:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144656.795097:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746531072:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19780us (19971us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.795108:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4329 00002000:00100000:3.0:1746144656.795120:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b5f7b80 x1830964746531072/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.795129:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7b80 with x1830964746531072 ext(3145728->4194303) 00002000:00010000:3.0:1746144656.795171:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f7b80 00000100:00100000:2.0:1746144656.797388:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746530944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22898us (23090us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144656.797398:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4328 00002000:00100000:2.0:1746144656.797408:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880099b8c700 x1830964746530944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.797416:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8c700 with x1830964746530944 ext(2097152->3145727) 00002000:00010000:2.0:1746144656.797421:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8c700 00000100:00100000:0.0:1746144656.802696:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746531328:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25787us (26016us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144656.802708:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4330 00002000:00100000:0.0:1746144656.802719:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880099b8ed80 x1830964746531328/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.802730:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ed80 with x1830964746531328 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.802736:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8ed80 00000100:00100000:1.0:1746144656.808687:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746531584:12345-192.168.204.23@tcp:3:cat.0 Request processed in 30868us (30955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144656.808697:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4331 00002000:00100000:1.0:1746144656.808706:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880099b8fb80 x1830964746531584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144656.808713:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8fb80 with x1830964746531584 ext(2097152->3145727) 00002000:00010000:1.0:1746144656.808718:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8fb80 00000100:00100000:3.0:1746144656.812070:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746532096:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26583us (26885us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144656.812082:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4333 00002000:00100000:3.0:1746144656.812093:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee08000 x1830964746532096/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.812108:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08000 with x1830964746532096 ext(3145728->4194303) 00002000:00010000:3.0:1746144656.812115:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee08000 00000100:00100000:0.0:1746144656.812174:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746531840:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26689us (27936us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144656.812185:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4332 00002000:00100000:0.0:1746144656.812201:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee09c00 x1830964746531840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144656.812210:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09c00 with x1830964746531840 ext(3145728->4194303) 00002000:00010000:0.0:1746144656.812215:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee09c00 00000100:00100000:0.0:1746144656.812903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.813014:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746532224 00000100:00100000:2.0:1746144656.813023:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746532224 00000100:00100000:2.0:1746144656.813452:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11489 00000100:00100000:2.0:1746144656.813459:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746532224:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144656.813474:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.813491:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5af expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.813515:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.813517:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.813530:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 27 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.813548:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 27 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144656.813558:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b46000, rc 0) 00000100:00100000:2.0:1746144656.813590:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746532224:12345-192.168.204.23@tcp:101:cat.0 Request processed in 132us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.813595:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11489 00000100:00100000:0.0:1746144656.826132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.826849:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746532480 00000100:00100000:2.0:1746144656.826857:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746532480 00002000:00100000:2.0:1746144656.826899:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f5180 x1830964746532480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.826908:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5180 with x1830964746532480 ext(4194304->4935679) 00002000:00010000:2.0:1746144656.826913:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f5180 00000100:00100000:2.0:1746144656.827126:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4334 00000100:00100000:2.0:1746144656.827512:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746532480:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144656.828201:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.828273:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746532736 00000100:00100000:3.0:1746144656.828278:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746532736 00002000:00100000:3.0:1746144656.828307:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880099b8e680 x1830964746532736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.828315:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8e680 with x1830964746532736 ext(4194304->4935679) 00002000:00010000:3.0:1746144656.828318:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8e680 00000100:00100000:3.0:1746144656.828330:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4335 00000100:00100000:3.0:1746144656.828336:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746532736:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144656.830216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144656.830773:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746532992 00000100:00100000:0.0:1746144656.830779:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746532992 00000100:00100000:0.0:1746144656.830811:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10019 00000100:00100000:0.0:1746144656.830817:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28960:x1830964746532992:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144656.830835:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144656.830850:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e0196c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5b6 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.832385:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832400:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832411:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832420:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832425:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832430:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832608:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832616:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832622:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144656.832630:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144656.832697:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832704:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832709:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832714:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2c0200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144656.832717:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832723:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832732:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144656.832735:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144656.832738:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832743:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e0196d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832779:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832783:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832787:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832791:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2c1a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144656.832793:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832797:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832803:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8200) 00010000:00010000:0.0:1746144656.832805:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144656.832807:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832811:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e0196d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144656.832846:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e0196c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 302 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.832857:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144656.832863:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144656.832865:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144656.832867:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133c66200, rc 0) 00000100:00100000:0.0:1746144656.832890:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28960:x1830964746532992:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2073us (2679us total) trans 8589943884 rc 0/0 00000100:00100000:0.0:1746144656.832896:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10019 00000100:00100000:2.0:1746144656.835964:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746532480:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8822us (9831us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144656.835974:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4334 00002000:00100000:2.0:1746144656.835983:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f5180 x1830964746532480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.835993:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5180 with x1830964746532480 ext(4194304->4935679) 00002000:00010000:2.0:1746144656.835997:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f5180 00000100:00100000:3.0:1746144656.837051:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746532736:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8712us (8848us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144656.837058:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4335 00002000:00100000:3.0:1746144656.837064:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880099b8e680 x1830964746532736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/440 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.837071:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8e680 with x1830964746532736 ext(4194304->4935679) 00002000:00010000:3.0:1746144656.837075:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8e680 00000100:00100000:0.0:1746144656.843741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.843860:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746533248 00000100:00100000:2.0:1746144656.843871:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746533248 00000100:00100000:2.0:1746144656.843932:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4024 00000100:00100000:2.0:1746144656.843942:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+10:28956:x1830964746533248:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144656.844641:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:28956:x1830964746533248:12345-192.168.204.23@tcp:35:cat.0 Request processed in 699us (909us total) trans 8589943885 rc 0/0 00000100:00100000:2.0:1746144656.844649:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4024 00000100:00100000:0.0:1746144656.925722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.925976:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746533504 00000100:00100000:2.0:1746144656.925983:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746533504 00000100:00100000:2.0:1746144656.926040:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10020 00000100:00100000:2.0:1746144656.926047:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:28964:x1830964746533504:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144656.926067:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144656.926084:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46400/0xa7c849b16e0196ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5bd expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.926218:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926229:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926238:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926250:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926256:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926261:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926347:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926354:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926374:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144656.926382:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144656.926448:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926453:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926458:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926462:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b47400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.926465:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926470:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926479:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144656.926486:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144656.926490:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926494:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47400/0xa7c849b16e0196f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926508:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926513:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926517:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926521:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4b46e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144656.926523:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926527:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926532:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136942600) 00010000:00010000:2.0:1746144656.926534:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144656.926536:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926540:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46e00/0xa7c849b16e0196fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144656.926574:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46400/0xa7c849b16e0196ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.926589:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.926594:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144656.926596:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144656.926598:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b46200, rc 0) 00000100:00100000:2.0:1746144656.926646:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:28964:x1830964746533504:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 598us (929us total) trans 8589943886 rc 0/0 00000100:00100000:2.0:1746144656.926652:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10020 00000100:00100000:0.0:1746144656.931881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.932334:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746533632 00000100:00100000:3.0:1746144656.932347:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746533632 00000100:00100000:3.0:1746144656.932669:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11490 00000100:00100000:3.0:1746144656.932683:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:28964:x1830964746533632:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.932708:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.932731:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5c4 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.932784:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.932793:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.932800:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.932801:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.932805:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3596288->3678207] (req 3596288->3678207) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.932841:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.932854:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144656.932869:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747435264:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.934951:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.934967:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 26 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144656.934979:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747435392:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.938866:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144656.939420:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747435264:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.939430:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747435392:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.939488:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3596288->3678207] (req 3596288->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.939507:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d450e00, rc 0) 00000100:00100000:3.0:1746144656.939551:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+15:28964:x1830964746533632:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6873us (7683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.939560:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11490 00000100:00100000:0.0:1746144656.940183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.940226:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746533760 00000100:00100000:2.0:1746144656.940234:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746533760 00010000:00010000:2.0:1746144656.940266:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144656.940299:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5712 00000100:00100000:2.0:1746144656.940306:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746533760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.940324:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.940345:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144656.940355:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144656.940374:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800945dce00/0xa7c849b16e0196b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a1 expref: 15 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144656.940391:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.940415:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746533760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.940421:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5712 00000100:00100000:0.0:1746144656.942968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.943047:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746533888 00000100:00100000:2.0:1746144656.943057:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746533888 00010000:00010000:2.0:1746144656.943089:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 27 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144656.943111:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5713 00000100:00100000:2.0:1746144656.943116:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746533888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.943129:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.943180:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 27 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144656.943192:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 27 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144656.943211:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2600/0xa7c849b16e01969f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e58c expref: 27 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144656.943224:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.943226:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.943232:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.943245:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.943277:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.943289:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747435520:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.943377:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.945644:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747435520:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.945669:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.945720:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746533888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2600us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.945730:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5713 00000100:00100000:0.0:1746144656.946967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.947954:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746534144 00000100:00100000:3.0:1746144656.947964:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746534144 00002000:00100000:3.0:1746144656.948033:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3596288->3600383) req@ffff88012c945880 x1830964746534144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.948044:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945880 with x1830964746534144 ext(3596288->3600383) 00002000:00010000:3.0:1746144656.948052:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c945880 00000100:00100000:3.0:1746144656.948092:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4336 00000100:00100000:3.0:1746144656.948105:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746534144:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144656.948451:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746534144:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 348us (1487us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144656.948459:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4336 00002000:00100000:3.0:1746144656.948466:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3596288->3600383) req@ffff88012c945880 x1830964746534144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.948473:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945880 with x1830964746534144 ext(3596288->3600383) 00002000:00010000:3.0:1746144656.948478:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c945880 00000100:00100000:0.0:1746144656.952677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.952983:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746534400 00000100:00100000:2.0:1746144656.952993:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746534400 00002000:00100000:2.0:1746144656.953048:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3674112->3678207) req@ffff88012c944380 x1830964746534400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.953059:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944380 with x1830964746534400 ext(3674112->3678207) 00002000:00010000:2.0:1746144656.953064:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944380 00000100:00100000:2.0:1746144656.953519:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4337 00000100:00100000:2.0:1746144656.953532:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746534400:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144656.953760:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746534400:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 231us (1097us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144656.953771:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4337 00002000:00100000:2.0:1746144656.953777:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3674112->3678207) req@ffff88012c944380 x1830964746534400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144656.953784:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944380 with x1830964746534400 ext(3674112->3678207) 00002000:00010000:2.0:1746144656.953787:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944380 00000100:00100000:0.0:1746144656.956041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.956208:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746534656 00000100:00100000:2.0:1746144656.956218:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746534656 00000100:00100000:2.0:1746144656.956293:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4025 00000100:00100000:2.0:1746144656.956303:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:28964:x1830964746534656:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144656.957470:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:28964:x1830964746534656:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1167us (1433us total) trans 8589943887 rc 0/0 00000100:00100000:2.0:1746144656.957477:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4025 00000100:00100000:0.0:1746144656.988102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.988899:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746534784 00000100:00100000:3.0:1746144656.988910:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746534784 00000100:00100000:3.0:1746144656.988967:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11491 00000100:00100000:3.0:1746144656.988976:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:28960:x1830964746534784:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144656.988995:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144656.989015:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.989047:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 19 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.989056:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.989063:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.989065:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144656.989068:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1384448->2097151] (req 1384448->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.989098:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.989110:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 12 pid: 22208 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144656.989123:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747435648:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.989266:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 19 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144656.989273:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 19 pid: 29370 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144656.989280:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747435776:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144656.989298:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144656.990883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.990953:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746534912 00000100:00100000:2.0:1746144656.990958:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746534912 00010000:00010000:2.0:1746144656.990986:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 20 pid: 29370 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144656.991006:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5714 00000100:00100000:2.0:1746144656.991011:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746534912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.991022:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.991043:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 20 pid: 29370 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144656.991053:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 20 pid: 29370 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144656.991076:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144656.991450:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747435648:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.991461:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b42fe000/0xa7c849b16e0195d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4eb expref: 20 pid: 29370 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144656.991610:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746534912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 597us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.991617:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5714 00000100:00100000:3.0:1746144656.991694:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747435776:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144656.991739:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1384448->2097151] (req 1384448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 18 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144656.991749:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d450200, rc 0) 00000100:00100000:3.0:1746144656.991783:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:28960:x1830964746534784:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2809us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144656.991789:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11491 00000100:00100000:0.0:1746144656.992688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144656.992765:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746535040 00000100:00100000:2.0:1746144656.992770:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746535040 00010000:00010000:2.0:1746144656.992791:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 13 pid: 22208 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144656.992808:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5715 00000100:00100000:2.0:1746144656.992814:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746535040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144656.993080:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144656.993098:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 13 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144656.993110:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 13 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144656.993127:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e019660 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e54d expref: 13 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144656.993176:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.993178:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144656.993185:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.993199:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144656.993229:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144656.993241:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747435904:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144656.993316:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144656.994716:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747435904:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144656.994731:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144656.994770:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746535040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1955us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144656.994778:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5715 00000100:00100000:0.0:1746144656.995203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144656.995353:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746535296 00000100:00100000:3.0:1746144656.995358:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746535296 00002000:00100000:3.0:1746144656.995404:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1384448->1388543) req@ffff88012c947100 x1830964746535296/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/0 e 0 to 0 dl 1746144667 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.995413:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947100 with x1830964746535296 ext(1384448->1388543) 00002000:00010000:3.0:1746144656.995418:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c947100 00000100:00100000:3.0:1746144656.995448:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4338 00000100:00100000:3.0:1746144656.995456:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746535296:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144656.995628:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746535296:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 173us (425us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144656.995634:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4338 00002000:00100000:3.0:1746144656.995639:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1384448->1388543) req@ffff88012c947100 x1830964746535296/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:297/0 lens 488/4536 e 0 to 0 dl 1746144667 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144656.995646:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947100 with x1830964746535296 ext(1384448->1388543) 00002000:00010000:3.0:1746144656.995649:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c947100 00000100:00100000:0.0:1746144657.002669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.002770:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746535424 00000100:00100000:3.0:1746144657.002781:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746535424 00000100:00100000:3.0:1746144657.003627:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11492 00000100:00100000:3.0:1746144657.003640:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:28960:x1830964746535424:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144657.003660:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.003680:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5d2 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.003711:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.003720:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.003727:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.003730:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.003733:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.003761:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.003772:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 11 pid: 8450 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144657.003784:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436032:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.004277:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.004285:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144657.004292:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436160:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.004311:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.006853:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436032:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.006861:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436160:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.006907:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->1306623] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.006921:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d451600, rc 0) 00000100:00100000:3.0:1746144657.006961:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:28960:x1830964746535424:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3327us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.006969:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11492 00000100:00100000:0.0:1746144657.011072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.011211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.011297:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746535680 00000100:00100000:2.0:1746144657.011299:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746535552 00000100:00100000:2.0:1746144657.011306:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746535552 00000100:00100000:1.0:1746144657.011306:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746535680 00010000:00010000:2.0:1746144657.011341:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746144657.011341:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 12 pid: 8450 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.011496:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5716 00000100:00100000:1.0:1746144657.011504:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746535680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.011518:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144657.011525:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5717 00000100:00100000:2.0:1746144657.011532:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746535552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.011539:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.011540:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 12 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.011548:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746144657.011558:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 12 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.011571:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746144657.011891:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edd2800/0xa7c849b16e019667 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e554 expref: 12 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.011897:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0195c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4f2 expref: 19 pid: 22208 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.012081:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.012083:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.012091:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 18 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.012101:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 18 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.012111:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.012151:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 18 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.012174:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747436288:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144657.012181:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746535680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 677us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.012187:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5716 00000100:00100000:2.0:1746144657.012237:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.015947:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747436288:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.015974:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.016022:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746535552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4489us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.016034:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5717 00000100:00100000:1.0:1746144657.022609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.022700:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746535936 00000100:00100000:2.0:1746144657.022710:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746535936 00002000:00100000:2.0:1746144657.022761:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1302528->1306623) req@ffff880099b8d880 x1830964746535936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.022771:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8d880 with x1830964746535936 ext(1302528->1306623) 00002000:00010000:2.0:1746144657.022777:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8d880 00000100:00100000:2.0:1746144657.023044:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4339 00000100:00100000:2.0:1746144657.023054:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746535936:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144657.023356:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746535936:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 303us (756us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144657.023363:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4339 00002000:00100000:2.0:1746144657.023369:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1302528->1306623) req@ffff880099b8d880 x1830964746535936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.023376:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8d880 with x1830964746535936 ext(1302528->1306623) 00002000:00010000:2.0:1746144657.023378:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8d880 00000100:00100000:0.0:1746144657.025092:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.025636:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746536192 00000100:00100000:2.0:1746144657.025645:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746536192 00000100:00100000:2.0:1746144657.025704:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4026 00000100:00100000:2.0:1746144657.025712:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28960:x1830964746536192:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144657.026875:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28960:x1830964746536192:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1159us (1787us total) trans 8589943888 rc 0/0 00000100:00100000:2.0:1746144657.026883:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4026 00000100:00100000:0.0:1746144657.061926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.062976:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746536320 00000100:00100000:3.0:1746144657.062988:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746536320 00000100:00100000:3.0:1746144657.063062:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11493 00000100:00100000:3.0:1746144657.063077:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746536320:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.063099:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.063119:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d451800/0xa7c849b16e019724 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5d9 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.063205:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747436416:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144657.063307:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8840 going to sleep for 11 seconds 00002000:00010000:3.0:1746144657.064821:0:8389:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144656 -> 1746144657 00000100:00100000:3.0:1746144657.064845:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747436416:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144657.064890:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d451800/0xa7c849b16e019724 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d9 expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.064901:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d451800/0xa7c849b16e019724 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d9 expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.064928:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d451800, rc 0) 00000100:00100000:3.0:1746144657.064958:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746536320:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1888us (3042us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144657.064964:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11493 00000100:00100000:0.0:1746144657.069037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.069191:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746536576 00000100:00100000:2.0:1746144657.069201:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746536576 00000100:00100000:2.0:1746144657.069518:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10021 00000100:00100000:2.0:1746144657.069529:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:28973:x1830964746536576:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.069555:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.069572:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47e00/0xa7c849b16e01972b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5e0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.069676:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.069690:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.069701:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144657.069711:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144657.069829:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47e00/0xa7c849b16e01972b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.069860:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.069868:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.069871:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746144657.069874:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b47c00, rc 0) 00000100:00100000:2.0:1746144657.069931:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:28973:x1830964746536576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 404us (904us total) trans 8589943889 rc 0/0 00000100:00100000:2.0:1746144657.069936:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10021 00000100:00100000:0.0:1746144657.073497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.073779:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746536704 00000100:00100000:3.0:1746144657.073789:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746536704 00000100:00100000:2.0:1746144657.073883:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11494 00000100:00100000:2.0:1746144657.073895:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746536704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.073915:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.073934:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46400/0xa7c849b16e019740 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5e7 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.073992:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747436544:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144657.074241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.074893:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746536832 00000100:00100000:3.0:1746144657.074897:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746536832 00000100:00100000:3.0:1746144657.074940:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11495 00000100:00100000:3.0:1746144657.074947:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746536832:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.074956:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.074966:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d451a00/0xa7c849b16e019747 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5ee expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.074997:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436672:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144657.075610:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.075918:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.076936:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747436544:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144657.076963:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46400/0xa7c849b16e019740 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e7 expref: 14 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.076976:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46400/0xa7c849b16e019740 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e7 expref: 14 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.077000:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b46400, rc 0) 00000100:00100000:2.0:1746144657.077565:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746536704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3671us (4078us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.077573:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11494 00002000:00010000:3.0:1746144657.077650:0:8389:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144654 -> 1746144657 00002000:00010000:3.0:1746144657.077654:0:8389:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144654 -> 1746144657 00002000:00010000:3.0:1746144657.077656:0:8389:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144654 -> 1746144657 00000100:00100000:3.0:1746144657.077667:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436672:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144657.077709:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d451a00/0xa7c849b16e019747 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5ee expref: 12 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.077719:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d451a00/0xa7c849b16e019747 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5ee expref: 12 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.078844:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d451a00, rc 0) 00000100:00100000:3.0:1746144657.078882:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746536832:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3934us (4639us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144657.078889:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11495 00000100:00100000:0.0:1746144657.079820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.079854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.079880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.079917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.079938:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746537216 00000100:00100000:0.0:1746144657.079945:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746537216 00002000:00100000:0.0:1746144657.079985:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4dd5500 x1830964746537216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.079994:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5500 with x1830964746537216 ext(0->1048575) 00002000:00010000:0.0:1746144657.079999:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5500 00000100:00100000:0.0:1746144657.080013:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746537344 00000100:00100000:0.0:1746144657.080016:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746537344 00002000:00100000:0.0:1746144657.080025:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a4dd5180 x1830964746537344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.080031:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5180 with x1830964746537344 ext(1048576->2097151) 00002000:00010000:0.0:1746144657.080034:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5180 00000100:00100000:0.0:1746144657.080042:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746537728 00000100:00100000:0.0:1746144657.080043:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746537728 00002000:00100000:0.0:1746144657.080053:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1306624->2097151) req@ffff8800a4dd4000 x1830964746537728/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.080059:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4000 with x1830964746537728 ext(1306624->2097151) 00002000:00010000:0.0:1746144657.080062:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd4000 00000100:00100000:0.0:1746144657.080068:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746537600 00000100:00100000:0.0:1746144657.080069:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746537600 00002000:00100000:0.0:1746144657.080076:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1384447) req@ffff8800a4dd6300 x1830964746537600/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.080081:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd6300 with x1830964746537600 ext(1048576->1384447) 00002000:00010000:0.0:1746144657.080084:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd6300 00000100:00100000:0.0:1746144657.080092:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4340 00000100:00100000:0.0:1746144657.080098:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746537216:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144657.080832:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4341 00000100:00100000:2.0:1746144657.080929:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746537344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.081010:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4342 00000100:00100000:0.0:1746144657.081017:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746537728:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.081072:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4343 00000100:00100000:0.0:1746144657.081077:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746537600:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144657.085749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.088092:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746537984 00000100:00100000:3.0:1746144657.088106:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746537984 00000100:00100000:3.0:1746144657.088516:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11496 00000100:00100000:3.0:1746144657.088528:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+11:28973:x1830964746537984:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.088547:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.088565:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5f5 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.088594:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.088602:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.088604:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.088608:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 12 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.088642:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.088653:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.088666:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436800:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.088752:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.091571:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746537600:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10482us (11641us total) trans 0 rc 335872/335872 00000100:00100000:1.0:1746144657.091582:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4343 00002000:00100000:1.0:1746144657.091594:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1384447) req@ffff8800a4dd6300 x1830964746537600/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.091604:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd6300 with x1830964746537600 ext(1048576->1384447) 00010000:00010000:1.0:1746144657.091614:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.091629:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.091635:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd6300 00000100:00100000:2.0:1746144657.092465:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746537344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11622us (12606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.092474:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4341 00002000:00100000:2.0:1746144657.092479:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8800a4dd5180 x1830964746537344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.092487:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5180 with x1830964746537344 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.092492:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5180 00000100:00100000:0.0:1746144657.098303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.098431:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747436800:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.098490:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 12 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.098510:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdaca00, rc 0) 00000100:00100000:2.0:1746144657.098554:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538112 00000100:00100000:2.0:1746144657.098560:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538112 00002000:00100000:2.0:1746144657.098599:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1384448->2097151) req@ffff8800a4dd7800 x1830964746538112/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.098608:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7800 with x1830964746538112 ext(1384448->2097151) 00010000:00010000:2.0:1746144657.098614:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.098626:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.098632:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd7800 00000100:00100000:2.0:1746144657.098650:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 832 00000100:00100000:2.0:1746144657.098655:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746538112:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144657.099221:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746537216:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19119us (19401us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.099228:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4340 00002000:00100000:1.0:1746144657.099234:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4dd5500 x1830964746537216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.099241:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5500 with x1830964746537216 ext(0->1048575) 00002000:00010000:1.0:1746144657.099244:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5500 00000100:00100000:3.0:1746144657.099311:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+12:28973:x1830964746537984:12345-192.168.204.23@tcp:101:cat.0 Request processed in 10786us (13572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.099318:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11496 00000100:00100000:1.0:1746144657.100847:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746537728:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19826us (20961us total) trans 0 rc 790528/790528 00000100:00100000:1.0:1746144657.100854:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4342 00002000:00100000:1.0:1746144657.100862:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1306624->2097151) req@ffff8800a4dd4000 x1830964746537728/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.100869:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4000 with x1830964746537728 ext(1306624->2097151) 00002000:00010000:1.0:1746144657.100873:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd4000 00000100:00100000:2.0:1746144657.104231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.104303:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538240 00000100:00100000:3.0:1746144657.104315:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538240 00000100:00100000:3.0:1746144657.104391:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10022 00000100:00100000:3.0:1746144657.104417:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:28974:x1830964746538240:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144657.104446:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.104466:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113a00/0xa7c849b16e019755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e5fc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.104535:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104549:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104560:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104573:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104579:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104584:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104701:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104710:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104717:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144657.104752:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144657.104756:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144657.104772:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104781:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104788:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104794:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104800:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104805:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5113000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.104809:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104816:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104827:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144657.104830:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.104834:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104839:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113000/0xa7c849b16e01975c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104870:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104876:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104880:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104884:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5112600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.104887:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104891:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104897:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33500) 00010000:00010000:3.0:1746144657.104899:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.104901:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104906:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5112600/0xa7c849b16e019763 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.104932:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113a00/0xa7c849b16e019755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746144657.104969:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746144657.105679:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.105688:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.105691:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144657.105694:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5113200, rc 0) 00000100:00100000:3.0:1746144657.105737:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746538240:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 1339us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.105744:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10022 00000100:00100000:3.0:1746144657.105932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.106028:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538368 00000100:00100000:0.0:1746144657.106033:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538368 00000100:00100000:0.0:1746144657.106061:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11497 00000100:00100000:0.0:1746144657.106073:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:28970:x1830964746538368:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144657.106081:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.106091:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e603 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.106109:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144657.106113:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 21 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.106122:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 21 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.106129:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009984d000, rc 0) 00000100:00100000:0.0:1746144657.106178:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:28970:x1830964746538368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 108us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.106183:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11497 00000100:00100000:2.0:1746144657.108024:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746538112:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9362us (9727us total) trans 21474840449 rc 0/0 00000100:00100000:2.0:1746144657.108035:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 832 00002000:00100000:2.0:1746144657.108046:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1384448->2097151) req@ffff8800a4dd7800 x1830964746538112/t21474840449(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.108055:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7800 with x1830964746538112 ext(1384448->2097151) 00010000:00010000:2.0:1746144657.108063:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.108082:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.108089:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd7800 00000100:00100000:0.0:1746144657.108627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.109075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.109131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.109187:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538496 00000100:00100000:0.0:1746144657.109194:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538496 00000100:00100000:1.0:1746144657.109201:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538624 00000100:00100000:1.0:1746144657.109205:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538624 00000100:00100000:0.0:1746144657.109238:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538752 00000100:00100000:0.0:1746144657.109240:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538752 00000100:00100000:0.0:1746144657.109253:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11498 00000100:00100000:1.0:1746144657.109260:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11499 00000100:00100000:0.0:1746144657.109261:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1962:x1830964746538496:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:1.0:1746144657.109266:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746538624:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144657.109274:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.109274:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1746144657.109284:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746144657.109287:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f122800/0xa7c849b16e019778 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e611 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.109287:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e60a expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746144657.109288:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746144657.109307:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.109309:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144657.109312:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11500 00000100:00100000:2.0:1746144657.109319:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746538752:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144657.109319:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.109325:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.109333:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e019786 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e618 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.109333:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144657.109337:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747436928:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144657.109341:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009984d400, rc 0) 00000100:00100000:2.0:1746144657.109355:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747437056:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144657.109366:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746538496:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 107us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.109371:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11498 00000100:00100000:1.0:1746144657.109530:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.109576:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a47e9840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.110771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.110795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.110809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.110810:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746538880 00000100:00100000:3.0:1746144657.110815:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746538880 00000100:00100000:3.0:1746144657.110847:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746539008 00000100:00100000:3.0:1746144657.110849:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746539008 00000100:00100000:3.0:1746144657.110867:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746539136 00000100:00100000:3.0:1746144657.110869:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746539136 00000100:00100000:3.0:1746144657.110885:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11501 00000100:00100000:3.0:1746144657.110890:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746538880:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:2.0:1746144657.110898:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11502 00010000:00010000:3.0:1746144657.110900:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144657.110904:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11503 00000100:00100000:2.0:1746144657.110905:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746539008:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144657.110911:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e61f expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.110912:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144657.110912:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746539136:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144657.110920:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f106000/0xa7c849b16e019794 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e626 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.110921:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.110925:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.110926:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.110929:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e62d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.110933:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.110940:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.110942:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.110944:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144657.110946:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747437184:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144657.110946:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.110951:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009945e400, rc 0) 00010000:00010000:1.0:1746144657.110957:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144657.110977:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746538880:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.110981:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1832240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.110995:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11501 00000100:00100000:2.0:1746144657.111024:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747437056:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144657.111043:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e019786 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e618 expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.111052:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e019786 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e618 expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.111063:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107e00, rc 0) 00000100:00100000:2.0:1746144657.111079:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746538752:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 1761us (1948us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.111084:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11500 00000100:00100000:2.0:1746144657.111130:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747436928:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144657.111178:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f122800/0xa7c849b16e019778 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e611 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.111186:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f122800/0xa7c849b16e019778 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e611 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.111193:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f122800, rc 0) 00000100:00100000:2.0:1746144657.111208:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746538624:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 1944us (2134us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.111213:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11499 00000100:00100000:0.0:1746144657.111225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.111239:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746539264 00000100:00100000:2.0:1746144657.111242:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746539264 00010000:00010000:2.0:1746144657.111257:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.111274:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5718 00000100:00100000:2.0:1746144657.111279:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746539264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.111287:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.111294:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.111303:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.111317:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d450200/0xa7c849b16e019716 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5cb expref: 21 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.111325:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.111326:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.111331:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 11 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.111338:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 11 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.111345:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.111346:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.111347:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f123000, rc 0) 00010000:00010000:2.0:1746144657.111349:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 20 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.111360:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 20 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.111376:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 20 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.111376:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746539136:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 464us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.111382:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11503 00000100:00100000:2.0:1746144657.111384:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747437312:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.111420:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 11 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.111428:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747437440:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.111443:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1832f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.113822:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747437184:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144657.113830:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747437312:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144657.113838:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747437440:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144657.113849:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.113850:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f106000/0xa7c849b16e019794 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e626 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.113860:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f106000/0xa7c849b16e019794 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e626 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.113868:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f106000, rc 0) 00000100:00100000:3.0:1746144657.114021:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746539264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2610us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.114031:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5718 00000100:00100000:2.0:1746144657.114051:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746539008:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3147us (3254us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.114057:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11502 00000100:00100000:0.0:1746144657.117407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.117562:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746539520 00000100:00100000:2.0:1746144657.117573:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746539520 00002000:00100000:2.0:1746144657.117623:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a4dd4700 x1830964746539520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.117633:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4700 with x1830964746539520 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.117638:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd4700 00000100:00100000:2.0:1746144657.117669:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4344 00000100:00100000:2.0:1746144657.117676:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746539520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.118781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.118820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.118925:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540032 00000100:00100000:1.0:1746144657.118930:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540032 00002000:00100000:1.0:1746144657.118958:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a4dd7100 x1830964746540032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.118966:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7100 with x1830964746540032 ext(1048576->2097151) 00002000:00010000:1.0:1746144657.118970:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd7100 00000100:00100000:1.0:1746144657.118984:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4345 00000100:00100000:1.0:1746144657.118990:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746540032:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.119031:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746539904 00000100:00100000:3.0:1746144657.119035:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746539904 00000100:00100000:3.0:1746144657.119074:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10023 00000100:00100000:3.0:1746144657.119080:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746539904:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144657.119093:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.119111:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af200/0xa7c849b16e0197a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e634 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120120:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.120168:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120176:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120182:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120193:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120198:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.120233:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120246:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 8 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.120258:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437568:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.120915:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120924:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 15 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.120932:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437696:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.120956:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120963:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 301 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.120970:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437824:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.120990:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.120996:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 15 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.121003:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437952:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.121016:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.126602:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.126646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.126680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.126876:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746539520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9198us (9478us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.126889:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4344 00002000:00100000:2.0:1746144657.126905:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a4dd4700 x1830964746539520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.126914:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4700 with x1830964746539520 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.126920:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd4700 00000100:00100000:2.0:1746144657.126969:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540160 00000100:00100000:2.0:1746144657.126977:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540160 00010000:00010000:2.0:1746144657.127004:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 9 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.127024:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540416 00000100:00100000:2.0:1746144657.127026:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540416 00010000:00010000:2.0:1746144657.127036:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 16 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.127048:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540288 00000100:00100000:2.0:1746144657.127049:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540288 00010000:00010000:2.0:1746144657.127058:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 17 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.127072:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5719 00000100:00100000:2.0:1746144657.127078:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746540160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.127090:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.127095:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 9 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.127105:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 9 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.127126:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.127132:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127173:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127178:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.127192:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746540160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 115us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.127198:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5719 00000100:00100000:2.0:1746144657.127207:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5720 00000100:00100000:2.0:1746144657.127211:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746540416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.127216:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.127220:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 17 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.127231:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 17 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.127240:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.127242:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127247:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127251:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.127262:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746540416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 51us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.127267:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5720 00000100:00100000:2.0:1746144657.127300:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5721 00000100:00100000:2.0:1746144657.127304:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746540288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.127309:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.127312:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 16 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.127318:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 16 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.127326:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.127329:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127333:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127338:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.127347:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746540288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 43us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.127352:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5721 00010000:00010000:3.0:1746144657.127464:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5113200/0xa7c849b16e01976a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5fc expref: 8 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.127482:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437568:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.127493:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b46200/0xa7c849b16e019701 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5bd expref: 15 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.127500:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437696:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.127509:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437824:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.127516:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019644 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e531 expref: 14 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.127524:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747437952:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.127578:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144657.127749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.127786:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540544 00000100:00100000:1.0:1746144657.127791:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540544 00010000:00010000:1.0:1746144657.127807:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.127829:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5722 00000100:00100000:1.0:1746144657.127834:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1960:x1830964746540544:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.127841:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.127844:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.127851:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.127862:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133c66200/0xa7c849b16e0196de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5b6 expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.127875:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144657.127878:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.127885:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.127892:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.127905:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.127911:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.127917:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144657.127933:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1960:x1830964746540544:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000004:00200000:2.0:1746144657.127937:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:1.0:1746144657.127938:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5722 00010000:00010000:2.0:1746144657.128071:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af200/0xa7c849b16e0197a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e634 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.128087:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e634 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.128093:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.128095:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144657.128097:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b42af400, rc 0) 00000100:00100000:2.0:1746144657.128116:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28974:x1830964746539904:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 9037us (9296us total) trans 8589943890 rc 0/0 00000100:00100000:2.0:1746144657.128122:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10023 00000100:00100000:1.0:1746144657.128125:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746540032:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9135us (9349us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.128130:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4345 00002000:00100000:1.0:1746144657.128162:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a4dd7100 x1830964746540032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.128170:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7100 with x1830964746540032 ext(1048576->2097151) 00002000:00010000:1.0:1746144657.128174:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd7100 00000100:00100000:0.0:1746144657.129573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.129768:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540800 00000100:00100000:2.0:1746144657.129775:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540800 00000100:00100000:2.0:1746144657.129842:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10024 00000100:00100000:2.0:1746144657.130029:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28974:x1830964746540800:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144657.130052:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.130056:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144657.130076:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b42af400/0xa7c849b16e0197a9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e634 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.130093:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.130096:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.130108:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f107200/0xa7c849b16e0197b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e63b expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.130239:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.130251:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.130259:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144657.130268:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144657.130357:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f107200/0xa7c849b16e0197b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.130369:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.130375:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.130378:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144657.130380:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f106000, rc 0) 00000100:00100000:2.0:1746144657.130982:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28974:x1830964746540800:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 955us (1413us total) trans 8589943891 rc 0/0 00000100:00100000:2.0:1746144657.130989:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10024 00000100:00100000:0.0:1746144657.131737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.131802:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746540928 00000100:00100000:2.0:1746144657.131807:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746540928 00000100:00100000:2.0:1746144657.133329:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11504 00000100:00100000:2.0:1746144657.133340:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+12:28973:x1830964746540928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.133357:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.133373:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e642 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.133401:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.133408:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144657.133410:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144657.133413:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.133443:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.133453:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 19 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.133464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.133465:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747438080:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.133532:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.133602:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541056 00000100:00100000:3.0:1746144657.133608:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541056 00000100:00100000:3.0:1746144657.133708:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10025 00000100:00100000:3.0:1746144657.133715:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28974:x1830964746541056:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144657.133728:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.133739:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4078600/0xa7c849b16e0197d3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e649 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.133791:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4078600/0xa7c849b16e0197d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e649 expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.133803:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4078600/0xa7c849b16e0197d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e649 expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.133821:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.133824:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144657.133826:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4078600, rc 0) 00000100:00100000:3.0:1746144657.133863:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:28974:x1830964746541056:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 149us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.133869:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10025 00000100:00100000:0.0:1746144657.136516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.136592:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541184 00000100:00100000:1.0:1746144657.136601:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541184 00000100:00100000:2.0:1746144657.136616:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747438080:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.136638:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11505 00000100:00100000:1.0:1746144657.136645:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746541184:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144657.136651:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.136671:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107e00, rc 0) 00010000:00010000:1.0:1746144657.136681:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.136693:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.136700:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 7 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144657.136706:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:28973:x1830964746540928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3369us (4970us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144657.136706:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.136711:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144657.136713:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11504 00010000:00010000:1.0:1746144657.136713:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.136715:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.136745:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.136755:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 13 pid: 8450 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.136768:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747438208:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.136801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144657.136835:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 7 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.136843:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 7 pid: 8453 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.136851:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747438336:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.136876:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.136884:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 25 pid: 29370 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.136892:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747438464:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.136897:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541312 00000100:00100000:0.0:1746144657.136900:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541312 00000100:00100000:1.0:1746144657.136915:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.137046:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11506 00000100:00100000:2.0:1746144657.137053:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746541312:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144657.137073:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137084:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 12 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137091:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137095:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.137096:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.137098:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137110:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137117:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 19 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.137130:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747438592:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.137213:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 12 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137222:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 12 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.137230:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c947480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747438720:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.137248:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.137400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.137412:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541440 00000100:00100000:0.0:1746144657.137414:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541440 00000100:00100000:0.0:1746144657.137705:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11507 00000100:00100000:0.0:1746144657.137714:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746541440:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:0.0:1746144657.137731:0:8389:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.137740:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144657.137743:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 12 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.137748:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144657.137750:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.137769:0:8389:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 12 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.137777:0:8389:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144657.137800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.137815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.137842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.137855:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541696 00000100:00100000:1.0:1746144657.137859:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541696 00000100:00100000:3.0:1746144657.137899:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541952 00000100:00100000:2.0:1746144657.137899:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541824 00000100:00100000:2.0:1746144657.137902:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541824 00000100:00100000:3.0:1746144657.137903:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541952 00000100:00100000:2.0:1746144657.137922:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11508 00000100:00100000:2.0:1746144657.137927:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746541824:12345-192.168.204.23@tcp:1:mirror_io.0 00000100:00100000:3.0:1746144657.137934:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11509 00000100:00100000:3.0:1746144657.137939:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746541952:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144657.137944:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137953:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.137954:0:29370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137959:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144657.137960:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746144657.137961:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11510 00010000:00010000:2.0:1746144657.137962:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.137966:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.137966:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746541696:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144657.137977:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.137978:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.137980:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.137985:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 12 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.137985:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.137989:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.137989:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 13 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.137991:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.137993:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.137993:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747438976:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.137995:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.138002:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.138007:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 12 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.138007:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.138008:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.138010:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.138014:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 12 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.138018:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.138022:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747439104:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.138022:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.138029:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 25 pid: 4760 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.138035:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747439232:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.138059:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.138067:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.138074:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747439360:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.138095:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 13 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.138103:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 13 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.138111:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747439488:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.138127:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746144657.138268:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.138276:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 8 pid: 4758 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144657.138285:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747439616:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.138325:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.138332:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 19 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.138339:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747439744:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.138356:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.138513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.138559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.138615:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746541568 00000100:00100000:1.0:1746144657.138619:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746541568 00000100:00100000:3.0:1746144657.138620:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542080 00000100:00100000:3.0:1746144657.138622:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542080 00002000:00100000:1.0:1746144657.138643:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1306623) req@ffff8800a4ebd880 x1830964746541568/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746144657.138647:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11511 00000100:00100000:3.0:1746144657.138652:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:28970:x1830964746542080:12345-192.168.204.23@tcp:101:cat.0 00002000:00100000:1.0:1746144657.138652:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebd880 with x1830964746541568 ext(1048576->1306623) 00010000:00010000:1.0:1746144657.138658:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.138659:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.138666:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.138667:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e650 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144657.138672:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4ebd880 00010000:00010000:3.0:1746144657.138680:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.138682:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.138687:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 833 00010000:00010000:3.0:1746144657.138688:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144657.138691:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.138691:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746541568:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:3.0:1746144657.138701:0:4760:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.138726:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.138733:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee26a00, rc 0) 00000100:00100000:3.0:1746144657.138752:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:28970:x1830964746542080:12345-192.168.204.23@tcp:101:cat.0 Request processed in 101us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.138757:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11511 00000100:00100000:0.0:1746144657.139673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.139728:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542208 00000100:00100000:3.0:1746144657.139732:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542208 00000100:00100000:1.0:1746144657.139733:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747438208:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.139742:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747438336:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.139748:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747438464:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.139751:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 10 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:1.0:1746144657.139764:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.139768:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5723 00000100:00100000:3.0:1746144657.139774:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746542208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.139783:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.139855:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 10 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.139865:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 10 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.139883:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009984d400/0xa7c849b16e01977f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e60a expref: 10 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.139939:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144657.139971:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746542208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 196us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.139976:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5723 00000100:00100000:3.0:1746144657.142102:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747438976:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.142125:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.142190:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747439104:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.142193:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747438592:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.142198:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747439616:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.142201:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c947480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747438720:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.142205:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747439744:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.142217:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.142239:0:29370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.142365:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747439232:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.142373:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747439360:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.142380:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747439488:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.142395:0:8453:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144657.146635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.146728:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542592 00000100:00100000:2.0:1746144657.146738:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542592 00002000:00100000:2.0:1746144657.146786:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3596288->3678207) req@ffff88009b812300 x1830964746542592/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.146796:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b812300 with x1830964746542592 ext(3596288->3678207) 00010000:00010000:2.0:1746144657.146806:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.146819:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.146825:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b812300 00000100:00100000:2.0:1746144657.146860:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 834 00000100:00100000:2.0:1746144657.146868:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746542592:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144657.147251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.147317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.147334:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542976 00000100:00100000:0.0:1746144657.147337:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542976 00010000:00010000:0.0:1746144657.147356:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746144657.147372:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542464 00000100:00100000:0.0:1746144657.147374:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542464 00000100:00100000:3.0:1746144657.147379:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5724 00010000:00010000:0.0:1746144657.147385:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.147402:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746542976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144657.147407:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5725 00000100:00100000:0.0:1746144657.147411:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746542464:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.147414:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144657.147419:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.147431:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.147434:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.147442:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.147444:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.147463:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009945e400/0xa7c849b16e01978d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e61f expref: 9 pid: 8388 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.147463:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdaca00/0xa7c849b16e01974e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5f5 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.147485:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144657.147485:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144657.147505:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746542464:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.147509:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746542976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 123us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.147512:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5725 00000100:00100000:3.0:1746144657.147515:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5724 00000100:00100000:1.0:1746144657.147577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.147594:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542848 00000100:00100000:2.0:1746144657.147597:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542848 00010000:00010000:2.0:1746144657.147610:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.147613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.147624:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543360 00000100:00100000:2.0:1746144657.147626:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543360 00000100:00100000:1.0:1746144657.147628:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5726 00010000:00010000:2.0:1746144657.147633:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 16 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.147633:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746542848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.147640:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144657.147645:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5727 00000100:00100000:2.0:1746144657.147648:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746543360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.147652:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.147656:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.147659:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.147662:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 16 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.147669:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 16 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.147677:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d450a00/0xa7c849b16e0196bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5a8 expref: 13 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.147679:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd2c00/0xa7c849b16e0196a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e593 expref: 16 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.147690:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144657.147690:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.147704:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746543360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 54us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.147709:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5727 00000100:00100000:1.0:1746144657.147709:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746542848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.147713:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5726 00000100:00100000:1.0:1746144657.147750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.147818:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543488 00000100:00100000:3.0:1746144657.147822:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543488 00010000:00010000:3.0:1746144657.147838:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 15 pid: 8450 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144657.147852:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5728 00000100:00100000:3.0:1746144657.147857:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746543488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.147864:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.147875:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 15 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.147882:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 15 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.147893:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edd3000/0xa7c849b16e019659 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e546 expref: 15 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.147900:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144657.147918:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746543488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.147923:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5728 00000100:00100000:0.0:1746144657.148212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.148253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.148704:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542720 00000100:00100000:2.0:1746144657.148708:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542720 00000100:00100000:3.0:1746144657.148710:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543232 00000100:00100000:3.0:1746144657.148713:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543232 00000100:00100000:0.0:1746144657.148715:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144657.148723:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 22 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.148729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144657.148731:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 9 pid: 4758 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.148739:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746542336 00000100:00100000:2.0:1746144657.148741:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746542336 00000100:00100000:3.0:1746144657.148743:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543104 00000100:00100000:3.0:1746144657.148744:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543104 00000100:00100000:0.0:1746144657.148746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144657.148751:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 28 pid: 29370 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.148755:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 28 pid: 4760 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746144657.148756:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543616 00000100:00100000:0.0:1746144657.148758:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543616 00000100:00100000:2.0:1746144657.148761:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5729 00010000:00010000:0.0:1746144657.148768:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 23 pid: 8453 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.148917:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746542720:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144657.148919:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5730 00010000:00010000:2.0:1746144657.148926:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144657.148927:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746543232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.148934:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.148936:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 23 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.148944:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 9 pid: 4758 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.148945:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 23 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.148953:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 9 pid: 4758 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.148957:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009984d000/0xa7c849b16e019771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e603 expref: 23 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.148965:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f123000/0xa7c849b16e01979b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e62d expref: 9 pid: 4758 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.148968:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.148970:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.148974:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.148976:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.148983:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.148994:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746543232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 69us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.149000:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5730 00010000:00010000:2.0:1746144657.149007:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144657.149010:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5731 00000100:00100000:3.0:1746144657.149017:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746542336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144657.149022:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746542720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (811us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144657.149024:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144657.149028:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5729 00010000:00010000:3.0:1746144657.149032:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 28 pid: 29370 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.149040:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 28 pid: 29370 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.149040:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5732 00000100:00100000:2.0:1746144657.149045:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746543104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.149051:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6800/0xa7c849b16e0195bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e4e4 expref: 28 pid: 29370 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.149051:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.149059:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 28 pid: 4760 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.149062:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.149064:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.149066:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149067:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 27 pid: 4760 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.149073:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149076:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4b46000/0xa7c849b16e0196c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5af expref: 27 pid: 4760 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.149084:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.149085:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.149087:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149093:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.149338:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144657.149355:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746542336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 340us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.149361:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5731 00010000:00010000:2.0:1746144657.149424:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144657.149425:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149433:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.149440:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746543104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 395us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.149445:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5732 00010000:00010000:1.0:1746144657.149450:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149457:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149462:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149465:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149468:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149472:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e7fc00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144657.149475:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149479:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149484:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149487:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149490:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149494:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f107000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144657.149496:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149497:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149501:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e0197da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149503:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149509:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.149513:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f107000/0xa7c849b16e0197e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.149539:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746541312:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 12488us (12738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.149539:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746541184:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 12895us (13038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.149546:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11505 00000100:00100000:2.0:1746144657.149549:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11506 00010000:00010000:1.0:1746144657.149565:0:8453:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149571:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149583:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149588:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149594:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149605:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e7e800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144657.149608:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149613:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149621:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.149627:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e0197fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.149652:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746541696:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 11686us (11851us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.149656:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11510 00000100:00100000:3.0:1746144657.150949:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746542592:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4077us (4319us total) trans 17179873207 rc 0/0 00000100:00100000:3.0:1746144657.150958:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 834 00002000:00100000:3.0:1746144657.150968:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3596288->3678207) req@ffff88009b812300 x1830964746542592/t17179873207(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.150982:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b812300 with x1830964746542592 ext(3596288->3678207) 00010000:00010000:3.0:1746144657.150989:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.151000:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00002000:00010000:3.0:1746144657.151511:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b812300 00000100:00100000:0.0:1746144657.151728:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5733 00000100:00100000:0.0:1746144657.151738:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746543616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144657.151753:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144657.151769:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 21 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.151784:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 21 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.151803:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1bcb200/0xa7c849b16e0196ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e59a expref: 21 pid: 8453 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.151814:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.151815:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.151818:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.151825:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.151856:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144657.151879:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746543616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 143us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.151884:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5733 00000100:00100000:1.0:1746144657.151952:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746541568:12345-192.168.204.23@tcp:4:cat.0 Request processed in 13259us (13438us total) trans 21474840450 rc 0/0 00000100:00100000:1.0:1746144657.151959:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 833 00002000:00100000:1.0:1746144657.151966:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1306623) req@ffff8800a4ebd880 x1830964746541568/t21474840450(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.151973:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebd880 with x1830964746541568 ext(1048576->1306623) 00010000:00010000:1.0:1746144657.151980:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.151992:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.151998:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4ebd880 00010000:00010000:3.0:1746144657.152039:0:29370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152048:0:29370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152066:0:29370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152073:0:29370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152079:0:29370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152085:0:29370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4079200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144657.152088:0:29370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152099:0:29370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152109:0:29370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.152121:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e0197f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.152219:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746541952:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 14278us (14374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.152227:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11509 00000100:00100000:0.0:1746144657.153565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.153631:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543744 00000100:00100000:1.0:1746144657.153640:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543744 00010000:00010000:1.0:1746144657.153665:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.153686:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5734 00000100:00100000:1.0:1746144657.153691:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746543744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.153703:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.153718:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.153728:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.153744:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d450e00/0xa7c849b16e01970f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3596288->3678207) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5c4 expref: 14 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.153755:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.153756:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.153760:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.153772:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.153799:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144657.153821:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746543744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 130us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.153827:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5734 00010000:00010000:3.0:1746144657.153971:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.153980:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.153997:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154004:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154011:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154022:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f106400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144657.154025:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154031:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154040:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.154041:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.154047:0:7257:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154054:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.154083:0:7257:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.154095:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747439872:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.154102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.154182:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.154293:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746543872 00000100:00100000:0.0:1746144657.154297:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746543872 00010000:00010000:0.0:1746144657.154311:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.154326:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5735 00000100:00100000:0.0:1746144657.154330:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746543872:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144657.154341:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144657.154352:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.154361:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.154373:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d451600/0xa7c849b16e01971d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5d2 expref: 20 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.154381:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.154383:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.154387:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 10 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.154393:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 10 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.154410:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 10 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.154419:0:7100:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 10 pid: 10724 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.154428:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747440000:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144657.154447:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a138e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.156777:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747439872:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144657.156829:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.156838:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e0197ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.157851:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1962:x1830964746541824:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 19917us (20028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.157862:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11508 00000100:00100000:1.0:1746144657.160921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.161187:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747440000:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144657.161211:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144657.161263:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746543872:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6931us (7160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.161471:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746544128 00000100:00100000:2.0:1746144657.161478:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746544128 00000100:00100000:3.0:1746144657.161483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.161533:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746544384 00000100:00100000:3.0:1746144657.161536:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746544384 00002000:00100000:3.0:1746144657.161595:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fb45180 x1830964746544384/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.161605:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb45180 with x1830964746544384 ext(2097152->3145727) 00002000:00010000:3.0:1746144657.161610:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb45180 00000100:00100000:3.0:1746144657.161629:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4346 00000100:00100000:3.0:1746144657.161638:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746544384:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144657.162076:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880099b8ce00 x1830964746544128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.162083:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ce00 with x1830964746544128 ext(1048576->2097151) 00010000:00010000:2.0:1746144657.162091:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.162103:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.162114:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099b8ce00 00000100:00100000:2.0:1746144657.162161:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 835 00000100:00100000:2.0:1746144657.162168:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746544128:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.162513:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5735 00000100:00100000:2.0:1746144657.176504:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746544128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14323us (15578us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.176516:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 835 00002000:00100000:2.0:1746144657.176529:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880099b8ce00 x1830964746544128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.176545:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ce00 with x1830964746544128 ext(1048576->2097151) 00010000:00010000:2.0:1746144657.176555:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.176581:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.176588:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099b8ce00 00000100:00100000:3.0:1746144657.178185:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746544384:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16540us (16693us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.178194:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4346 00002000:00100000:3.0:1746144657.178203:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fb45180 x1830964746544384/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.178211:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb45180 with x1830964746544384 ext(2097152->3145727) 00002000:00010000:3.0:1746144657.178216:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb45180 00000100:00100000:0.0:1746144657.183414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.183522:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746544512 00000100:00100000:3.0:1746144657.183531:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746544512 00000100:00100000:3.0:1746144657.183590:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11512 00000100:00100000:3.0:1746144657.183599:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:28970:x1830964746544512:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.183621:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.183640:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e657 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144657.183668:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d91, atime: 0x68140d90, ctime: 0x68140d91, blocks: 0x1029 00010000:00010000:3.0:1746144657.183689:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.183691:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.183700:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 20 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.183715:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 20 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.183726:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f107400, rc 0) 00000100:00100000:3.0:1746144657.183788:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:28970:x1830964746544512:12345-192.168.204.23@tcp:101:cat.0 Request processed in 190us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.183794:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11512 00000100:00100000:0.0:1746144657.185366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.185429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.185475:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746544768 00000100:00100000:1.0:1746144657.185482:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746544768 00010000:00010000:1.0:1746144657.185508:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.185512:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746544640 00000100:00100000:2.0:1746144657.185516:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746544640 00000100:00100000:1.0:1746144657.185543:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5736 00000100:00100000:2.0:1746144657.185544:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11513 00000100:00100000:2.0:1746144657.185550:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:28973:x1830964746544640:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144657.185550:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746544768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.185561:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.185579:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.185591:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.185609:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f107e00/0xa7c849b16e0197cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e642 expref: 11 pid: 10724 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.185631:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.185632:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.185636:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.185643:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.185675:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.185686:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.185700:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e65e expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.185700:0:8389:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.185702:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746544768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 153us (272us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144657.185707:0:8389:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.185708:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5736 00002000:00010000:2.0:1746144657.185718:0:29370:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d91, atime: 0x68140d8e, ctime: 0x68140d91, blocks: 0x821 00010000:00010000:2.0:1746144657.185728:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.185728:0:8389:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.185730:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.185735:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.185735:0:8389:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.185742:0:8389:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.185746:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.185749:0:8389:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2c1400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144657.185752:0:8389:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.185754:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4587600, rc 0) 00010000:00010000:0.0:1746144657.185759:0:8389:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.185770:0:8389:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.185773:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:28973:x1830964746544640:12345-192.168.204.23@tcp:101:cat.0 Request processed in 224us (412us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144657.185775:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e0197e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.185778:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11513 00000100:00100000:0.0:1746144657.185842:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1962:x1830964746541440:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 48129us (48442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.185849:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11507 00000100:00100000:0.0:1746144657.189596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.189646:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746545024 00000100:00100000:0.0:1746144657.189654:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746545024 00000100:00100000:0.0:1746144657.189699:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10026 00000100:00100000:0.0:1746144657.189708:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:28974:x1830964746545024:12345-192.168.204.23@tcp:36:mirror_io.0 00010000:00010000:0.0:1746144657.189766:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144657.189791:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4078600/0xa7c849b16e0197d3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e649 expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.189815:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144657.189820:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144657.189851:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144657.189868:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.189875:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.189883:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 13 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.189892:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.189899:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144657.189930:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.189943:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 13 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.189957:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440128:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.190039:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 13 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.190047:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 13 pid: 22257 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.190054:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440256:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.190079:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.190087:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 300 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.190095:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b810a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440384:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.190114:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.190121:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 300 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.190127:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440512:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.190537:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a138e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.192025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.192104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.192184:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746545536 00000100:00100000:1.0:1746144657.192191:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746545536 00000100:00100000:1.0:1746144657.192231:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10027 00000100:00100000:1.0:1746144657.192241:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:28976:x1830964746545536:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144657.192262:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.192276:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e019820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e665 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.192327:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746545280 00000100:00100000:3.0:1746144657.192332:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746545280 00002000:00100000:3.0:1746144657.192369:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b813100 x1830964746545280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.192379:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b813100 with x1830964746545280 ext(1048576->2097151) 00002000:00010000:3.0:1746144657.192384:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b813100 00010000:00010000:1.0:1746144657.192386:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144657.192395:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4347 00010000:00010000:1.0:1746144657.192398:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144657.192400:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746545280:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:1.0:1746144657.192409:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144657.192424:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144657.192429:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144657.192434:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144657.192714:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440128:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.192722:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440256:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.192729:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b810a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440384:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.193184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.193625:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746545664 00000100:00100000:2.0:1746144657.193630:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746545664 00010000:00010000:2.0:1746144657.193658:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 16 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.193685:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5737 00000100:00100000:2.0:1746144657.193689:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746545664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.193699:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.193703:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 16 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.193712:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 16 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.193727:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47c00/0xa7c849b16e019732 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e5e0 expref: 16 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.193748:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.193752:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.193759:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.193793:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746545664:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.193799:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5737 00000100:00100000:0.0:1746144657.195584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.195684:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746545792 00000100:00100000:1.0:1746144657.195690:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746545792 00010000:00010000:1.0:1746144657.195710:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 15 pid: 22257 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.195736:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5738 00000100:00100000:1.0:1746144657.195741:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746545792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144657.195751:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.195756:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 15 pid: 22257 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.195764:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 15 pid: 22257 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.195779:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4600/0xa7c849b16e01964b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e538 expref: 15 pid: 22257 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.195792:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144657.195797:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.195804:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144657.195830:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746545792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.195834:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5738 00000100:00100000:0.0:1746144657.196089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.196287:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747440512:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.196337:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144657.196860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.196878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.196890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.196905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.196920:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746546432 00000100:00100000:0.0:1746144657.196923:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746546432 00002000:00100000:0.0:1746144657.196951:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b32fb80 x1830964746546432/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.196960:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32fb80 with x1830964746546432 ext(3145728->4194303) 00002000:00010000:0.0:1746144657.196965:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32fb80 00000100:00100000:0.0:1746144657.196974:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746546560 00000100:00100000:0.0:1746144657.196977:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746546560 00002000:00100000:0.0:1746144657.196987:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009b32df80 x1830964746546560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.196993:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32df80 with x1830964746546560 ext(2097152->3145727) 00002000:00010000:0.0:1746144657.196996:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32df80 00000100:00100000:0.0:1746144657.197008:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746546688 00000100:00100000:0.0:1746144657.197010:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746546688 00002000:00100000:0.0:1746144657.197016:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b32ce00 x1830964746546688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.197022:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ce00 with x1830964746546688 ext(3145728->4194303) 00002000:00010000:0.0:1746144657.197024:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32ce00 00000100:00100000:0.0:1746144657.197033:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4348 00000100:00100000:0.0:1746144657.197037:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746546432:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.198402:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4349 00000100:00100000:0.0:1746144657.198411:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746546560:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.198666:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4350 00000100:00100000:3.0:1746144657.198685:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746546688:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144657.198861:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746546048 00000100:00100000:2.0:1746144657.198867:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746546048 00010000:00010000:2.0:1746144657.198893:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 301 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.198917:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746545920 00000100:00100000:2.0:1746144657.198919:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746545920 00010000:00010000:2.0:1746144657.198929:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 302 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.198940:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5739 00000100:00100000:2.0:1746144657.198945:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1963:x1830964746546048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.198953:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.198958:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.198967:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.198985:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad600/0xa7c849b16e01960c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e51c expref: 302 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.198998:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.199001:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.199009:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.199032:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1963:x1830964746546048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 87us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.199041:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5739 00000100:00100000:2.0:1746144657.199054:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5740 00000100:00100000:2.0:1746144657.199057:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1960:x1830964746545920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.199063:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.199067:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 300 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.199074:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 300 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.199082:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5200/0xa7c849b16e019613 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e523 expref: 300 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.199088:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.199090:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.199096:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.199101:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.199117:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.199128:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1960:x1830964746545920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 69us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.199132:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5740 00010000:00010000:1.0:1746144657.199876:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.199886:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000040:00080000:1.0:1746144657.201683:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2885, 88 off240824 00000004:00080000:1.0:1746144657.201697:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410561630ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201749:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2808, 88 off234040 00000004:00080000:1.0:1746144657.201753:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410618397ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201763:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2809, 88 off234128 00000004:00080000:1.0:1746144657.201766:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410631280ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201775:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2886, 88 off240912 00000004:00080000:1.0:1746144657.201777:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410642365ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201782:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2887, 88 off241000 00000004:00080000:1.0:1746144657.201785:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410650068ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201792:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2810, 88 off234216 00000004:00080000:1.0:1746144657.201794:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410659548ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201800:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2811, 88 off234304 00000004:00080000:1.0:1746144657.201802:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410667980ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201809:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2812, 88 off234392 00000004:00080000:1.0:1746144657.201811:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410676588ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201818:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2888, 88 off241088 00000004:00080000:1.0:1746144657.201821:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410686095ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201828:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2813, 88 off234480 00000004:00080000:1.0:1746144657.201830:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410695808ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201836:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2889, 88 off241176 00000004:00080000:1.0:1746144657.201839:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410704335ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201845:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2814, 88 off234568 00000004:00080000:1.0:1746144657.201847:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410713045ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144657.201854:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2890, 88 off241264 00000004:00080000:1.0:1746144657.201856:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410721638ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201862:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2891, 88 off241352 00000004:00080000:1.0:1746144657.201864:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410729740ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201871:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2892, 88 off241440 00000004:00080000:1.0:1746144657.201873:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410738480ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201878:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2893, 88 off241528 00000004:00080000:1.0:1746144657.201881:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636410746448ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144657.201907:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2815, 88 off234656 00000004:00080000:1.0:1746144657.201910:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636410775775ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144657.213605:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746546432:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16557us (16716us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144657.213618:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4348 00002000:00100000:0.0:1746144657.213631:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b32fb80 x1830964746546432/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.213874:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32fb80 with x1830964746546432 ext(3145728->4194303) 00002000:00010000:0.0:1746144657.213880:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32fb80 00000100:00100000:2.0:1746144657.215103:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746546688:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16425us (18190us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.215114:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4350 00002000:00100000:2.0:1746144657.215122:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b32ce00 x1830964746546688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.215130:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ce00 with x1830964746546688 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.215165:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32ce00 00000100:00100000:3.0:1746144657.220178:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746545280:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27768us (28148us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.220192:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4347 00002000:00100000:3.0:1746144657.220205:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b813100 x1830964746545280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.220214:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b813100 with x1830964746545280 ext(1048576->2097151) 00002000:00010000:3.0:1746144657.220221:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b813100 00000100:00100000:0.0:1746144657.220392:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746546560:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21981us (23498us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144657.220607:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4349 00002000:00100000:0.0:1746144657.220614:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009b32df80 x1830964746546560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.220621:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32df80 with x1830964746546560 ext(2097152->3145727) 00002000:00010000:0.0:1746144657.220624:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32df80 00000100:00100000:0.0:1746144657.228230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.228266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.228415:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746546944 00000100:00100000:1.0:1746144657.228425:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746546944 00000100:00100000:2.0:1746144657.228461:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547072 00000100:00100000:2.0:1746144657.228466:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547072 00000100:00100000:1.0:1746144657.228472:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10028 00000100:00100000:1.0:1746144657.228481:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28970:x1830964746546944:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144657.228492:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10029 00000100:00100000:2.0:1746144657.228498:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+14:28973:x1830964746547072:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.228505:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.228505:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.228524:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e66c expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.228525:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e673 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.228580:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.228590:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 15 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.228601:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 300 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.228616:0:22257:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.228616:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 300 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.228628:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 15 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.228628:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144657.228630:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144657.228633:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 15 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.228639:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144657.228639:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62e400, rc 0) 00010000:00010000:2.0:1746144657.228646:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144657.228650:0:22257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 15 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.228656:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabd400, rc 0) 00000100:00100000:2.0:1746144657.228685:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:28973:x1830964746547072:12345-192.168.204.23@tcp:101:cat.0 Request processed in 188us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.228685:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28970:x1830964746546944:12345-192.168.204.23@tcp:101:cat.0 Request processed in 205us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.228691:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10028 00000100:00100000:2.0:1746144657.228702:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10029 00000004:00010000:1.0:1746144657.234985:0:14710:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b810380 reply state ffff88012e689000 transno 8589943892 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144657.235002:0:14710:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746144657.235126:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:28974:x1830964746545024:12345-192.168.204.23@tcp:36:mirror_io.0 Request processed in 45413us (45534us total) trans 8589943892 rc 0/0 00000100:00100000:1.0:1746144657.235164:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10026 00000001:00080000:1.0:1746144657.235207:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943884 is committed 00000001:00080000:1.0:1746144657.235217:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943881 is committed 00000001:00080000:1.0:1746144657.235229:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943892 is committed 00000004:00080000:1.0:1746144657.235233:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2001 committed 00000004:00080000:1.0:1746144657.235239:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2075 committed 00000004:00080000:1.0:1746144657.235244:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2074 committed 00000004:00080000:1.0:1746144657.235246:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2073 committed 00000004:00080000:1.0:1746144657.235248:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2072 committed 00000004:00080000:1.0:1746144657.235249:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2000 committed 00000004:00080000:1.0:1746144657.235251:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2071 committed 00000004:00080000:1.0:1746144657.235252:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1999 committed 00000004:00080000:1.0:1746144657.235254:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2070 committed 00000004:00080000:1.0:1746144657.235255:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1998 committed 00000004:00080000:1.0:1746144657.235257:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1997 committed 00000004:00080000:1.0:1746144657.235259:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1996 committed 00000004:00080000:1.0:1746144657.235260:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2069 committed 00000004:00080000:1.0:1746144657.235262:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2068 committed 00000004:00080000:1.0:1746144657.235263:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1995 committed 00000004:00080000:1.0:1746144657.235264:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1994 committed 00000004:00080000:1.0:1746144657.235265:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2067 committed 00000001:00080000:1.0:1746144657.235275:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943889 is committed 00000001:00080000:1.0:1746144657.235279:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943888 is committed 00010000:00010000:1.0:1746144657.235400:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.235408:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.235415:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.235420:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2c1200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144657.235424:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.235432:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144657.235448:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144657.235451:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144657.235456:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 8 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.235467:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 8 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.235476:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 8 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.235485:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 296 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.235491:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 296 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.235497:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 296 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.235530:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 296 pid: 14708 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.235543:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747440640:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144657.235607:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 8 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.235615:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747440768:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144657.235632:0:3280:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.235798:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.235833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.235849:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.235862:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.235875:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746144657.235878:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.235890:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.235900:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.235913:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.235933:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441024 00000100:00100000:1.0:1746144657.235940:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441024 00000100:00100000:1.0:1746144657.235980:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441536 00000100:00100000:1.0:1746144657.235982:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441536 00000100:00100000:1.0:1746144657.235990:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441152 00000100:00100000:1.0:1746144657.235992:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441152 00000100:00100000:1.0:1746144657.235999:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441664 00000100:00100000:1.0:1746144657.236000:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441664 00000100:00100000:1.0:1746144657.236010:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11514 00000100:00100000:1.0:1746144657.236016:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3295:x1830964747441024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.236233:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3295:x1830964747441024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (399us total) trans 21474840451 rc 0/0 00000100:00100000:1.0:1746144657.236238:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11514 00000100:00100000:1.0:1746144657.236248:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11515 00000100:00100000:1.0:1746144657.236252:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3295:x1830964747441536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.236318:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3295:x1830964747441536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (455us total) trans 21474840452 rc 0/0 00000100:00100000:1.0:1746144657.236323:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11515 00000100:00100000:1.0:1746144657.236330:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11516 00000100:00100000:1.0:1746144657.236334:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3295:x1830964747441152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144657.236392:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144657.236395:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.236397:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144656 -> 1746144656 00002000:00010000:1.0:1746144657.236398:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.236400:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144657.236413:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3295:x1830964747441152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (522us total) trans 21474840453 rc 0/0 00000100:00100000:1.0:1746144657.236417:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11516 00000100:00100000:1.0:1746144657.236423:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11517 00000100:00100000:1.0:1746144657.236426:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3295:x1830964747441664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.236493:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3295:x1830964747441664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (578us total) trans 21474840454 rc 0/0 00000100:00100000:1.0:1746144657.236498:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11517 00000004:00080000:1.0:1746144657.236544:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8dc00/2, rc 0, transno 21474840453 00000100:00100000:1.0:1746144657.236548:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144657.236556:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b812d80/2, rc 0, transno 21474840454 00000100:00100000:1.0:1746144657.236559:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144657.236565:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8d180/2, rc 0, transno 21474840451 00000100:00100000:1.0:1746144657.236568:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144657.236573:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b810a80/2, rc 0, transno 21474840452 00000100:00100000:1.0:1746144657.236576:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747441536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.236906:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747440896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.236929:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.236943:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.236958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.236967:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.236981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.236990:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237012:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1746144657.237017:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.237031:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237042:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.237056:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237065:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237078:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237089:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237106:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237123:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237170:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237183:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237198:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237209:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746144657.237213:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237228:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237234:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237247:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.237262:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747440896 00000100:00100000:3.0:1746144657.237265:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747440896 00000100:00100000:3.0:1746144657.237288:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441408 00000100:00100000:3.0:1746144657.237290:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441408 00000100:00100000:3.0:1746144657.237297:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441920 00000100:00100000:3.0:1746144657.237298:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441920 00000100:00100000:3.0:1746144657.237310:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442432 00000100:00100000:3.0:1746144657.237312:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442432 00000100:00100000:3.0:1746144657.237318:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441280 00000100:00100000:3.0:1746144657.237319:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441280 00000100:00100000:3.0:1746144657.237326:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747441792 00000100:00100000:3.0:1746144657.237327:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747441792 00000100:00100000:3.0:1746144657.237333:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442304 00000100:00100000:3.0:1746144657.237335:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442304 00000100:00100000:3.0:1746144657.237342:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442816 00000100:00100000:3.0:1746144657.237344:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442816 00000100:00100000:3.0:1746144657.237350:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442176 00000100:00100000:3.0:1746144657.237352:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442176 00000100:00100000:3.0:1746144657.237358:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442688 00000100:00100000:3.0:1746144657.237360:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442688 00000100:00100000:3.0:1746144657.237368:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442048 00000100:00100000:3.0:1746144657.237369:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442048 00000100:00100000:3.0:1746144657.237376:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442560 00000100:00100000:3.0:1746144657.237378:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442560 00000100:00100000:3.0:1746144657.237386:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11518 00000100:00100000:3.0:1746144657.237392:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747440896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.237491:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747440896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (561us total) trans 21474840455 rc 0/0 00000100:00100000:3.0:1746144657.237497:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11518 00000100:00100000:3.0:1746144657.237507:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11519 00000100:00100000:3.0:1746144657.237513:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747441408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.237584:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747441408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (624us total) trans 21474840456 rc 0/0 00000100:00100000:3.0:1746144657.237589:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11519 00000100:00100000:3.0:1746144657.237597:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11520 00000100:00100000:3.0:1746144657.237603:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747441920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237712:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747441920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (729us total) trans 17179873208 rc 0/0 00000100:00100000:3.0:1746144657.237717:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11520 00000100:00100000:3.0:1746144657.237725:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11521 00000100:00100000:3.0:1746144657.237731:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747442432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.237805:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747442432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (801us total) trans 17179873209 rc 0/0 00000100:00100000:3.0:1746144657.237811:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11521 00000100:00100000:3.0:1746144657.237819:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11522 00000100:00100000:3.0:1746144657.237826:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747441280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144657.237885:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144657.237887:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144657.237889:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144657.237891:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144657.237892:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144657.237909:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747441280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (877us total) trans 21474840457 rc 0/0 00000100:00100000:3.0:1746144657.237914:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11522 00000100:00100000:3.0:1746144657.237924:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11523 00000100:00100000:3.0:1746144657.237930:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747441792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.238002:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747441792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (945us total) trans 21474840458 rc 0/0 00000100:00100000:3.0:1746144657.238008:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11523 00000100:00100000:3.0:1746144657.238016:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11524 00000100:00100000:3.0:1746144657.238022:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747442304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.238092:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747442304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1012us total) trans 17179873210 rc 0/0 00000100:00100000:3.0:1746144657.238097:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11524 00000100:00100000:3.0:1746144657.238105:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11525 00000100:00100000:3.0:1746144657.238112:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3294:x1830964747442816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.238213:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747442816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1106us total) trans 17179873211 rc 0/0 00000100:00100000:3.0:1746144657.238219:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11525 00000100:00100000:3.0:1746144657.238344:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11526 00000100:00100000:3.0:1746144657.238352:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3296:x1830964747442176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746144657.238418:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:3.0:1746144657.238421:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:3.0:1746144657.238423:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144657 -> 1746144656 00002000:00010000:3.0:1746144657.238424:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:3.0:1746144657.238426:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5611 00000100:00100000:3.0:1746144657.238448:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747442176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (1277us total) trans 17179873212 rc 0/0 00000100:00100000:3.0:1746144657.238453:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11526 00000100:00100000:3.0:1746144657.238462:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11527 00000100:00100000:3.0:1746144657.238468:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3296:x1830964747442688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.238538:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747442688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1338us total) trans 17179873213 rc 0/0 00000100:00100000:3.0:1746144657.238543:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11527 00000100:00100000:3.0:1746144657.238551:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11528 00000100:00100000:3.0:1746144657.238556:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3296:x1830964747442048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746144657.238621:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144657.238624:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:3.0:1746144657.238626:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:3.0:1746144657.238627:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:3.0:1746144657.238629:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746144657.238647:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747442048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (1418us total) trans 17179873214 rc 0/0 00000100:00100000:3.0:1746144657.238652:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11528 00000100:00100000:3.0:1746144657.238660:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11529 00000100:00100000:3.0:1746144657.238666:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3296:x1830964747442560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.238738:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747442560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1489us total) trans 17179873215 rc 0/0 00000100:00100000:3.0:1746144657.238743:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11529 00000004:00080000:3.0:1746144657.238786:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45880/2, rc 0, transno 17179873214 00000100:00100000:3.0:1746144657.238795:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238803:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb46300/2, rc 0, transno 17179873215 00000100:00100000:3.0:1746144657.238806:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442560:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238812:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb46680/2, rc 0, transno 17179873212 00000100:00100000:3.0:1746144657.238815:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238820:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44380/2, rc 0, transno 17179873213 00000100:00100000:3.0:1746144657.238823:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747442688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238840:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8ea00/2, rc 0, transno 21474840457 00000100:00100000:3.0:1746144657.238843:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441280:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144657.238849:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b811c00/2, rc 0, transno 21474840458 00000100:00100000:3.0:1746144657.238852:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441792:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144657.238858:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45c00/2, rc 0, transno 17179873210 00000100:00100000:3.0:1746144657.238860:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238867:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44e00/2, rc 0, transno 17179873211 00000100:00100000:3.0:1746144657.238869:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442816:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238875:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8ca80/2, rc 0, transno 21474840455 00000100:00100000:3.0:1746144657.238877:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747440896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144657.238883:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b811f80/2, rc 0, transno 21474840456 00000100:00100000:3.0:1746144657.238886:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441408:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144657.238893:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45500/2, rc 0, transno 17179873208 00000100:00100000:3.0:1746144657.238895:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747441920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.238901:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47b80/2, rc 0, transno 17179873209 00000100:00100000:3.0:1746144657.238904:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.238940:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.238960:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.238978:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747442944 00000100:00100000:3.0:1746144657.238981:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747442944 00000100:00100000:3.0:1746144657.239000:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11530 00000100:00100000:3.0:1746144657.239004:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3294:x1830964747442944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.239082:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3294:x1830964747442944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (121us total) trans 17179873216 rc 0/0 00000100:00100000:3.0:1746144657.239087:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11530 00000004:00080000:3.0:1746144657.239105:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51edc00/2, rc 0, transno 17179873216 00000100:00100000:3.0:1746144657.239108:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747442944:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746144657.239741:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144657.239761:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.239769:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144657.239795:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.239808:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 7 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.239818:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747443072:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.239877:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af480 going to sleep for 11 seconds 00000100:00080000:2.0:1746144657.239898:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746144657.239902:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144657.243300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.245370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.245451:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747443072:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.245482:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144657.245529:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547200 00000100:00100000:2.0:1746144657.245536:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547200 00000100:00100000:2.0:1746144657.245581:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10030 00000100:00100000:2.0:1746144657.245590:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28974:x1830964746547200:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144657.245618:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.245637:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e67a expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.245692:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.245704:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.245720:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.245723:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144657.245726:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabce00, rc 0) 00000100:00100000:2.0:1746144657.245764:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28974:x1830964746547200:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 176us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.245770:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10030 00000100:00100000:2.0:1746144657.245791:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547328 00000100:00100000:2.0:1746144657.245794:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547328 00000100:00100000:2.0:1746144657.245811:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4027 00000100:00100000:2.0:1746144657.245815:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28973:x1830964746547328:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144657.245863:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:28973:x1830964746547328:12345-192.168.204.23@tcp:49:cat.0 Request processed in 48us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.245869:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4027 00000100:00100000:0.0:1746144657.245997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.246056:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.246116:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747440640:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144657.246126:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747440768:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144657.246169:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144657.246176:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019819 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 14710 initiator: MDT0 00000100:00100000:3.0:1746144657.246234:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547584 00000100:00100000:3.0:1746144657.246238:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547584 00000100:00100000:3.0:1746144657.246274:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4028 00000100:00100000:3.0:1746144657.246280:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28970:x1830964746547584:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:3.0:1746144657.246326:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28970:x1830964746547584:12345-192.168.204.23@tcp:49:cat.0 Request processed in 46us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.246332:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4028 00000100:00100000:2.0:1746144657.246737:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547456 00000100:00100000:2.0:1746144657.246741:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547456 00010000:00010000:2.0:1746144657.246756:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 8 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.247496:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5741 00000100:00100000:2.0:1746144657.247505:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746547456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.247516:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.247522:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 8 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.247532:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 8 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.247550:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f106000/0xa7c849b16e0197be lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e63b expref: 8 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.247562:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.247565:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144657.247573:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144657.247579:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144657.247594:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.247623:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746547456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.247629:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5741 00010000:00010000:3.0:1746144657.247727:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247732:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144657.247747:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144657.247899:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247906:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247913:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247918:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fabd800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.247921:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247928:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247937:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.247939:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144657.247942:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247945:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd800/0xa7c849b16e019843 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247961:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247966:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247970:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247974:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacc800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.247976:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247981:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247987:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144657.247988:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.247990:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.247999:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc800/0xa7c849b16e019827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248007:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248013:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248018:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248021:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.248023:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248032:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248568:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009e9aca00) 00010000:00010000:3.0:1746144657.248571:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.248573:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248579:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacca00/0xa7c849b16e01982e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.248623:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e019820 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e665 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.248630:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e019820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e665 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.248638:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd200, rc 0) 00000100:00100000:3.0:1746144657.248679:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:28976:x1830964746545536:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 56437us (56574us total) trans 8589943893 rc 301/301 00000100:00100000:3.0:1746144657.248686:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10027 00000100:00100000:2.0:1746144657.248986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.249254:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547840 00000100:00100000:3.0:1746144657.249261:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547840 00000100:00100000:3.0:1746144657.249342:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10031 00000100:00100000:3.0:1746144657.249350:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28978:x1830964746547840:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144657.249364:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.249375:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de800/0xa7c849b16e019858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e681 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.249468:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249479:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249486:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249498:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249503:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249509:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249602:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249609:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249614:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144657.249621:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144657.249675:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249680:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249689:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249693:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b21f8a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.249696:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249701:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249709:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.249711:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144657.249713:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249717:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e01986d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249726:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249730:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249734:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249738:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2df000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.249740:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249744:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249753:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144657.249755:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.249757:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249760:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2df000/0xa7c849b16e01985f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249765:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249769:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249774:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249777:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2dec00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.249779:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249783:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249788:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33700) 00010000:00010000:3.0:1746144657.249789:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.249791:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249794:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2dec00/0xa7c849b16e019866 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.249814:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de800/0xa7c849b16e019858 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e681 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.249822:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de800/0xa7c849b16e019858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e681 expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.249827:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2de800, rc 0) 00000100:00100000:3.0:1746144657.250684:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28978:x1830964746547840:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1333us (1696us total) trans 8589943894 rc 301/301 00000100:00100000:3.0:1746144657.250691:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10031 00000100:00100000:0.0:1746144657.251762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.251838:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746547968 00000100:00100000:3.0:1746144657.251845:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746547968 00000100:00100000:3.0:1746144657.251886:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10032 00000100:00100000:3.0:1746144657.251893:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746547968:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144657.251909:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.251924:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e01987b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e688 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.251992:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.252003:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.252011:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144657.252029:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144657.252033:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144657.252043:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144657.252063:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2de000/0xa7c849b16e01987b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.252074:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.252080:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.252082:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144657.252085:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dad5800, rc 0) 00000100:00100000:3.0:1746144657.252122:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28974:x1830964746547968:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 230us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.252127:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10032 00000100:00100000:0.0:1746144657.255335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.255408:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746548096 00000100:00100000:1.0:1746144657.255418:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746548096 00000100:00100000:1.0:1746144657.255473:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11531 00000100:00100000:1.0:1746144657.255480:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:28973:x1830964746548096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144657.255498:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.255514:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e68f expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.255540:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.255542:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.255549:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.255563:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.255572:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a4e00, rc 0) 00000100:00100000:1.0:1746144657.255625:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+15:28973:x1830964746548096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 145us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.255631:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11531 00000100:00100000:0.0:1746144657.268379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.268435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.268498:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746548352 00000100:00100000:3.0:1746144657.268510:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746548352 00000100:00100000:2.0:1746144657.268559:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746548608 00000100:00100000:2.0:1746144657.268564:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746548608 00002000:00100000:3.0:1746144657.268572:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b32ed80 x1830964746548352/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.268584:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ed80 with x1830964746548352 ext(3145728->4194303) 00002000:00100000:2.0:1746144657.268587:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b32c380 x1830964746548608/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746144657.268591:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32ed80 00000100:00100000:3.0:1746144657.268611:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4351 00000100:00100000:3.0:1746144657.268619:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746548352:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144657.268706:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32c380 with x1830964746548608 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.268710:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32c380 00000100:00100000:2.0:1746144657.268737:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4352 00000100:00100000:2.0:1746144657.268743:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746548608:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.269402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.269436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.269537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.269557:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746549248 00000100:00100000:0.0:1746144657.269563:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746549248 00002000:00100000:0.0:1746144657.269588:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009b32c700 x1830964746549248/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.269595:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32c700 with x1830964746549248 ext(2097152->3145727) 00002000:00010000:0.0:1746144657.269600:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32c700 00000100:00100000:0.0:1746144657.269620:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4353 00000100:00100000:0.0:1746144657.269627:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746549248:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144657.269699:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746548992 00000100:00100000:0.0:1746144657.269704:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746548992 00000100:00100000:0.0:1746144657.269733:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10033 00000100:00100000:0.0:1746144657.269738:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:28976:x1830964746548992:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144657.269754:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.269758:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746144657.269789:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e01983c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e673 expref: 8 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.269815:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144657.269820:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144657.269836:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e255200/0xa7c849b16e019890 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e69d expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.269888:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144657.269904:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 297 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.269911:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.269918:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.269925:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144657.269958:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.269971:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 7 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.269985:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443200:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.270094:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.270103:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 7 pid: 14710 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.270112:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443328:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.270199:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 297 pid: 14708 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.270497:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746548864 00000100:00100000:2.0:1746144657.270503:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746548864 00000100:00100000:2.0:1746144657.270548:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11532 00000100:00100000:2.0:1746144657.270556:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746548864:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144657.270565:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.270582:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e696 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144657.270604:0:8453:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d8f, atime: 0x68140d8e, ctime: 0x68140d8f, blocks: 0x809 00010000:00010000:2.0:1746144657.270623:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.270625:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.270636:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.270650:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.270660:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabd200, rc 0) 00000100:00100000:2.0:1746144657.270695:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746548864:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 140us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.270703:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11532 00010000:00010000:0.0:1746144657.274410:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 297 pid: 14708 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.274446:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443456:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.274539:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.274760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.274785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.274796:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.274817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.274840:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746549376 00000100:00100000:2.0:1746144657.274848:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746549376 00000100:00100000:2.0:1746144657.274884:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746549632 00000100:00100000:2.0:1746144657.274886:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746549632 00000100:00100000:1.0:1746144657.274887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.274899:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746549888 00000100:00100000:2.0:1746144657.274901:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746549888 00000100:00100000:1.0:1746144657.274905:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746549504 00000100:00100000:1.0:1746144657.274908:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746549504 00000100:00100000:2.0:1746144657.274912:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746549760 00000100:00100000:2.0:1746144657.274914:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746549760 00000100:00100000:1.0:1746144657.274929:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11533 00000100:00100000:1.0:1746144657.274935:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746549376:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144657.274953:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144657.274970:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11534 00010000:00010000:1.0:1746144657.274970:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6a4 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.274980:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746549632:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144657.274988:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746144657.274993:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d91, atime: 0x68140d91, ctime: 0x68140d91, blocks: 0x821 00010000:00010000:3.0:1746144657.274999:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6b2 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.275010:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.275012:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.275017:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.275018:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.275020:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.275023:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.275033:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.275033:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.275042:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418ec00, rc 0) 00010000:00010000:1.0:1746144657.275042:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5000, rc 0) 00000100:00100000:1.0:1746144657.275067:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746549376:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 132us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.275068:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746549632:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.275073:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11533 00000100:00100000:3.0:1746144657.275082:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11534 00000100:00100000:1.0:1746144657.275088:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11535 00000100:00100000:1.0:1746144657.275092:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746549888:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:3.0:1746144657.275094:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11536 00010000:00010000:1.0:1746144657.275097:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144657.275101:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746549504:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144657.275103:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6c0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.275107:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.275112:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.275113:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.275115:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6ab expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.275117:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.275124:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746144657.275128:0:8453:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d91, atime: 0x68140d91, ctime: 0x68140d91, blocks: 0x821 00010000:00010000:1.0:1746144657.275130:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5c00, rc 0) 00010000:00010000:3.0:1746144657.275166:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.275168:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144657.275168:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746549888:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 75us (370us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144657.275172:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 9 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144657.275173:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11535 00010000:00010000:3.0:1746144657.275181:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144657.275182:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11537 00000100:00100000:1.0:1746144657.275186:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746549760:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144657.275191:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.275192:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418f600, rc 0) 00010000:00010000:1.0:1746144657.275197:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6b9 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.275205:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.275207:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144657.275210:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746549504:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 111us (392us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144657.275210:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144657.275215:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11536 00010000:00010000:1.0:1746144657.275218:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.275229:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5600, rc 0) 00000100:00100000:1.0:1746144657.275240:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746549760:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.275244:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11537 00000100:00100000:1.0:1746144657.282349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.282384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.282421:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550016 00000100:00100000:2.0:1746144657.282430:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550016 00000100:00100000:3.0:1746144657.282432:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550144 00000100:00100000:3.0:1746144657.282435:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550144 00010000:00010000:3.0:1746144657.282470:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 9 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.282470:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 9 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.282502:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5742 00000100:00100000:2.0:1746144657.282510:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5743 00000100:00100000:2.0:1746144657.282516:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746550016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.282530:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.282536:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 9 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.282546:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 9 pid: 14709 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.282567:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.282571:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.282579:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.282587:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.282637:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746550016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.282643:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5743 00010000:00010000:0.0:1746144657.282816:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e019882 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e688 expref: 8 pid: 14709 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.282834:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443200:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.282861:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443328:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.282869:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443456:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.282904:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144657.282941:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746550144:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.282948:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.282952:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 7 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.282959:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 7 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.282968:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabce00/0xa7c849b16e01984a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e67a expref: 7 pid: 14710 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.282979:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.282982:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.282987:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.282992:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144657.283007:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746550144:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 499us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.283012:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5742 00000100:00100000:2.0:1746144657.283413:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746548352:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14795us (15044us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.283421:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4351 00002000:00100000:2.0:1746144657.283429:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b32ed80 x1830964746548352/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.283438:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ed80 with x1830964746548352 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.283443:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32ed80 00000100:00100000:0.0:1746144657.284405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.284675:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550272 00000100:00100000:3.0:1746144657.284681:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550272 00000100:00100000:0.0:1746144657.284682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.284726:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550400 00000100:00100000:2.0:1746144657.284729:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550400 00000100:00100000:2.0:1746144657.284757:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10034 00010000:00010000:3.0:1746144657.284778:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 298 pid: 14708 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.284796:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5744 00000100:00100000:3.0:1746144657.284804:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1961:x1830964746550272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.284816:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.284824:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 298 pid: 14708 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.284834:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 298 pid: 14708 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.284856:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:28974:x1830964746550400:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144657.284875:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.284887:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6c7 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.284950:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62e400/0xa7c849b16e019835 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e66c expref: 298 pid: 14708 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.285058:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.285066:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.285082:0:14709:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.285093:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.285103:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.285105:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144657.285107:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.285113:0:14709:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.285117:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.285125:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.285169:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabcc00, rc 0) 00010000:00010000:3.0:1746144657.285289:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.285295:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.285301:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144657.285474:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144657.285481:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144657.285775:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746550400:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 918us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.285782:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10034 00000040:00080000:0.0:1746144657.286079:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2894, 88 off241616 00000004:00080000:0.0:1746144657.286085:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636494949778ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286124:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2816, 88 off234744 00000004:00080000:0.0:1746144657.286127:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636494992917ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286174:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2817, 88 off234832 00000004:00080000:0.0:1746144657.286177:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495042522ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286185:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2895, 88 off241704 00000004:00080000:0.0:1746144657.286187:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495052800ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286193:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2896, 88 off241792 00000004:00080000:0.0:1746144657.286197:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495062180ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286203:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2818, 88 off234920 00000004:00080000:0.0:1746144657.286205:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495070487ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286210:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2819, 88 off235008 00000004:00080000:0.0:1746144657.286212:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495077967ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286218:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2820, 88 off235096 00000004:00080000:0.0:1746144657.286221:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495086198ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286226:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2897, 88 off241880 00000004:00080000:0.0:1746144657.286229:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495094588ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286235:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2821, 88 off235184 00000004:00080000:0.0:1746144657.286238:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495103197ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286244:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2898, 88 off241968 00000004:00080000:0.0:1746144657.286246:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495111585ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286252:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2822, 88 off235272 00000004:00080000:0.0:1746144657.286254:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495119530ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144657.286260:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2899, 88 off242056 00000004:00080000:0.0:1746144657.286262:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495127472ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286268:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2900, 88 off242144 00000004:00080000:0.0:1746144657.286270:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495135922ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286281:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2901, 88 off242232 00000004:00080000:0.0:1746144657.286284:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495149508ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286290:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2902, 88 off242320 00000004:00080000:0.0:1746144657.286294:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 636495159280ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144657.286300:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2823, 88 off235360 00000004:00080000:0.0:1746144657.286303:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 636495168250ns, next at 593480289301ns, rc = 0 00000100:00100000:3.0:1746144657.286328:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:1961:x1830964746550272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1524us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.286335:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5744 00000100:00100000:1.0:1746144657.286831:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746549248:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 17204us (17294us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.286838:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4353 00002000:00100000:1.0:1746144657.286847:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009b32c700 x1830964746549248/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.286854:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32c700 with x1830964746549248 ext(2097152->3145727) 00002000:00010000:1.0:1746144657.286857:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32c700 00000100:00100000:3.0:1746144657.287123:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746548608:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18379us (18686us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.287130:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4352 00002000:00100000:3.0:1746144657.287162:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b32c380 x1830964746548608/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.287170:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32c380 with x1830964746548608 ext(3145728->4194303) 00002000:00010000:3.0:1746144657.287173:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32c380 00000100:00100000:2.0:1746144657.288482:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.288529:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550528 00000100:00100000:2.0:1746144657.288751:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550528 00000100:00100000:2.0:1746144657.288803:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10035 00000100:00100000:2.0:1746144657.288811:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28970:x1830964746550528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.288831:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.288849:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6ce expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.289170:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.289562:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.289575:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.289582:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144657.289585:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 6 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.289591:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabd400, rc 0) 00000100:00100000:2.0:1746144657.289640:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28970:x1830964746550528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 830us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.289646:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10035 00000100:00100000:2.0:1746144657.298642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.298668:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550656 00000100:00100000:0.0:1746144657.298772:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550656 00000100:00100000:0.0:1746144657.298822:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11538 00000100:00100000:0.0:1746144657.298831:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+10:28973:x1830964746550656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144657.298931:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.298950:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6d5 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.298974:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.298976:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.298984:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 11 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.298999:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 11 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.299009:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a503ec00, rc 0) 00000100:00100000:0.0:1746144657.299056:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:28973:x1830964746550656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 226us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.299062:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11538 00000100:00100000:2.0:1746144657.303928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.304597:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550784 00000100:00100000:0.0:1746144657.304606:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550784 00000100:00100000:0.0:1746144657.304645:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10036 00000100:00100000:0.0:1746144657.304652:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:28973:x1830964746550784:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144657.304670:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.304688:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6dc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.304747:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.304762:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.304774:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144657.304776:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144657.304780:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 6 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.304785:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a503ea00, rc 0) 00000100:00100000:0.0:1746144657.304828:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:28973:x1830964746550784:12345-192.168.204.23@tcp:101:cat.0 Request processed in 176us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.304834:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10036 00000001:00080000:1.0:1746144657.318430:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943895 is committed 00000004:00080000:1.0:1746144657.318441:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2009 committed 00000004:00080000:1.0:1746144657.318446:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2084 committed 00000004:00080000:1.0:1746144657.318581:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2083 committed 00000004:00080000:1.0:1746144657.318584:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2082 committed 00000004:00080000:1.0:1746144657.318586:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2081 committed 00000004:00080000:1.0:1746144657.318587:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2008 committed 00000004:00080000:1.0:1746144657.318589:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2080 committed 00000004:00080000:1.0:1746144657.318590:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2007 committed 00000004:00080000:1.0:1746144657.318591:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2079 committed 00000004:00080000:1.0:1746144657.318593:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2006 committed 00000004:00080000:1.0:1746144657.318594:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2005 committed 00000004:00080000:1.0:1746144657.318596:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2004 committed 00000004:00080000:1.0:1746144657.318598:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2078 committed 00000004:00080000:1.0:1746144657.318600:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2077 committed 00000004:00080000:1.0:1746144657.318602:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2003 committed 00000004:00080000:1.0:1746144657.318603:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2002 committed 00000004:00080000:1.0:1746144657.318604:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2076 committed 00000001:00080000:1.0:1746144657.318612:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943894 is committed 00010000:00010000:2.0:1746144657.318776:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318787:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.318790:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746144657.318794:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 6 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318802:0:20319:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 6 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318811:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 6 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318817:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 296 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318823:0:20319:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 296 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318829:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 296 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318835:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318840:0:20319:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318846:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.318867:0:20319:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.318877:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443840:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.318966:0:20319:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 296 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.318978:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c945c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443968:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.319001:0:20319:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 6 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.319007:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747444096:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.319021:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.319121:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747443584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319180:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.319199:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747444480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319213:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.319223:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747444992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319233:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.319246:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746144657.319250:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747443712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.319263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.319272:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747444608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319289:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.319310:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747443584 00000100:00100000:1.0:1746144657.319315:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747443584 00000100:00100000:1.0:1746144657.319341:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444480 00000100:00100000:1.0:1746144657.319343:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444480 00000100:00100000:1.0:1746144657.319352:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444992 00000100:00100000:1.0:1746144657.319354:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444992 00000100:00100000:3.0:1746144657.319356:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747445120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.319362:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747443712 00000100:00100000:1.0:1746144657.319364:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747443712 00000100:00100000:1.0:1746144657.319373:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444608 00000100:00100000:1.0:1746144657.319374:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444608 00000100:00100000:3.0:1746144657.319378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.319394:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747445632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.319409:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144657.319433:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747444224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319509:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445120 00000100:00100000:1.0:1746144657.319512:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445120 00000100:00100000:1.0:1746144657.319525:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445632 00000100:00100000:1.0:1746144657.319526:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445632 00000100:00100000:3.0:1746144657.319527:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746144657.319532:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747445504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.319546:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.319562:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747444352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144657.319566:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445504 00000100:00100000:0.0:1746144657.319575:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445504 00000100:00100000:3.0:1746144657.319576:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.319584:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747444864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144657.319600:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444352 00000100:00100000:0.0:1746144657.319602:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444352 00000100:00100000:3.0:1746144657.319612:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144657.319616:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11539 00000100:00100000:3.0:1746144657.319620:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747445376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144657.319625:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3295:x1830964747443584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144657.319633:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.319639:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747445888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.319649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144657.319678:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444864 00000100:00100000:3.0:1746144657.319682:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444864 00000100:00100000:3.0:1746144657.319707:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445376 00000100:00100000:3.0:1746144657.319709:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445376 00000100:00100000:3.0:1746144657.319715:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445888 00000100:00100000:3.0:1746144657.319716:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445888 00000100:00100000:3.0:1746144657.319723:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11540 00000100:00100000:3.0:1746144657.319729:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830964747444480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319813:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11541 00000100:00100000:2.0:1746144657.319817:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11542 00000100:00100000:1.0:1746144657.319819:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830964747444992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144657.319823:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3295:x1830964747443712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144657.319846:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144657.319850:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:0.0:1746144657.319852:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144657 -> 1746144657 00002000:00010000:0.0:1746144657.319853:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:0.0:1746144657.319855:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746144657.319871:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144657.319875:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144657.319877:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144657.319879:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144657.319881:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144657.319899:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747443584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (718us total) trans 21474840459 rc 0/0 00002000:00010000:2.0:1746144657.319905:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746144657.319906:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747444480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (691us total) trans 21474840460 rc 0/0 00000100:00100000:0.0:1746144657.319906:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11539 00002000:00010000:2.0:1746144657.319908:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144655 -> 1746144655 00002000:00010000:2.0:1746144657.319910:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:2.0:1746144657.319911:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144655 -> 1746144655 00000100:00100000:3.0:1746144657.319912:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11540 00002000:00010000:2.0:1746144657.319913:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746144657.319915:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747444992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (681us total) trans 21474840461 rc 0/0 00000100:00100000:1.0:1746144657.319921:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11541 00000100:00100000:0.0:1746144657.319925:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11543 00000100:00100000:2.0:1746144657.319929:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3295:x1830964747443712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (664us total) trans 17179873217 rc 0/0 00000100:00100000:3.0:1746144657.319930:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11544 00000100:00100000:0.0:1746144657.319931:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3295:x1830964747444608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.319933:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11545 00000100:00100000:2.0:1746144657.319936:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11542 00000100:00100000:3.0:1746144657.319937:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3296:x1830964747445120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.319937:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3296:x1830964747445632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144657.319943:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11546 00000100:00100000:2.0:1746144657.319948:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3296:x1830964747445504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.319949:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11547 00000100:00100000:1.0:1746144657.319966:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3294:x1830964747444352:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144657.320011:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ec700/2, rc 0, transno 17179873217 00000100:00100000:1.0:1746144657.320019:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747443712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144657.320029:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb5180/2, rc 0, transno 21474840459 00000100:00100000:1.0:1746144657.320031:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747443584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144657.320036:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3295:x1830964747444608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (745us total) trans 21474840462 rc 0/0 00000004:00080000:1.0:1746144657.320037:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb7100/2, rc 0, transno 21474840460 00000100:00100000:2.0:1746144657.320038:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3296:x1830964747445504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (490us total) trans 17179873218 rc 0/0 00000100:00100000:1.0:1746144657.320040:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747444480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144657.320043:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11543 00000004:00080000:1.0:1746144657.320045:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb5f80/2, rc 0, transno 21474840461 00000100:00100000:2.0:1746144657.320047:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11546 00000100:00100000:1.0:1746144657.320048:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747444992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144657.320055:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11548 00000004:00080000:1.0:1746144657.320056:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb6a00/2, rc 0, transno 21474840462 00000100:00100000:1.0:1746144657.320058:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747444608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144657.320059:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11549 00000100:00100000:0.0:1746144657.320061:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3294:x1830964747444864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144657.320064:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3294:x1830964747445376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144657.320120:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144657.320123:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.320125:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144656 -> 1746144656 00002000:00010000:1.0:1746144657.320127:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.320129:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746144657.320132:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3294:x1830964747445376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (498us total) trans 17179873219 rc 0/0 00000100:00100000:2.0:1746144657.320163:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11549 00000100:00100000:2.0:1746144657.320172:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11550 00000100:00100000:1.0:1746144657.320176:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747444352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (599us total) trans 21474840463 rc 0/0 00000100:00100000:2.0:1746144657.320177:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3294:x1830964747445888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.320180:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11547 00000100:00100000:0.0:1746144657.320185:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747444864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (571us total) trans 21474840464 rc 0/0 00000100:00100000:0.0:1746144657.320192:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11548 00000100:00100000:2.0:1746144657.320224:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144657.320242:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747444736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144657.320255:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3296:x1830964747445632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (844us total) trans 17179873220 rc 0/0 00000100:00100000:2.0:1746144657.320256:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.320260:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11545 00000100:00100000:2.0:1746144657.320264:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747445248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.320268:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444224 00000100:00100000:1.0:1746144657.320270:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444224 00000100:00100000:2.0:1746144657.320276:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.320280:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747444736 00000100:00100000:1.0:1746144657.320281:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747444736 00000100:00100000:2.0:1746144657.320285:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747445760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.320289:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445248 00000100:00100000:1.0:1746144657.320290:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445248 00000100:00100000:2.0:1746144657.320297:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.320299:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11551 00000100:00100000:1.0:1746144657.320302:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747444224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144657.320312:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747445760 00000100:00100000:2.0:1746144657.320314:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747445760 00000100:00100000:0.0:1746144657.320327:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11552 00000100:00100000:0.0:1746144657.320335:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747444736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144657.320367:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144657.320370:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.320371:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.320373:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:1.0:1746144657.320375:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144657.320396:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3293:x1830964747444224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (171us total) trans 21474840465 rc 0/0 00000100:00100000:0.0:1746144657.320424:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3293:x1830964747444736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (166us total) trans 21474840466 rc 0/0 00000100:00100000:2.0:1746144657.320610:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11553 00000100:00100000:1.0:1746144657.320614:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11551 00000100:00100000:2.0:1746144657.320616:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747445248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.320625:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11554 00000100:00100000:1.0:1746144657.320628:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747445760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746144657.320665:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144657.320668:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:3.0:1746144657.320670:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:3.0:1746144657.320672:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:3.0:1746144657.320673:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746144657.320686:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:2.0:1746144657.320689:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144657 -> 1746144657 00002000:00010000:2.0:1746144657.320690:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144656 -> 1746144656 00002000:00010000:2.0:1746144657.320692:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144657 -> 1746144657 00002000:00010000:2.0:1746144657.320693:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5611 00000100:00100000:3.0:1746144657.320694:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3296:x1830964747445120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 759us (1315us total) trans 17179873221 rc 0/0 00000100:00100000:3.0:1746144657.320699:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11544 00000100:00100000:1.0:1746144657.320699:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3293:x1830964747445760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (400us total) trans 17179873222 rc 0/0 00000100:00100000:1.0:1746144657.320704:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11554 00000100:00100000:2.0:1746144657.320706:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3293:x1830964747445248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (430us total) trans 17179873223 rc 0/0 00000100:00100000:2.0:1746144657.320710:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11553 00000004:00080000:3.0:1746144657.320726:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb4380/2, rc 0, transno 21474840463 00000004:00080000:2.0:1746144657.320728:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb4700/2, rc 0, transno 21474840465 00000100:00100000:3.0:1746144657.320730:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747444352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144657.320731:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747444224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144657.320738:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb5500/2, rc 0, transno 21474840464 00000004:00080000:2.0:1746144657.320739:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb7800/2, rc 0, transno 21474840466 00000100:00100000:3.0:1746144657.320741:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747444864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144657.320742:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747444736:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144657.320747:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b811880/2, rc 0, transno 17179873219 00000004:00080000:2.0:1746144657.320749:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b813800/2, rc 0, transno 17179873223 00000100:00100000:3.0:1746144657.320750:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747445376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144657.320752:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747445248:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144657.320757:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebf100/2, rc 0, transno 17179873222 00000100:00100000:2.0:1746144657.320760:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747445760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.320765:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b813b80/2, rc 0, transno 17179873218 00000100:00100000:3.0:1746144657.320767:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747445504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.320771:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3294:x1830964747445888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 594us (1120us total) trans 17179873224 rc 0/0 00000004:00080000:3.0:1746144657.320772:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b813480/2, rc 0, transno 17179873221 00000100:00100000:3.0:1746144657.320775:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747445120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.320775:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11550 00000004:00080000:3.0:1746144657.320781:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebd500/2, rc 0, transno 17179873220 00000100:00100000:3.0:1746144657.320784:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747445632:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144657.320795:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebed80/2, rc 0, transno 17179873224 00000100:00100000:3.0:1746144657.320887:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747445888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.320927:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746144657.320933:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747446016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144657.320951:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144657.321012:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747446016 00000100:00100000:1.0:1746144657.321015:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747446016 00000100:00100000:1.0:1746144657.321041:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11555 00000100:00100000:1.0:1746144657.321045:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747446016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144657.321121:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3296:x1830964747446016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (168us total) trans 17179873225 rc 0/0 00000100:00100000:1.0:1746144657.321126:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11555 00000004:00080000:3.0:1746144657.321128:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebc380/2, rc 0, transno 17179873225 00000100:00100000:3.0:1746144657.321146:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747446016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144657.322261:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11552 00000100:00100000:3.0:1746144657.322275:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443840:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.322281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.322283:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c945c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747443968:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.322298:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746550912 00000100:00100000:2.0:1746144657.322301:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746550912 00000100:00100000:2.0:1746144657.322319:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4029 00000100:00100000:2.0:1746144657.322324:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28970:x1830964746550912:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144657.322400:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28970:x1830964746550912:12345-192.168.204.23@tcp:49:cat.0 Request processed in 75us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.322406:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4029 00000100:00100000:2.0:1746144657.322708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.322728:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746551040 00000100:00100000:2.0:1746144657.322731:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.322734:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746551040 00000100:00100000:0.0:1746144657.322760:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746551168 00000100:00100000:0.0:1746144657.322761:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746551168 00000100:00100000:2.0:1746144657.322768:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4030 00000100:00100000:2.0:1746144657.322775:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:28973:x1830964746551040:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:0.0:1746144657.322781:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4031 00000100:00100000:0.0:1746144657.322786:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746551168:12345-192.168.204.23@tcp:49:mirror_io.0 00000100:00100000:2.0:1746144657.322819:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:28973:x1830964746551040:12345-192.168.204.23@tcp:49:cat.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.322824:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4030 00000100:00100000:0.0:1746144657.322866:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746551168:12345-192.168.204.23@tcp:49:mirror_io.0 Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.322873:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4031 00000100:00100000:3.0:1746144657.327208:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747444096:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144657.327255:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e255200/0xa7c849b16e019890 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 9 pid: 20319 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746144657.327275:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.327304:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e254e00, rc 0) 00000100:00100000:3.0:1746144657.327363:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:28976:x1830964746548992:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 57623us (57927us total) trans 8589943895 rc 0/0 00000100:00100000:3.0:1746144657.327370:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10033 00000100:00100000:0.0:1746144657.329750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.330005:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746551424 00000100:00100000:3.0:1746144657.330015:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746551424 00002000:00100000:3.0:1746144657.330072:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b32f100 x1830964746551424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.330081:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32f100 with x1830964746551424 ext(3145728->4194303) 00002000:00010000:3.0:1746144657.330087:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32f100 00000100:00100000:3.0:1746144657.330496:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4354 00000100:00100000:3.0:1746144657.330506:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746551424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.334991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.335202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.335230:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746551680 00000100:00100000:2.0:1746144657.335239:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746551680 00002000:00100000:2.0:1746144657.335286:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb47100 x1830964746551680/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.335295:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb47100 with x1830964746551680 ext(2097152->3145727) 00002000:00010000:2.0:1746144657.335301:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb47100 00000100:00100000:2.0:1746144657.335317:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746551936 00000100:00100000:2.0:1746144657.335319:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746551936 00002000:00100000:2.0:1746144657.335331:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee09180 x1830964746551936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.335337:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09180 with x1830964746551936 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.335339:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee09180 00000100:00100000:2.0:1746144657.335377:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4355 00000100:00100000:2.0:1746144657.335384:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746551680:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144657.335397:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4356 00000100:00100000:1.0:1746144657.335405:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746551936:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144657.344522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.344849:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746552192 00000100:00100000:3.0:1746144657.344858:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746552192 00002000:00100000:3.0:1746144657.344907:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd90700 x1830964746552192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.344917:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90700 with x1830964746552192 ext(3145728->4194303) 00002000:00010000:3.0:1746144657.344923:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd90700 00000100:00100000:2.0:1746144657.345777:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746551424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15270us (16033us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.345786:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4354 00002000:00100000:2.0:1746144657.345793:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b32f100 x1830964746551424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.345801:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32f100 with x1830964746551424 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.345805:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32f100 00000100:00100000:2.0:1746144657.345824:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4357 00000100:00100000:2.0:1746144657.345833:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746552192:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144657.350606:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746551936:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 15192us (15395us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144657.355283:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4356 00002000:00100000:0.0:1746144657.355305:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee09180 x1830964746551936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.355316:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09180 with x1830964746551936 ext(3145728->4194303) 00002000:00010000:0.0:1746144657.355322:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee09180 00000100:00100000:3.0:1746144657.356634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.356664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.356678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.356689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.356708:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746552320 00000100:00100000:3.0:1746144657.356715:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746552320 00000100:00100000:3.0:1746144657.356757:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746552448 00000100:00100000:3.0:1746144657.356759:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746552448 00000100:00100000:3.0:1746144657.356768:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746552704 00000100:00100000:3.0:1746144657.356769:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746552704 00000100:00100000:3.0:1746144657.356777:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746552576 00000100:00100000:3.0:1746144657.356779:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746552576 00000100:00100000:3.0:1746144657.356790:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11556 00000100:00100000:3.0:1746144657.356797:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746552320:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.356814:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.356831:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6e3 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.356852:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.356854:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.356863:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.356879:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.356890:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7ebe00, rc 0) 00000100:00100000:3.0:1746144657.356929:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746552320:12345-192.168.204.23@tcp:101:cat.0 Request processed in 133us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.356934:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11556 00000100:00100000:3.0:1746144657.356943:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11557 00000100:00100000:3.0:1746144657.356949:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746552448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.356956:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.356965:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6ea expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.356975:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.356976:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.356980:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 22 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.356988:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 22 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.356995:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7eba00, rc 0) 00000100:00100000:3.0:1746144657.357008:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746552448:12345-192.168.204.23@tcp:101:cat.0 Request processed in 61us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.357014:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11557 00000100:00100000:3.0:1746144657.357022:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11558 00000100:00100000:3.0:1746144657.357027:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746552704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.357032:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.357038:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6f8 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.357047:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.357048:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.357052:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.357064:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 27 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.357071:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7eac00, rc 0) 00000100:00100000:3.0:1746144657.357083:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746552704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 58us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.357088:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11558 00000100:00100000:3.0:1746144657.357096:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11559 00000100:00100000:3.0:1746144657.357101:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746552576:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.357106:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.357112:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6f1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.357121:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.357122:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144657.357123:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746551680:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 21738us (22141us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746144657.357126:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 22 pid: 8389 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144657.357131:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4355 00010000:00010000:3.0:1746144657.357158:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 22 pid: 8389 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746144657.357161:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb47100 x1830964746551680/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746144657.357166:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7eb800, rc 0) 00002000:00100000:2.0:1746144657.357169:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb47100 with x1830964746551680 ext(2097152->3145727) 00002000:00010000:2.0:1746144657.357173:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb47100 00000100:00100000:3.0:1746144657.357181:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746552576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 81us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.357186:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11559 00000100:00100000:2.0:1746144657.358512:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746552192:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 12677us (13997us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.358520:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4357 00002000:00100000:2.0:1746144657.358527:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd90700 x1830964746552192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.358535:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90700 with x1830964746552192 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.358539:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd90700 00000100:00100000:0.0:1746144657.361540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.361601:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746552832 00000100:00100000:2.0:1746144657.361610:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746552832 00000100:00100000:2.0:1746144657.361664:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11560 00000100:00100000:2.0:1746144657.361671:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:28976:x1830964746552832:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144657.361689:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.361707:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e6ff expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.361733:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.361741:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 12 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.361749:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.361755:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.361756:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.361760:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3936256->4194303] (req 3936256->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.361789:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.361799:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 7 pid: 10724 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.361809:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747446144:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.362190:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.362284:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553088 00000100:00100000:3.0:1746144657.362289:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553088 00002000:00100000:3.0:1746144657.362328:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b32dc00 x1830964746553088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.362338:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32dc00 with x1830964746553088 ext(4194304->4935679) 00002000:00010000:3.0:1746144657.362342:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32dc00 00000100:00100000:3.0:1746144657.362356:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4358 00000100:00100000:3.0:1746144657.362362:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746553088:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:2.0:1746144657.362560:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 12 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.362569:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 12 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.362577:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747446272:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.363071:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.363086:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 21 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.363094:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747446400:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.363127:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.368366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.368400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.368516:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553216 00000100:00100000:3.0:1746144657.368526:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553216 00010000:00010000:3.0:1746144657.368576:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144657.368605:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5745 00000100:00100000:3.0:1746144657.368612:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746553216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.368626:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.368650:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.368662:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.368689:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144657.368697:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e0198b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c0 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00000100:00100000:3.0:1746144657.368759:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746553216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.368766:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5745 00000100:00100000:0.0:1746144657.368873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.369007:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747446144:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.369176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.369441:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747446272:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.369450:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747446400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.369479:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3936256->4194303] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.369491:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53be800, rc 0) 00000100:00100000:3.0:1746144657.369516:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:28976:x1830964746552832:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7846us (7988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.369523:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11560 00000100:00100000:2.0:1746144657.369636:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553344 00000100:00100000:2.0:1746144657.369640:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553344 00000100:00100000:2.0:1746144657.369669:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553472 00000100:00100000:2.0:1746144657.369671:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553472 00000100:00100000:2.0:1746144657.369682:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553600 00000100:00100000:2.0:1746144657.369684:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553600 00000100:00100000:0.0:1746144657.369693:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11561 00000100:00100000:0.0:1746144657.369700:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746553344:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144657.369701:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11562 00000100:00100000:2.0:1746144657.369706:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746553472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.369715:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.369715:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.369726:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e70d expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.369726:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e706 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.369740:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.369740:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.369742:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144657.369742:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.369749:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 14 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144657.369749:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144657.369761:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.369765:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 14 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144657.369768:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a4a00, rc 0) 00010000:00010000:2.0:1746144657.369773:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b20de00, rc 0) 00000100:00100000:0.0:1746144657.369783:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746553344:12345-192.168.204.23@tcp:101:cat.0 Request processed in 85us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.369788:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11561 00000100:00100000:2.0:1746144657.369790:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746553472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 84us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.369795:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11562 00000100:00100000:0.0:1746144657.369798:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11563 00000100:00100000:0.0:1746144657.369802:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746553600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144657.369807:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.369813:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e714 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.370531:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.370533:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.370538:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.370548:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.370555:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136916a00, rc 0) 00000100:00100000:1.0:1746144657.370588:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746553600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 784us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.370594:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11563 00000100:00100000:1.0:1746144657.370927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.370953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.370966:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553856 00000100:00100000:3.0:1746144657.370971:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553856 00010000:00010000:3.0:1746144657.370996:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 22 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.371022:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746553728 00000100:00100000:3.0:1746144657.371024:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746553728 00010000:00010000:3.0:1746144657.371035:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 14 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.371050:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5746 00000100:00100000:3.0:1746144657.371056:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746553856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.371065:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.371089:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 22 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.371098:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 22 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.371114:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f107400/0xa7c849b16e01980b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e657 expref: 22 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.371163:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.371170:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5747 00000100:00100000:2.0:1746144657.371179:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746553728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144657.371181:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746553856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 126us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.371186:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5746 00010000:00010000:2.0:1746144657.371187:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.371197:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 14 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.371207:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 14 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.371219:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a503ec00/0xa7c849b16e0198d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6d5 expref: 14 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.371228:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.371229:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.371234:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.371241:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.371267:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.371279:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747446528:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.371330:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.371788:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746553088:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9426us (9597us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144657.371796:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4358 00002000:00100000:3.0:1746144657.371806:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b32dc00 x1830964746553088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.371815:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32dc00 with x1830964746553088 ext(4194304->4935679) 00002000:00010000:3.0:1746144657.371820:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32dc00 00000100:00100000:0.0:1746144657.378016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.378216:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746554112 00000100:00100000:3.0:1746144657.378229:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746554112 00002000:00100000:3.0:1746144657.378301:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012cef9180 x1830964746554112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.378312:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9180 with x1830964746554112 ext(4194304->4935679) 00002000:00010000:3.0:1746144657.378318:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef9180 00000100:00100000:3.0:1746144657.378372:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4359 00000100:00100000:3.0:1746144657.378386:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746554112:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.380199:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747446528:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144657.380221:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144657.380252:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746553728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9074us (9296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.380261:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5747 00000100:00100000:0.0:1746144657.382535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.382587:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746554240 00000100:00100000:1.0:1746144657.382596:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746554240 00000100:00100000:1.0:1746144657.382651:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11564 00000100:00100000:1.0:1746144657.382659:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746554240:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144657.382678:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.382696:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01991c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e71b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144657.382761:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747446656:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144657.382852:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.388913:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746554112:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10520us (10898us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144657.388926:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4359 00002000:00100000:3.0:1746144657.388940:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012cef9180 x1830964746554112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.388949:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9180 with x1830964746554112 ext(4194304->4935679) 00002000:00010000:3.0:1746144657.388955:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef9180 00002000:00010000:1.0:1746144657.389318:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144657 -> 1746144658 00002000:00010000:1.0:1746144657.389322:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144656 -> 1746144658 00002000:00010000:1.0:1746144657.389324:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144657 -> 1746144658 00000100:00100000:1.0:1746144657.389345:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747446656:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144657.389382:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01991c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e71b expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.389395:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01991c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e71b expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.389501:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1200, rc 0) 00000100:00100000:1.0:1746144657.389625:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746554240:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6965us (7097us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144657.389632:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11564 00000100:00100000:0.0:1746144657.393683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.393787:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746554368 00000100:00100000:1.0:1746144657.393797:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746554368 00000100:00100000:1.0:1746144657.393904:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11565 00000100:00100000:1.0:1746144657.393914:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:28976:x1830964746554368:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144657.393933:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.393951:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e722 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.393983:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.393992:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.393998:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.394004:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.394006:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.394010:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->4259839] (req 4194304->4259839) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144657.394184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.394258:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746554496 00000100:00100000:3.0:1746144657.394263:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746554496 00000100:00100000:3.0:1746144657.394301:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11566 00000100:00100000:3.0:1746144657.394307:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746554496:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.394315:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.394325:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea600/0xa7c849b16e01992a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e729 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.394370:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747446784:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144657.394442:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7780 going to sleep for 11 seconds 00010000:00010000:1.0:1746144657.394678:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.394691:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 17 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.394700:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747446912:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.395429:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.395439:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 7 pid: 10724 timeout: 736 lvb_type: 1 00000100:00100000:1.0:1746144657.395446:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747447040:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.395479:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.395486:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 26 pid: 4760 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.395493:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747447168:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.395509:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.399430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.399558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.399736:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747446784:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144657.399781:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea600/0xa7c849b16e01992a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e729 expref: 22 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.399797:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea600/0xa7c849b16e01992a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e729 expref: 22 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.399814:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7ea600, rc 0) 00000100:00100000:3.0:1746144657.399860:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746554752 00000100:00100000:3.0:1746144657.399867:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746554752 00000100:00100000:3.0:1746144657.399913:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4032 00000100:00100000:3.0:1746144657.399921:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:28973:x1830964746554752:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144657.400066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.400082:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746554880 00000100:00100000:0.0:1746144657.400085:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746554880 00010000:00010000:0.0:1746144657.400103:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746144657.400129:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746555008 00000100:00100000:0.0:1746144657.400131:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746555008 00010000:00010000:0.0:1746144657.400180:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 18 pid: 8389 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.400197:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5748 00000100:00100000:0.0:1746144657.400202:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746554880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144657.400214:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747446912:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.400215:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144657.400221:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747447040:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.400226:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747447168:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144657.400230:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.400239:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.400298:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5749 00000100:00100000:2.0:1746144657.400306:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746555008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.400313:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144657.400624:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [4194304->4259839] (req 4194304->4259839) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.400631:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 18 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.400640:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 18 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.400652:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a4e00/0xa7c849b16e019889 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e68f expref: 18 pid: 8389 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.400655:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c0200, rc 0) 00010000:00010000:2.0:1746144657.400667:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.400686:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746555008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 383us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.400688:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:28976:x1830964746554368:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6775us (7015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.400693:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5749 00000100:00100000:1.0:1746144657.400695:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11565 00000100:00100000:2.0:1746144657.400719:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746554496:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6413us (6536us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.400724:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11566 00010000:00010000:0.0:1746144657.400930:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a5600/0xa7c849b16e0198c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b9 expref: 8 pid: 10724 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.400950:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144657.400967:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746554880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 765us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.400974:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5748 00000100:00100000:3.0:1746144657.401043:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:28973:x1830964746554752:12345-192.168.204.23@tcp:35:cat.0 Request processed in 1122us (1622us total) trans 8589943896 rc 0/0 00000100:00100000:3.0:1746144657.401049:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4032 00000100:00100000:0.0:1746144657.404561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.404650:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746555136 00000100:00100000:2.0:1746144657.404659:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746555136 00010000:00010000:2.0:1746144657.404695:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 27 pid: 4760 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.404728:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5750 00000100:00100000:2.0:1746144657.404735:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746555136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.404750:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.404773:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 27 pid: 4760 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.404785:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 27 pid: 4760 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.404806:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee26a00/0xa7c849b16e019804 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e650 expref: 27 pid: 4760 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.404819:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.404822:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.404829:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.404837:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.404869:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.404882:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747447296:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.405006:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.406253:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747447296:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.406270:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.406300:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746555136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1565us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.406308:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5750 00000100:00100000:0.0:1746144657.409230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.409303:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746555392 00000100:00100000:3.0:1746144657.409314:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746555392 00002000:00100000:3.0:1746144657.409378:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4255744->4259839) req@ffff88012cefb480 x1830964746555392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.409388:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb480 with x1830964746555392 ext(4255744->4259839) 00002000:00010000:3.0:1746144657.409394:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefb480 00000100:00100000:3.0:1746144657.409427:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4360 00000100:00100000:3.0:1746144657.409437:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746555392:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.410194:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746555392:12345-192.168.204.23@tcp:3:cat.0 Request processed in 757us (972us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144657.410201:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4360 00002000:00100000:3.0:1746144657.410207:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4255744->4259839) req@ffff88012cefb480 x1830964746555392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.410215:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb480 with x1830964746555392 ext(4255744->4259839) 00002000:00010000:3.0:1746144657.410218:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefb480 00000100:00100000:0.0:1746144657.414325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.414538:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746555648 00000100:00100000:3.0:1746144657.414549:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746555648 00000100:00100000:3.0:1746144657.414668:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4033 00000100:00100000:3.0:1746144657.414679:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:28976:x1830964746555648:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144657.415572:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+10:28976:x1830964746555648:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 892us (1255us total) trans 8589943897 rc 0/0 00000100:00100000:3.0:1746144657.415583:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4033 00000100:00100000:0.0:1746144657.416592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.416657:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746555776 00000100:00100000:1.0:1746144657.416665:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746555776 00000100:00100000:1.0:1746144657.416916:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11567 00000100:00100000:1.0:1746144657.416923:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:28978:x1830964746555776:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144657.416940:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.416960:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e730 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.416988:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.416996:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144657.416998:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144657.417001:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4124672->4194303] (req 4124672->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.417029:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.417040:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 15 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.417057:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747447424:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.417315:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.418453:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747447424:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.418479:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4124672->4194303] (req 4124672->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.418495:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2de800, rc 0) 00000100:00100000:1.0:1746144657.418525:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:28978:x1830964746555776:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1602us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.418532:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11567 00000100:00100000:0.0:1746144657.419085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.419473:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746555904 00000100:00100000:3.0:1746144657.419478:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746555904 00002000:00100000:3.0:1746144657.419568:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4259839) req@ffff88009f01c700 x1830964746555904/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.419578:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01c700 with x1830964746555904 ext(4194304->4259839) 00010000:00010000:3.0:1746144657.419585:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.419596:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:3.0:1746144657.419603:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f01c700 00000100:00100000:3.0:1746144657.419633:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 836 00000100:00100000:3.0:1746144657.419641:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746555904:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144657.422042:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746555904:12345-192.168.204.23@tcp:4:cat.0 Request processed in 2393us (2948us total) trans 17179873226 rc 0/0 00000100:00100000:3.0:1746144657.422052:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 836 00002000:00100000:3.0:1746144657.422063:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4259839) req@ffff88009f01c700 x1830964746555904/t17179873226(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.422073:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01c700 with x1830964746555904 ext(4194304->4259839) 00010000:00010000:3.0:1746144657.422085:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.422103:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:3.0:1746144657.422109:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f01c700 00000100:00100000:0.0:1746144657.423542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.423599:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746556032 00000100:00100000:2.0:1746144657.423608:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746556032 00010000:00010000:2.0:1746144657.423644:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.423682:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5751 00000100:00100000:2.0:1746144657.423690:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746556032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.423704:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144657.423721:0:7309:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144657 -> 1746144658 00002000:00010000:2.0:1746144657.423724:0:7309:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144657 -> 1746144658 00010000:00010000:2.0:1746144657.423729:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.423740:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.423762:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c0200/0xa7c849b16e019923 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e722 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.423800:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.423802:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.423810:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.424261:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.424300:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.424312:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747447552:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.424393:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.426642:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747447552:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144657.426655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144657.426664:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.426714:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746556032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3024us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.426723:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5751 00000100:00100000:3.0:1746144657.426727:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746556288 00000100:00100000:3.0:1746144657.426733:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746556288 00002000:00100000:3.0:1746144657.427181:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4124672->4128767) req@ffff88013129ca80 x1830964746556288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.427191:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ca80 with x1830964746556288 ext(4124672->4128767) 00002000:00010000:3.0:1746144657.427195:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013129ca80 00000100:00100000:3.0:1746144657.427901:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4361 00000100:00100000:3.0:1746144657.427916:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746556288:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144657.428095:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746556288:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 186us (1441us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144657.428101:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4361 00002000:00100000:3.0:1746144657.428106:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4124672->4128767) req@ffff88013129ca80 x1830964746556288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.428113:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ca80 with x1830964746556288 ext(4124672->4128767) 00002000:00010000:3.0:1746144657.428116:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013129ca80 00000100:00100000:0.0:1746144657.432256:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.432703:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746556416 00000100:00100000:1.0:1746144657.432714:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746556416 00000100:00100000:1.0:1746144657.432769:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11568 00000100:00100000:1.0:1746144657.432777:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:28978:x1830964746556416:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144657.432797:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.432816:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e737 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.432848:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.432856:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144657.432858:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144657.432862:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4050943] (req 3145728->4050943) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.432897:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.432910:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 12 pid: 4758 timeout: 736 lvb_type: 0 00000100:00100000:1.0:1746144657.432921:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747447680:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144657.433013:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.435569:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747447680:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144657.435601:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4050943] (req 3145728->4050943) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144657.435603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144657.435618:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1400, rc 0) 00000100:00100000:2.0:1746144657.435651:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746556544 00000100:00100000:2.0:1746144657.435658:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746556544 00000100:00100000:1.0:1746144657.435662:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:28978:x1830964746556416:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2886us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.435671:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11568 00002000:00100000:2.0:1746144657.435700:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3936256->4194303) req@ffff88013129f800 x1830964746556544/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.435708:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129f800 with x1830964746556544 ext(3936256->4194303) 00010000:00010000:2.0:1746144657.435715:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 13 pid: 4758 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.435728:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 13 pid: 4758 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.435734:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013129f800 00000100:00100000:2.0:1746144657.435763:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 837 00000100:00100000:2.0:1746144657.435770:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746556544:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144657.440389:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746556544:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4608us (4775us total) trans 21474840467 rc 0/0 00000100:00100000:2.0:1746144657.440401:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 837 00002000:00100000:2.0:1746144657.440412:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3936256->4194303) req@ffff88013129f800 x1830964746556544/t21474840467(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.440420:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129f800 with x1830964746556544 ext(3936256->4194303) 00010000:00010000:2.0:1746144657.440430:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 15 pid: 4758 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.440446:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 15 pid: 4758 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.440459:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013129f800 00000100:00100000:0.0:1746144657.443895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.444214:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746556672 00000100:00100000:2.0:1746144657.444225:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746556672 00010000:00010000:2.0:1746144657.444278:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 15 pid: 4758 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.444317:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5752 00000100:00100000:2.0:1746144657.444325:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746556672:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.444343:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.444373:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 15 pid: 4758 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.444385:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 15 pid: 4758 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.444410:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e019900 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ff expref: 15 pid: 4758 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.444445:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.444448:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.444457:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.444466:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.444510:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.444521:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747447808:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.444618:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.448739:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747447808:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.448765:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.448827:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746556672:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4500us (4941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.448837:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5752 00000100:00100000:0.0:1746144657.458451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.458519:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746556928 00000100:00100000:2.0:1746144657.458530:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746556928 00002000:00100000:2.0:1746144657.458583:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (4046848->4050943) req@ffff88013129f100 x1830964746556928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.458597:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129f100 with x1830964746556928 ext(4046848->4050943) 00002000:00010000:2.0:1746144657.458603:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129f100 00000100:00100000:2.0:1746144657.459442:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4362 00000100:00100000:2.0:1746144657.459453:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746556928:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144657.459640:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746556928:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 189us (1200us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144657.459647:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4362 00002000:00100000:2.0:1746144657.459652:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (4046848->4050943) req@ffff88013129f100 x1830964746556928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.459665:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129f100 with x1830964746556928 ext(4046848->4050943) 00002000:00010000:2.0:1746144657.459669:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129f100 00000100:00100000:0.0:1746144657.464370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.464434:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746557184 00000100:00100000:3.0:1746144657.464444:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746557184 00000100:00100000:3.0:1746144657.464520:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4034 00000100:00100000:3.0:1746144657.464530:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:28978:x1830964746557184:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144657.464775:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28978:x1830964746557184:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 247us (416us total) trans 8589943898 rc 0/0 00000100:00100000:3.0:1746144657.464782:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4034 00000100:00100000:0.0:1746144657.527944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.528051:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746557440 00000100:00100000:3.0:1746144657.528061:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746557440 00000100:00100000:3.0:1746144657.528198:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10037 00000100:00100000:3.0:1746144657.528209:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:28985:x1830964746557440:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.528235:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.528256:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffff800/0xa7c849b16e01993f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e73e expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.528374:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528387:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528399:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528414:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528419:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528424:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528527:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528539:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528544:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144657.528553:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144657.528632:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528639:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528644:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528650:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db96e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.528653:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528659:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528670:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.528673:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144657.528677:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528682:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e019954 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528715:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528728:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528732:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528736:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f89800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.528738:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528743:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528749:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144657.528824:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.528828:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528833:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528841:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528845:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528850:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528853:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f89a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.528854:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528862:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528868:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639900) 00010000:00010000:3.0:1746144657.528870:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.528872:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528876:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89a00/0xa7c849b16e01994d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.528907:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffff800/0xa7c849b16e01993f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e73e expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.528912:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffff800/0xa7c849b16e01993f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e73e expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.528916:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffff800, rc 0) 00000100:00100000:3.0:1746144657.528964:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:28985:x1830964746557440:12345-192.168.204.23@tcp:101:cat.0 Request processed in 758us (1032us total) trans 8589943899 rc 301/301 00000100:00100000:3.0:1746144657.528970:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10037 00000100:00100000:2.0:1746144657.532188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.532287:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746557568 00000100:00100000:3.0:1746144657.532295:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746557568 00000100:00100000:3.0:1746144657.532491:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10038 00000100:00100000:3.0:1746144657.532501:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:28985:x1830964746557568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.532526:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.532545:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e019962 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e745 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.532629:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.532640:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.532649:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144657.532672:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144657.532676:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144657.533251:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.533276:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e019962 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.533289:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.533296:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.533299:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144657.533302:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273200, rc 0) 00000100:00100000:3.0:1746144657.533730:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:28985:x1830964746557568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1230us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.533737:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10038 00000100:00100000:0.0:1746144657.537400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.537479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.537633:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746557696 00000100:00100000:1.0:1746144657.537642:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746557696 00000100:00100000:3.0:1746144657.537672:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746557824 00000100:00100000:3.0:1746144657.537675:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746557824 00000100:00100000:1.0:1746144657.537696:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11569 00000100:00100000:1.0:1746144657.537703:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746557696:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144657.537714:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11570 00000100:00100000:3.0:1746144657.537719:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746557824:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144657.537721:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.537730:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.537738:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e019970 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e74c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.537740:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019977 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e753 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.537787:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747447936:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144657.537791:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747448064:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144657.537964:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.538318:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746144657.540651:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144656 -> 1746144658 00000100:00100000:1.0:1746144657.540681:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747448064:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144657.540686:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747447936:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144657.540710:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e019970 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e74c expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.540713:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019977 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e753 expref: 15 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.540723:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e019977 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e753 expref: 15 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.540723:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e019970 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e74c expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.540748:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273600, rc 0) 00010000:00010000:1.0:1746144657.540750:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1000, rc 0) 00000100:00100000:1.0:1746144657.540782:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746557696:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3079us (3390us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144657.540789:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11569 00000100:00100000:3.0:1746144657.541243:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746557824:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3522us (3762us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144657.541249:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11570 00000100:00100000:0.0:1746144657.550683:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.551031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.551119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.551417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.552249:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746558336 00000100:00100000:2.0:1746144657.552259:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746558336 00002000:00100000:2.0:1746144657.552311:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f168700 x1830964746558336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.552321:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168700 with x1830964746558336 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.552327:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168700 00000100:00100000:2.0:1746144657.552345:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746558208 00000100:00100000:2.0:1746144657.552348:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746558208 00002000:00100000:2.0:1746144657.552357:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f16a680 x1830964746558208/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.552363:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a680 with x1830964746558208 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.552366:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16a680 00000100:00100000:2.0:1746144657.552379:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746558592 00000100:00100000:2.0:1746144657.552381:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746558592 00002000:00100000:2.0:1746144657.552396:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f169880 x1830964746558592/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.552402:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169880 with x1830964746558592 ext(0->1048575) 00002000:00010000:2.0:1746144657.552405:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f169880 00000100:00100000:3.0:1746144657.552513:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746558720 00000100:00100000:3.0:1746144657.552517:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746558720 00002000:00100000:3.0:1746144657.552552:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f16bb80 x1830964746558720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.552558:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16bb80 with x1830964746558720 ext(1048576->2097151) 00002000:00010000:3.0:1746144657.552561:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16bb80 00000100:00100000:2.0:1746144657.552628:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4363 00000100:00100000:2.0:1746144657.552636:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746558336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.553057:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4364 00000100:00100000:0.0:1746144657.553065:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746558208:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.553310:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4365 00000100:00100000:0.0:1746144657.553316:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746558592:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144657.553443:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4366 00000100:00100000:1.0:1746144657.553454:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746558720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144657.570057:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746558592:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16727us (18923us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.570071:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4365 00002000:00100000:2.0:1746144657.570085:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f169880 x1830964746558592/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.570095:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169880 with x1830964746558592 ext(0->1048575) 00002000:00010000:2.0:1746144657.570102:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f169880 00000100:00100000:2.0:1746144657.579601:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746558720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26138us (28171us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.579613:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4366 00002000:00100000:2.0:1746144657.579625:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f16bb80 x1830964746558720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.579636:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16bb80 with x1830964746558720 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.579641:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16bb80 00000100:00100000:3.0:1746144657.580209:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746558336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27572us (29534us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.580220:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4363 00002000:00100000:3.0:1746144657.580226:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f168700 x1830964746558336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.580233:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168700 with x1830964746558336 ext(1048576->2097151) 00002000:00010000:3.0:1746144657.580237:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168700 00000100:00100000:1.0:1746144657.585868:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746558208:12345-192.168.204.23@tcp:3:cat.0 Request processed in 32792us (34825us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.585881:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4364 00002000:00100000:1.0:1746144657.585894:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f16a680 x1830964746558208/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.585903:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a680 with x1830964746558208 ext(1048576->2097151) 00002000:00010000:1.0:1746144657.585908:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16a680 00000100:00100000:0.0:1746144657.598505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.598627:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746558976 00000100:00100000:3.0:1746144657.598637:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746558976 00000100:00100000:3.0:1746144657.598706:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11571 00000100:00100000:3.0:1746144657.598715:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746558976:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.598802:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.598821:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4273800/0xa7c849b16e01997e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e75a expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.598873:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747448192:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144657.599339:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.600560:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747448192:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144657.600589:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273800/0xa7c849b16e01997e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e75a expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.600601:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273800/0xa7c849b16e01997e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e75a expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.601101:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273800, rc 0) 00000100:00100000:3.0:1746144657.601309:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746558976:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2594us (2813us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144657.601318:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11571 00000100:00100000:2.0:1746144657.601829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.601885:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746559104 00000100:00100000:3.0:1746144657.601892:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746559104 00000100:00100000:3.0:1746144657.602071:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11572 00000100:00100000:3.0:1746144657.602081:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746559104:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.602096:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.602110:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019985 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e761 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.602184:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747448320:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144657.602248:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.604778:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747448320:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144657.604815:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019985 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e761 expref: 15 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.604828:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273c00/0xa7c849b16e019985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e761 expref: 15 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144657.604850:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273c00, rc 0) 00000100:00100000:3.0:1746144657.604887:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746559104:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2808us (3058us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144657.604895:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11572 00000100:00100000:0.0:1746144657.606668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.606749:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746559232 00000100:00100000:3.0:1746144657.606756:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746559232 00000100:00100000:3.0:1746144657.606801:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11573 00000100:00100000:3.0:1746144657.606809:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:28985:x1830964746559232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.606825:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.606841:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e768 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.606868:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.606875:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.606877:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.606880:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.606910:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.606922:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 26 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.606933:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747448448:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.607010:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.609906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.610097:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747448448:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144657.610174:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.610192:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffff800, rc 0) 00000100:00100000:3.0:1746144657.610237:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:28985:x1830964746559232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3427us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.610245:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11573 00000100:00100000:1.0:1746144657.610325:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746559360 00000100:00100000:1.0:1746144657.610332:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746559360 00002000:00100000:1.0:1746144657.610374:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4124672->4194303) req@ffff88009f16b800 x1830964746559360/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.610384:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16b800 with x1830964746559360 ext(4124672->4194303) 00010000:00010000:1.0:1746144657.610391:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 27 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.610403:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 27 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.610409:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f16b800 00000100:00100000:1.0:1746144657.610426:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 838 00000100:00100000:1.0:1746144657.610433:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746559360:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144657.616591:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746559360:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 6146us (6680us total) trans 17179873227 rc 0/0 00000100:00100000:1.0:1746144657.616606:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 838 00002000:00100000:1.0:1746144657.616619:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4124672->4194303) req@ffff88009f16b800 x1830964746559360/t17179873227(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.616630:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16b800 with x1830964746559360 ext(4124672->4194303) 00010000:00010000:1.0:1746144657.616640:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 29 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.616658:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 29 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.616672:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f16b800 00000100:00100000:0.0:1746144657.618473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.618566:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746559488 00000100:00100000:2.0:1746144657.618575:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746559488 00010000:00010000:2.0:1746144657.618613:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 29 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.618640:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5753 00000100:00100000:2.0:1746144657.618647:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746559488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.618662:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.618684:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 29 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.618701:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 29 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.618725:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2de800/0xa7c849b16e019931 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4124672->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e730 expref: 29 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.618853:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.618856:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.618864:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.618872:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.618906:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.618919:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747448576:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.619719:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.622310:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747448576:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.622334:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.622385:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746559488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3737us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.622394:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5753 00000100:00100000:0.0:1746144657.624567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.624628:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746559744 00000100:00100000:1.0:1746144657.624638:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746559744 00002000:00100000:1.0:1746144657.624684:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f169f80 x1830964746559744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.624694:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169f80 with x1830964746559744 ext(2097152->3145727) 00002000:00010000:1.0:1746144657.624699:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f169f80 00000100:00100000:1.0:1746144657.626011:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4367 00000100:00100000:1.0:1746144657.626024:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746559744:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.627643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.627846:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746560000 00000100:00100000:3.0:1746144657.627854:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746560000 00000100:00100000:3.0:1746144657.627902:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10039 00000100:00100000:3.0:1746144657.627908:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:28988:x1830964746560000:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.627927:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.627944:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e76f expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.628040:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628053:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628063:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628075:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628080:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628084:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628208:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628217:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628223:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144657.628232:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144657.628305:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628312:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628317:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628323:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b43c4400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.628327:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628333:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628344:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.628346:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144657.628350:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628355:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4400/0xa7c849b16e0199a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628373:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628377:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628386:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628390:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fffe200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.628392:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628396:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628401:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144657.628403:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.628405:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628409:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffe200/0xa7c849b16e01999a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628415:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628419:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628424:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628427:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db96e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.628429:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628433:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628441:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639100) 00010000:00010000:3.0:1746144657.628442:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.628444:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628448:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db96e00/0xa7c849b16e0199a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144657.628481:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019993 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e76f expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.628487:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f89800/0xa7c849b16e019993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e76f expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.628496:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f89800, rc 0) 00000100:00100000:3.0:1746144657.628556:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28988:x1830964746560000:12345-192.168.204.23@tcp:101:cat.0 Request processed in 648us (916us total) trans 8589943900 rc 301/301 00000100:00100000:3.0:1746144657.628562:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10039 00000100:00100000:2.0:1746144657.632684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.632769:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746560256 00000100:00100000:3.0:1746144657.632778:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746560256 00000100:00100000:3.0:1746144657.632833:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4035 00000100:00100000:3.0:1746144657.632841:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:28988:x1830964746560256:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144657.633044:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28988:x1830964746560256:12345-192.168.204.23@tcp:35:cat.0 Request processed in 203us (369us total) trans 8589943901 rc 0/0 00000100:00100000:3.0:1746144657.633051:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4035 00000100:00100000:1.0:1746144657.639329:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746559744:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13296us (14755us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.639342:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4367 00002000:00100000:1.0:1746144657.639355:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f169f80 x1830964746559744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.639364:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169f80 with x1830964746559744 ext(2097152->3145727) 00002000:00010000:1.0:1746144657.639370:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f169f80 00000100:00100000:0.0:1746144657.639465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.639725:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746560384 00000100:00100000:1.0:1746144657.639733:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746560384 00000100:00100000:1.0:1746144657.639775:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10040 00000100:00100000:1.0:1746144657.639783:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:28988:x1830964746560384:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144657.639804:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.639822:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d400/0xa7c849b16e0199b6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e776 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.639905:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144657.639919:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144657.639929:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144657.639954:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:1.0:1746144657.639958:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144657.639970:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144657.639991:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d400/0xa7c849b16e0199b6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 302 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144657.643216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.643542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.643575:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746560768 00000100:00100000:0.0:1746144657.643582:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746560768 00000100:00100000:0.0:1746144657.643617:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11574 00000100:00100000:0.0:1746144657.643623:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:28985:x1830964746560768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144657.643641:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.643656:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e784 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.643686:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.643692:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144657.643694:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144657.643697:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.643723:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.643733:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 21 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:0.0:1746144657.643743:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747448704:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.643810:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.643862:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746560640 00000100:00100000:2.0:1746144657.643866:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746560640 00000100:00100000:2.0:1746144657.643891:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10041 00000100:00100000:2.0:1746144657.643896:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:28990:x1830964746560640:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144657.643905:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.643920:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5400/0xa7c849b16e0199cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e77d expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.643951:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.643959:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144657.643962:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144657.643964:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b20d600, rc 0) 00000100:00100000:1.0:1746144657.643994:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28988:x1830964746560384:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4212us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.643999:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10040 00010000:00010000:2.0:1746144657.644018:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644029:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644038:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644050:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644055:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644060:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644189:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644197:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644202:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144657.644211:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144657.644287:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644293:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644299:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644304:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a5a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.644307:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644313:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644320:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.644322:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144657.644325:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644329:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5a00/0xa7c849b16e0199e0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644356:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644361:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644365:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644373:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a5e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.644375:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644380:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644386:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144657.644388:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144657.644390:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644395:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5e00/0xa7c849b16e0199d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644403:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644407:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644412:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644415:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a4e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.644417:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644421:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644426:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8d00) 00010000:00010000:2.0:1746144657.644427:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144657.644430:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644434:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a4e00/0xa7c849b16e0199d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.644463:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5400/0xa7c849b16e0199cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e77d expref: 14 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.644469:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a5400/0xa7c849b16e0199cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e77d expref: 14 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.644476:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a5400, rc 0) 00000100:00100000:2.0:1746144657.644491:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:28990:x1830964746560640:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 595us (1284us total) trans 8589943902 rc 301/301 00000100:00100000:2.0:1746144657.644497:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10041 00000100:00100000:0.0:1746144657.647497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.647533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.648494:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747448704:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.648576:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746561024 00000100:00100000:3.0:1746144657.648583:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746561024 00000100:00100000:1.0:1746144657.648599:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746561152 00000100:00100000:1.0:1746144657.648609:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746561152 00000100:00100000:3.0:1746144657.648642:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11575 00000100:00100000:0.0:1746144657.648642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.648650:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746561024:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144657.648659:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11576 00000100:00100000:1.0:1746144657.648665:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746561152:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.648667:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144657.648673:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746560896 00000100:00100000:0.0:1746144657.648676:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746560896 00010000:00010000:1.0:1746144657.648679:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.648684:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e78b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.648691:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b20da00/0xa7c849b16e0199f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e792 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746144657.648701:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4050943) req@ffff88009f398a80 x1830964746560896/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746144657.648705:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.648707:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:0.0:1746144657.648710:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398a80 with x1830964746560896 ext(3145728->4050943) 00010000:00010000:3.0:1746144657.648715:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144657.648716:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 24 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:0.0:1746144657.648727:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 24 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.648729:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 29 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144657.648729:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747448832:192.168.204.23@tcp:106: 00002000:00010000:0.0:1746144657.648734:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f398a80 00000100:00100000:0.0:1746144657.648747:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 839 00010000:00010000:3.0:1746144657.648751:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b43c4800, rc 0) 00000100:00100000:0.0:1746144657.648752:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746560896:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144657.648795:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144657.648962:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746561024:12345-192.168.204.23@tcp:101:cat.0 Request processed in 312us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.648968:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11575 00010000:00010000:2.0:1746144657.649701:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.649712:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273600, rc 0) 00000100:00100000:2.0:1746144657.649748:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:28985:x1830964746560768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6124us (6205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.649754:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11574 00000100:00100000:1.0:1746144657.650009:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747448832:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144657.650034:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b20da00/0xa7c849b16e0199f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e792 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.650044:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b20da00/0xa7c849b16e0199f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e792 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.650066:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b20da00, rc 0) 00000100:00100000:1.0:1746144657.650103:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746561152:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1437us (2568us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144657.650109:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11576 00000100:00100000:0.0:1746144657.655946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.656032:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746561280 00000100:00100000:1.0:1746144657.656042:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746561280 00000100:00100000:1.0:1746144657.656103:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11577 00000100:00100000:1.0:1746144657.656113:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+15:28990:x1830964746561280:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144657.656168:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.656189:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e799 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.656225:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144657.656232:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.656239:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144657.656242:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->2461695] (req 2265088->2461695) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.656278:0:8450:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.656292:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->2461695] (req 2265088->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.656301:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b20ca00, rc 0) 00000100:00100000:1.0:1746144657.656351:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:28990:x1830964746561280:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 240us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.656357:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11577 00000100:00100000:0.0:1746144657.657888:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.657947:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746561536 00000100:00100000:3.0:1746144657.657954:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746561536 00000100:00100000:0.0:1746144657.657995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:3.0:1746144657.658009:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f39bb80 x1830964746561536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.658019:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39bb80 with x1830964746561536 ext(0->1048575) 00000100:00100000:0.0:1746144657.658022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:3.0:1746144657.658025:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f39bb80 00000100:00100000:2.0:1746144657.658039:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746561792 00000100:00100000:2.0:1746144657.658047:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746561792 00000100:00100000:3.0:1746144657.658050:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4368 00000100:00100000:3.0:1746144657.658063:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746561536:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144657.658066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:2.0:1746144657.658081:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f39a680 x1830964746561792/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.658097:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39a680 with x1830964746561792 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.658101:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39a680 00000100:00100000:2.0:1746144657.658115:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746562304 00000100:00100000:2.0:1746144657.658117:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746562304 00002000:00100000:2.0:1746144657.658125:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f399c00 x1830964746562304/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.658131:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399c00 with x1830964746562304 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.658174:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f399c00 00000100:00100000:2.0:1746144657.658189:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746562048 00000100:00100000:2.0:1746144657.658193:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746562048 00002000:00100000:2.0:1746144657.658203:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f398000 x1830964746562048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.658209:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398000 with x1830964746562048 ext(1048576->2097151) 00002000:00010000:2.0:1746144657.658211:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f398000 00000100:00100000:2.0:1746144657.658220:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4369 00000100:00100000:2.0:1746144657.658226:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746561792:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144657.658425:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4370 00000100:00100000:1.0:1746144657.658433:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746562304:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.659620:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4371 00000100:00100000:3.0:1746144657.659635:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746562048:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144657.663447:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746560896:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 14686us (14796us total) trans 21474840468 rc 0/0 00000100:00100000:1.0:1746144657.663458:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 839 00002000:00100000:1.0:1746144657.663468:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4050943) req@ffff88009f398a80 x1830964746560896/t21474840468(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.663476:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398a80 with x1830964746560896 ext(3145728->4050943) 00010000:00010000:1.0:1746144657.663485:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 28 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.663499:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 28 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.663506:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f398a80 00000100:00100000:0.0:1746144657.670701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.671355:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746562432 00000100:00100000:2.0:1746144657.671366:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746562432 00010000:00010000:2.0:1746144657.671403:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 28 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.671637:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746561536:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13574us (13753us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.671648:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4368 00002000:00100000:3.0:1746144657.671659:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f39bb80 x1830964746561536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.671667:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39bb80 with x1830964746561536 ext(0->1048575) 00002000:00010000:3.0:1746144657.671673:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f39bb80 00000100:00100000:2.0:1746144657.672245:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5754 00000100:00100000:2.0:1746144657.672254:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746562432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.672266:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.672428:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 28 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.672440:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 28 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.672458:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4050943) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e737 expref: 28 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.672591:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.672594:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.672600:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.672608:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.672638:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.672648:0:7309:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 15 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.672657:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747449088:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.672721:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.673063:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746562304:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14630us (15037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.673072:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4370 00002000:00100000:1.0:1746144657.673081:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f399c00 x1830964746562304/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.673089:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399c00 with x1830964746562304 ext(1048576->2097151) 00002000:00010000:1.0:1746144657.673094:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f399c00 00000100:00100000:3.0:1746144657.675554:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746562048:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15914us (17475us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.675566:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4371 00002000:00100000:3.0:1746144657.675577:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f398000 x1830964746562048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.675585:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398000 with x1830964746562048 ext(1048576->2097151) 00002000:00010000:3.0:1746144657.675591:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f398000 00000100:00100000:2.0:1746144657.678706:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747449088:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.678724:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.678759:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746562432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6506us (8070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.678768:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5754 00000100:00100000:3.0:1746144657.679092:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746561792:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20858us (21089us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.679103:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4369 00002000:00100000:3.0:1746144657.679113:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f39a680 x1830964746561792/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.679122:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39a680 with x1830964746561792 ext(1048576->2097151) 00002000:00010000:3.0:1746144657.679128:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39a680 00000100:00100000:0.0:1746144657.683010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.683050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.683088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.683192:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746562688 00000100:00100000:1.0:1746144657.683203:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746562688 00000100:00100000:3.0:1746144657.683234:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746563200 00000100:00100000:3.0:1746144657.683242:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746563200 00002000:00100000:1.0:1746144657.683247:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f399880 x1830964746562688/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.683256:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399880 with x1830964746562688 ext(2097152->3145727) 00010000:00010000:1.0:1746144657.683264:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 16 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.683277:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 16 pid: 7257 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.683283:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f399880 00002000:00100000:3.0:1746144657.683289:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f399500 x1830964746563200/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.683298:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399500 with x1830964746563200 ext(3145728->4194303) 00000100:00100000:1.0:1746144657.683302:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746563072 00002000:00010000:3.0:1746144657.683303:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f399500 00000100:00100000:1.0:1746144657.683305:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746563072 00002000:00100000:1.0:1746144657.683313:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f398380 x1830964746563072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.683319:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398380 with x1830964746563072 ext(3145728->4194303) 00000100:00100000:3.0:1746144657.683320:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 840 00010000:00010000:1.0:1746144657.683322:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 17 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.683329:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 17 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.683330:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746562688:12345-192.168.204.23@tcp:3:multiop.0 00002000:00010000:1.0:1746144657.683333:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f398380 00000100:00100000:1.0:1746144657.683344:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 841 00000100:00100000:1.0:1746144657.683349:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746563072:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144657.684197:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4372 00000100:00100000:0.0:1746144657.684206:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746563200:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144657.694955:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746563072:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11597us (11858us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.694966:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 841 00002000:00100000:1.0:1746144657.694974:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f398380 x1830964746563072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.694983:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398380 with x1830964746563072 ext(3145728->4194303) 00010000:00010000:1.0:1746144657.694991:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 18 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.695005:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 18 pid: 7257 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.695016:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f398380 00010000:00010000:0.0:1746144657.700494:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746144657.700958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.701470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.701781:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746563712 00000100:00100000:1.0:1746144657.701788:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746563712 00002000:00100000:1.0:1746144657.701822:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4dd7480 x1830964746563712/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.701831:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7480 with x1830964746563712 ext(2097152->3145727) 00002000:00010000:1.0:1746144657.701836:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd7480 00000100:00100000:1.0:1746144657.701861:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4373 00000100:00100000:1.0:1746144657.701869:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746563712:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144657.702038:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746563456 00000100:00100000:3.0:1746144657.702048:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746563456 00000100:00100000:3.0:1746144657.702120:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10042 00000100:00100000:3.0:1746144657.702129:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:28992:x1830964746563456:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144657.702186:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.702208:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7a0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.703434:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703447:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703455:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703466:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703470:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703477:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144657.703494:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746563200:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 19287us (20440us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144657.703502:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4372 00002000:00100000:0.0:1746144657.703510:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f399500 x1830964746563200/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144657.703524:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399500 with x1830964746563200 ext(3145728->4194303) 00002000:00010000:0.0:1746144657.703528:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f399500 00010000:00010000:3.0:1746144657.703576:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703583:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703588:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144657.703594:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:2.0:1746144657.703632:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746562688:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 20304us (20632us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.703639:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 840 00002000:00100000:2.0:1746144657.703645:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f399880 x1830964746562688/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746144657.703650:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00002000:00100000:2.0:1746144657.703651:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399880 with x1830964746562688 ext(2097152->3145727) 00010000:00010000:3.0:1746144657.703655:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.703658:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 16 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.703659:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703664:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b43c4200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.703666:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703671:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144657.703671:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 16 pid: 7257 timeout: 736 lvb_type: 0 00002000:00010000:2.0:1746144657.703677:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f399880 00010000:00010000:3.0:1746144657.703684:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144657.703686:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144657.703688:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703695:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c4200/0xa7c849b16e019a18 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703711:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703715:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703719:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703722:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff4dc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.703723:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703727:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703731:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144657.703733:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.703735:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703738:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703744:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703748:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703752:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703755:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b43c5000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144657.703757:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703761:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703764:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639900) 00010000:00010000:3.0:1746144657.703766:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144657.703767:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703771:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019a11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144657.703931:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a0 expref: 303 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.703938:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a0 expref: 303 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.703945:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4de00, rc 0) 00000100:00100000:3.0:1746144657.703967:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28992:x1830964746563456:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1840us (3015us total) trans 8589943903 rc 301/301 00000100:00100000:3.0:1746144657.703973:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10042 00000100:00100000:0.0:1746144657.713748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.714509:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746563840 00000100:00100000:2.0:1746144657.714518:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746563840 00000100:00100000:2.0:1746144657.714569:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11578 00000100:00100000:2.0:1746144657.714576:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:28985:x1830964746563840:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.714591:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.714606:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7a7 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.714626:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.714629:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.714635:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.714647:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.714656:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ae00, rc 0) 00000100:00100000:2.0:1746144657.714709:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:28985:x1830964746563840:12345-192.168.204.23@tcp:101:cat.0 Request processed in 132us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.714714:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11578 00000100:00100000:0.0:1746144657.718302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.718403:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746563968 00000100:00100000:2.0:1746144657.718412:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746563968 00010000:00010000:2.0:1746144657.718450:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 17 pid: 7257 timeout: 736 lvb_type: 0 00000100:00100000:2.0:1746144657.718476:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5755 00000100:00100000:2.0:1746144657.718482:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746563968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.718496:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.718519:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 17 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.718531:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 17 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.718553:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273600/0xa7c849b16e0199c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e784 expref: 17 pid: 7257 timeout: 736 lvb_type: 0 00010000:00010000:2.0:1746144657.718586:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.718588:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.718595:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.718602:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.718635:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.718647:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747449216:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.718728:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.721255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.721422:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746564224 00000100:00100000:2.0:1746144657.721430:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746564224 00002000:00100000:2.0:1746144657.721465:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f39a300 x1830964746564224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.721475:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39a300 with x1830964746564224 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.721479:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39a300 00000100:00100000:2.0:1746144657.721496:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4374 00000100:00100000:2.0:1746144657.721502:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746564224:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144657.722061:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746563712:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20191us (20590us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.722068:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4373 00002000:00100000:1.0:1746144657.722074:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4dd7480 x1830964746563712/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.722082:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7480 with x1830964746563712 ext(2097152->3145727) 00002000:00010000:1.0:1746144657.722085:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd7480 00000100:00100000:2.0:1746144657.727581:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747449216:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.727599:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.727646:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746563968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9163us (9354us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.727656:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5755 00000100:00100000:1.0:1746144657.729724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.729798:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746564352 00000100:00100000:2.0:1746144657.729807:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746564352 00000100:00100000:2.0:1746144657.729863:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11579 00000100:00100000:2.0:1746144657.729870:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:28992:x1830964746564352:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144657.729885:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.729901:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7ae expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.729923:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.729931:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.729937:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.729941:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.729943:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.729946:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [241664->450559] (req 241664->450559) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.729970:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.729980:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.729991:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747449344:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.730057:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.730064:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 17 pid: 8450 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.730071:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747449472:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.730091:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.730097:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 6 pid: 8453 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.730104:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747449600:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.730115:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144657.730547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.730642:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746564480 00000100:00100000:3.0:1746144657.730647:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746564480 00000100:00100000:3.0:1746144657.730685:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11580 00000100:00100000:3.0:1746144657.730692:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:28988:x1830964746564480:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144657.730700:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144657.730709:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7b5 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.730724:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.730730:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.730731:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144657.730734:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.730749:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.730756:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 17 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.730770:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747449728:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144657.730817:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144657.731774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.731870:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746564736 00000100:00100000:1.0:1746144657.731876:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746564736 00002000:00100000:1.0:1746144657.731915:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2265088->2269183) req@ffff88009f398700 x1830964746564736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.731931:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398700 with x1830964746564736 ext(2265088->2269183) 00010000:00010000:1.0:1746144657.731939:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.731950:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.731958:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f398700 00000100:00100000:1.0:1746144657.731983:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 842 00000100:00100000:1.0:1746144657.731990:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746564736:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144657.732189:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746564736:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 199us (416us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144657.732196:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 842 00002000:00100000:1.0:1746144657.732202:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2265088->2269183) req@ffff88009f398700 x1830964746564736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.732209:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398700 with x1830964746564736 ext(2265088->2269183) 00010000:00010000:1.0:1746144657.732213:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.732222:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.732227:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f398700 00000100:00100000:2.0:1746144657.732646:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746564224:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11143us (11396us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.732653:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4374 00002000:00100000:2.0:1746144657.732658:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f39a300 x1830964746564224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.732664:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39a300 with x1830964746564224 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.732667:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39a300 00000100:00100000:0.0:1746144657.735717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.735775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.735800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.735834:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747449728:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144657.735839:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746564864 00000100:00100000:0.0:1746144657.735845:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746564864 00010000:00010000:3.0:1746144657.735871:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144657.735874:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 7 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:3.0:1746144657.735886:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b43c4400, rc 0) 00000100:00100000:0.0:1746144657.735911:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5756 00000100:00100000:0.0:1746144657.735918:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746564864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144657.735931:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144657.735939:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:28988:x1830964746564480:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5246us (5392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.735949:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11580 00010000:00010000:0.0:1746144657.735954:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 7 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.735966:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 7 pid: 8453 timeout: 736 lvb_type: 1 00010000:00010000:0.0:1746144657.735991:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.736174:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746565120 00000100:00100000:2.0:1746144657.736179:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746565120 00000100:00100000:2.0:1746144657.736201:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746564992 00000100:00100000:2.0:1746144657.736203:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746564992 00000100:00100000:2.0:1746144657.736217:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11581 00000100:00100000:2.0:1746144657.736222:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746565120:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.736234:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.736249:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7c3 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.736269:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a3b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7c3 expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144657.736316:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11582 00000100:00100000:1.0:1746144657.736325:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746564992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144657.736332:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.736339:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4587400/0xa7c849b16e019a42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7bc expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144657.736350:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.736355:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4587400/0xa7c849b16e019a42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7bc expref: 19 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.736363:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4587400/0xa7c849b16e019a42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7bc expref: 19 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.736378:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4587400, rc 0) 00010000:00010000:2.0:1746144657.736524:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7c3 expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.736544:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428b000, rc 0) 00000100:00100000:1.0:1746144657.736891:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746564992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 565us (1088us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.736973:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746565120:12345-192.168.204.23@tcp:101:cat.0 Request processed in 750us (1197us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.736979:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11581 00000100:00100000:2.0:1746144657.737013:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747449344:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144657.737021:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747449472:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.737029:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fabd200/0xa7c849b16e01989e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e696 expref: 7 pid: 8453 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.737038:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747449600:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144657.737060:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [241664->450559] (req 241664->450559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.737068:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a600, rc 0) 00000100:00100000:2.0:1746144657.737081:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:28992:x1830964746564352:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7213us (7367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.737086:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11579 00000100:00100000:0.0:1746144657.737196:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746564864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1277us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144657.737206:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5756 00000100:00100000:1.0:1746144657.737276:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11582 00000100:00100000:0.0:1746144657.738038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.738162:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746565248 00000100:00100000:2.0:1746144657.738167:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746565248 00010000:00010000:2.0:1746144657.738184:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.738728:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5757 00000100:00100000:2.0:1746144657.738735:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746565248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.738745:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.738764:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.738773:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 736 lvb_type: 1 00000100:00100000:0.0:1746144657.738784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144657.738790:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7ebe00/0xa7c849b16e0198e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6e3 expref: 30 pid: 8389 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.738801:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.738823:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746565248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 89us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.738832:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5757 00000100:00100000:2.0:1746144657.738840:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746565376 00000100:00100000:2.0:1746144657.738843:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746565376 00010000:00010000:2.0:1746144657.738851:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 18 pid: 8450 timeout: 736 lvb_type: 1 00000100:00100000:2.0:1746144657.738864:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5758 00000100:00100000:2.0:1746144657.738868:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746565376:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144657.738875:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144657.738882:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 18 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.738889:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 18 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.738899:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944a4a00/0xa7c849b16e01990e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e706 expref: 18 pid: 8450 timeout: 736 lvb_type: 1 00010000:00010000:2.0:1746144657.738906:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.738908:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144657.738915:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.738922:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.738948:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.738961:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747449856:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.739017:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.743085:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747449856:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144657.743109:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.743577:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746565376:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4705us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144657.743588:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5758 00000100:00100000:0.0:1746144657.745236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.745271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.745335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.746657:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746565632 00000100:00100000:1.0:1746144657.746667:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746565632 00002000:00100000:1.0:1746144657.746720:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2457600->2461695) req@ffff880136448380 x1830964746565632/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.746730:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448380 with x1830964746565632 ext(2457600->2461695) 00010000:00010000:1.0:1746144657.746741:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.746756:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.746769:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136448380 00000100:00100000:1.0:1746144657.746796:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746565888 00000100:00100000:1.0:1746144657.746799:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746565888 00002000:00100000:1.0:1746144657.746814:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (241664->245759) req@ffff880136449180 x1830964746565888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.746821:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449180 with x1830964746565888 ext(241664->245759) 00002000:00010000:1.0:1746144657.746824:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449180 00000100:00100000:1.0:1746144657.746834:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746566144 00000100:00100000:1.0:1746144657.746836:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746566144 00002000:00100000:1.0:1746144657.746845:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880136448a80 x1830964746566144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.746851:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448a80 with x1830964746566144 ext(4194304->4935679) 00002000:00010000:1.0:1746144657.746854:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448a80 00000100:00100000:1.0:1746144657.746871:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 843 00000100:00100000:1.0:1746144657.746878:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746565632:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144657.747055:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746565632:12345-192.168.204.23@tcp:3:cat.0 Request processed in 177us (1824us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144657.747061:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 843 00002000:00100000:1.0:1746144657.747066:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2457600->2461695) req@ffff880136448380 x1830964746565632/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.747073:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448380 with x1830964746565632 ext(2457600->2461695) 00010000:00010000:1.0:1746144657.747078:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.747092:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.747097:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136448380 00000100:00100000:1.0:1746144657.747110:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4375 00000100:00100000:1.0:1746144657.747115:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746565888:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144657.747175:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4376 00000100:00100000:2.0:1746144657.747189:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746566144:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144657.747218:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746565888:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 102us (1945us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144657.747225:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4375 00002000:00100000:1.0:1746144657.747229:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (241664->245759) req@ffff880136449180 x1830964746565888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.747236:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449180 with x1830964746565888 ext(241664->245759) 00002000:00010000:1.0:1746144657.747239:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449180 00000100:00100000:0.0:1746144657.751975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.753461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.753491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.753806:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746566400 00000100:00100000:1.0:1746144657.753816:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746566400 00002000:00100000:1.0:1746144657.753866:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2265088->2461695) req@ffff880136449500 x1830964746566400/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.753876:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449500 with x1830964746566400 ext(2265088->2461695) 00010000:00010000:1.0:1746144657.753886:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.753902:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 16 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.753914:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136449500 00000100:00100000:1.0:1746144657.753939:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746566912 00000100:00100000:1.0:1746144657.753942:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746566912 00000100:00100000:3.0:1746144657.753943:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746566656 00000100:00100000:3.0:1746144657.753954:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746566656 00002000:00100000:1.0:1746144657.753959:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (446464->450559) req@ffff88013644a300 x1830964746566912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.753966:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644a300 with x1830964746566912 ext(446464->450559) 00002000:00010000:1.0:1746144657.753970:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644a300 00000100:00100000:3.0:1746144657.754011:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4036 00000100:00100000:3.0:1746144657.754019:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:28990:x1830964746566656:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144657.754345:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 844 00000100:00100000:1.0:1746144657.754353:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746566400:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144657.754358:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:28990:x1830964746566656:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 339us (902us total) trans 8589943904 rc 0/0 00000100:00100000:3.0:1746144657.754365:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4036 00000100:00100000:2.0:1746144657.754441:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4377 00000100:00100000:2.0:1746144657.754451:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746566912:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144657.754582:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746566912:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 134us (1089us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144657.754588:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4377 00002000:00100000:2.0:1746144657.754593:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (446464->450559) req@ffff88013644a300 x1830964746566912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/4536 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.754599:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644a300 with x1830964746566912 ext(446464->450559) 00002000:00010000:2.0:1746144657.754602:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644a300 00000100:00100000:2.0:1746144657.754945:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746566144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7762us (9609us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144657.754951:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4376 00002000:00100000:2.0:1746144657.754956:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880136448a80 x1830964746566144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.754963:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448a80 with x1830964746566144 ext(4194304->4935679) 00002000:00010000:2.0:1746144657.754966:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448a80 00000100:00100000:2.0:1746144657.758021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.758083:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746567168 00000100:00100000:3.0:1746144657.758094:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746567168 00000100:00100000:3.0:1746144657.758166:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4037 00000100:00100000:3.0:1746144657.758174:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:28992:x1830964746567168:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144657.758344:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:28992:x1830964746567168:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 171us (334us total) trans 8589943905 rc 0/0 00000100:00100000:3.0:1746144657.758350:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4037 00000100:00100000:1.0:1746144657.759510:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746566400:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5156us (7543us total) trans 21474840469 rc 0/0 00000100:00100000:1.0:1746144657.759518:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 844 00002000:00100000:1.0:1746144657.759526:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2265088->2461695) req@ffff880136449500 x1830964746566400/t21474840469(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:298/0 lens 488/448 e 0 to 0 dl 1746144668 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.759534:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449500 with x1830964746566400 ext(2265088->2461695) 00010000:00010000:1.0:1746144657.759541:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:1.0:1746144657.759554:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00002000:00010000:1.0:1746144657.759560:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136449500 00000100:00100000:0.0:1746144657.759769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.759801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.759816:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746567296 00000100:00100000:0.0:1746144657.759820:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746567296 00000100:00100000:0.0:1746144657.759841:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746567424 00000100:00100000:0.0:1746144657.759843:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746567424 00000100:00100000:0.0:1746144657.759854:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11583 00000100:00100000:0.0:1746144657.759860:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746567296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144657.759869:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144657.759881:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c600/0xa7c849b16e019a49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7ca expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144657.759916:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747449984:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144657.759961:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144657.760309:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11584 00000100:00100000:2.0:1746144657.760325:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746567424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.760339:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.760353:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7d1 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.760378:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a50 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7d1 expref: 19 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.760388:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7d1 expref: 19 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.760404:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428be00, rc 0) 00000100:00100000:2.0:1746144657.760440:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746567424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 123us (638us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.760445:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11584 00000100:00100000:0.0:1746144657.762083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.762175:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746567552 00000100:00100000:3.0:1746144657.762181:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746567552 00010000:00010000:3.0:1746144657.762213:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00000100:00100000:3.0:1746144657.762239:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5759 00000100:00100000:3.0:1746144657.762245:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746567552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144657.762254:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144657.762270:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.762284:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.762300:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b20ca00/0xa7c849b16e0199fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2265088->3145727] (req 2265088->2461695) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e799 expref: 18 pid: 8450 timeout: 736 lvb_type: 0 00010000:00010000:3.0:1746144657.762310:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.762312:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144657.762317:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.762324:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144657.762345:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144657.762353:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747450112:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144657.762409:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7780 going to sleep for 11 seconds 00002000:00010000:2.0:1746144657.762531:0:4760:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144655 -> 1746144658 00002000:00010000:2.0:1746144657.762537:0:4760:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144654 -> 1746144658 00002000:00010000:2.0:1746144657.762539:0:4760:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144655 -> 1746144658 00000100:00100000:2.0:1746144657.762558:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136449f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747449984:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144657.762600:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c600/0xa7c849b16e019a49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ca expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.762611:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff4c600/0xa7c849b16e019a49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ca expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.762622:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4c600, rc 0) 00000100:00100000:2.0:1746144657.762651:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746567296:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2791us (2883us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.762658:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11583 00000100:00100000:0.0:1746144657.765871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.765921:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747450112:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144657.765934:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746567680 00000100:00100000:2.0:1746144657.765942:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746567680 00010000:00010000:3.0:1746144657.765948:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144657.765998:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11585 00000100:00100000:2.0:1746144657.766005:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746567680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144657.766023:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.766043:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b428a800/0xa7c849b16e019a57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7d8 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.766111:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747450240:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144657.766225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.766246:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746567552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3999us (4165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144657.766255:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5759 00000100:00100000:1.0:1746144657.766256:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746567808 00000100:00100000:1.0:1746144657.766262:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746567808 00000100:00100000:1.0:1746144657.766291:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11586 00000100:00100000:1.0:1746144657.766297:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746567808:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144657.766310:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144657.766323:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7df expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144657.766327:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00010000:00010000:1.0:1746144657.766340:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.766341:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144657.766347:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 18 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.766359:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 18 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144657.766369:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52b9c00, rc 0) 00000100:00100000:1.0:1746144657.766388:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746567808:12345-192.168.204.23@tcp:101:cat.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144657.766393:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11586 00000100:00100000:2.0:1746144657.768566:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747450240:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144657.768597:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b428a800/0xa7c849b16e019a57 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7d8 expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.768609:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b428a800/0xa7c849b16e019a57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7d8 expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144657.768628:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428a800, rc 0) 00000100:00100000:2.0:1746144657.768671:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746567680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2665us (2809us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144657.768678:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11585 00000100:00100000:0.0:1746144657.769548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.769576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.769612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.769669:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746568064 00000100:00100000:3.0:1746144657.769676:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746568064 00002000:00100000:3.0:1746144657.769733:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013644bb80 x1830964746568064/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746144657.769733:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746568320 00000100:00100000:2.0:1746144657.769736:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746568320 00002000:00100000:3.0:1746144657.769741:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644bb80 with x1830964746568064 ext(2097152->3145727) 00002000:00010000:3.0:1746144657.769744:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644bb80 00002000:00100000:2.0:1746144657.769751:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013644b480 x1830964746568320/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.769759:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644b480 with x1830964746568320 ext(3145728->4194303) 00002000:00010000:2.0:1746144657.769763:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644b480 00000100:00100000:3.0:1746144657.769764:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746568576 00000100:00100000:3.0:1746144657.769766:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746568576 00000100:00100000:2.0:1746144657.769778:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4378 00002000:00100000:3.0:1746144657.769779:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136449880 x1830964746568576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746144657.769783:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746568064:12345-192.168.204.23@tcp:3:multiop.0 00002000:00100000:3.0:1746144657.769785:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449880 with x1830964746568576 ext(3145728->4194303) 00002000:00010000:3.0:1746144657.769788:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449880 00000100:00100000:3.0:1746144657.769800:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4379 00000100:00100000:3.0:1746144657.769806:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746568320:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144657.770274:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4380 00000100:00100000:1.0:1746144657.770283:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746568576:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144657.777330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144657.777403:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746568832 00000100:00100000:2.0:1746144657.777411:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746568832 00000100:00100000:2.0:1746144657.777459:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4038 00000100:00100000:2.0:1746144657.777467:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:28985:x1830964746568832:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144657.777629:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:28985:x1830964746568832:12345-192.168.204.23@tcp:35:cat.0 Request processed in 162us (305us total) trans 8589943906 rc 0/0 00000100:00100000:2.0:1746144657.777636:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4038 00000100:00100000:3.0:1746144657.777641:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746568320:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 7837us (8064us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144657.777648:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4379 00002000:00100000:3.0:1746144657.777655:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013644b480 x1830964746568320/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144657.777663:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644b480 with x1830964746568320 ext(3145728->4194303) 00002000:00010000:3.0:1746144657.777668:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644b480 00000100:00100000:2.0:1746144657.780201:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746568064:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10412us (10649us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144657.780210:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4378 00002000:00100000:2.0:1746144657.780218:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013644bb80 x1830964746568064/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144657.780227:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644bb80 with x1830964746568064 ext(2097152->3145727) 00002000:00010000:2.0:1746144657.780230:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644bb80 00000100:00100000:1.0:1746144657.781815:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746568576:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11530us (12197us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144657.781823:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4380 00002000:00100000:1.0:1746144657.781829:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136449880 x1830964746568576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.781836:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449880 with x1830964746568576 ext(3145728->4194303) 00002000:00010000:1.0:1746144657.781840:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449880 00000100:00100000:0.0:1746144657.792520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144657.792636:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746569088 00000100:00100000:1.0:1746144657.792645:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746569088 00002000:00100000:1.0:1746144657.792684:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880136448000 x1830964746569088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/0 e 0 to 0 dl 1746144668 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.792692:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448000 with x1830964746569088 ext(4194304->4935679) 00002000:00010000:1.0:1746144657.792697:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448000 00000100:00100000:1.0:1746144657.792758:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4381 00000100:00100000:1.0:1746144657.792766:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746569088:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144657.797861:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746569088:12345-192.168.204.23@tcp:3:cat.0 Request processed in 5088us (5340us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144657.797869:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4381 00002000:00100000:1.0:1746144657.797878:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880136448000 x1830964746569088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:298/0 lens 488/440 e 0 to 0 dl 1746144668 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144657.797886:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448000 with x1830964746569088 ext(4194304->4935679) 00002000:00010000:1.0:1746144657.797891:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448000 00000100:00100000:0.0:1746144657.990020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144657.990080:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144657.990414:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746569600 00000100:00100000:3.0:1746144657.990424:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746569600 00000100:00100000:3.0:1746144657.991713:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746569344 00000100:00100000:3.0:1746144657.991719:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746569344 00000100:00100000:2.0:1746144657.991901:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10043 00000100:00100000:2.0:1746144657.991913:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:29001:x1830964746569600:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144657.991939:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.991957:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7ed expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.992063:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992074:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992085:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992095:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992099:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992104:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992219:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992226:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992232:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144657.992240:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144657.992311:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992317:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992323:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992328:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff4d600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.992332:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992338:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992349:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.992352:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144657.992356:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992361:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4d600/0xa7c849b16e019a7a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992383:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992387:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992394:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992398:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff4de00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.992400:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992404:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992410:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144657.992411:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144657.992414:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992418:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4de00/0xa7c849b16e019a6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992425:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992429:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992433:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992436:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff4c600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.992438:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992443:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992452:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8b00) 00010000:00010000:2.0:1746144657.992453:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144657.992456:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992460:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4c600/0xa7c849b16e019a73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992493:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ed expref: 17 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.992499:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff4dc00/0xa7c849b16e019a65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ed expref: 17 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.992507:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff4dc00, rc 0) 00000100:00100000:2.0:1746144657.992564:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+16:29001:x1830964746569600:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 655us (2554us total) trans 8589943907 rc 301/301 00000100:00100000:2.0:1746144657.992571:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10043 00000100:00100000:2.0:1746144657.992593:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10044 00000100:00100000:2.0:1746144657.992598:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29000:x1830964746569344:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144657.992607:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144657.992613:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019a88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7e6 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.992649:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992656:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992663:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992671:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992676:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992681:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992719:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992725:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992731:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144657.992736:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144657.992763:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992768:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992773:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992777:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428b000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.992780:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992786:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992792:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144657.992793:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144657.992795:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992800:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019a9d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992812:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992817:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992822:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992826:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428be00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.992827:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992831:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992836:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144657.992838:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144657.992840:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992844:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992850:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992855:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992859:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992863:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428ac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144657.992865:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992870:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992875:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8e00) 00010000:00010000:2.0:1746144657.992877:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144657.992879:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992883:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019a96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144657.992901:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019a88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7e6 expref: 305 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.992908:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019a88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7e6 expref: 305 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144657.992914:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428a800, rc 0) 00000100:00100000:2.0:1746144657.992929:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29000:x1830964746569344:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 332us (2850us total) trans 8589943908 rc 301/301 00000100:00100000:2.0:1746144657.992935:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10044 00000100:00100000:0.0:1746144658.006570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.007662:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746569856 00000100:00100000:1.0:1746144658.007672:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746569856 00000100:00080000:2.0:1746144658.007715:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144658.007747:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10045 00000100:00100000:1.0:1746144658.007759:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:29004:x1830964746569856:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.007785:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.007804:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bae00/0xa7c849b16e019aab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7f4 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.008913:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.008928:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.008939:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.008953:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.008958:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.008962:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009067:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009075:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009081:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144658.009088:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144658.009197:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009203:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009208:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009216:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b20ca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.009219:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009224:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009233:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144658.009235:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144658.009238:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.009242:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20ca00/0xa7c849b16e019ac0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011662:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011676:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011682:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011688:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995bb200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.011692:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011698:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011712:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144658.011714:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144658.011718:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011722:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb200/0xa7c849b16e019ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011735:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011740:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011744:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011748:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800995bb800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.011750:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011755:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011766:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9000) 00010000:00010000:1.0:1746144658.011768:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144658.011770:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.011775:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bb800/0xa7c849b16e019ab9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.012317:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bae00/0xa7c849b16e019aab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7f4 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.012324:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800995bae00/0xa7c849b16e019aab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7f4 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.012336:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800995bae00, rc 0) 00000100:00100000:1.0:1746144658.012405:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:29004:x1830964746569856:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4648us (5846us total) trans 8589943909 rc 301/301 00000100:00100000:1.0:1746144658.012414:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10045 00000100:00100000:0.0:1746144658.012680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.012996:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746569984 00000100:00100000:3.0:1746144658.013006:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746569984 00000100:00080000:0.0:1746144658.013072:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144658.013107:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11587 00000100:00100000:3.0:1746144658.013196:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29000:x1830964746569984:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.013217:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.013235:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e7fb expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.013267:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.013276:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.013283:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.013290:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144658.013291:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144658.013295:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3530752->3821567] (req 3530752->3821567) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.013330:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.013344:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 17 pid: 8453 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.013357:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450368:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.013501:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.013512:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 737 lvb_type: 1 00000100:00100000:3.0:1746144658.014694:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450496:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.016219:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.016232:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 25 pid: 8453 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.016243:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450624:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.017033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.017240:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746570112 00000100:00100000:1.0:1746144658.017249:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746570112 00000100:00100000:1.0:1746144658.017316:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11588 00000100:00100000:1.0:1746144658.017326:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746570112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.017340:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.017356:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f0ce00/0xa7c849b16e019ad5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e802 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144658.017395:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747450752:192.168.204.23@tcp:106: 00000100:00080000:0.0:1746144658.017533:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144658.017606:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144658.017630:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450368:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144658.017743:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.017861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.017910:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746570240 00000100:00100000:3.0:1746144658.017914:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746570240 00010000:00010000:3.0:1746144658.017960:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 18 pid: 8453 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.017979:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5760 00000100:00100000:3.0:1746144658.017986:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746570240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.017995:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144658.018018:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 18 pid: 8453 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.018028:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 18 pid: 8453 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.018049:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019a26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7a7 expref: 18 pid: 8453 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.018065:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.018086:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746570240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.018092:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5760 00000100:00080000:0.0:1746144658.018276:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144658.024126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.024435:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746570496 00000100:00100000:1.0:1746144658.024445:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746570496 00000100:00080000:0.0:1746144658.024574:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144658.024688:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10046 00000100:00100000:1.0:1746144658.024697:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29007:x1830964746570496:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.024722:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.024745:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e019adc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e809 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.024860:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.024873:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.024885:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.024898:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.024903:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.024908:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025015:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025024:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025028:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144658.025034:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144658.025101:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025106:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025110:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025114:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4865e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.025116:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025122:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025129:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144658.025131:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144658.025168:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025173:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e019af1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025186:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025191:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025195:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025199:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4865a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.025201:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025204:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025209:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144658.025211:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144658.025213:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025217:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e019ae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025223:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025228:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025232:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025236:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.025238:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025242:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025247:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9200) 00010000:00010000:1.0:1746144658.025249:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144658.025251:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025255:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e019aea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.025288:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e019adc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e809 expref: 306 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.025295:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e019adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e809 expref: 306 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.025302:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864000, rc 0) 00000100:00100000:1.0:1746144658.025357:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29007:x1830964746570496:12345-192.168.204.23@tcp:101:cat.0 Request processed in 661us (1241us total) trans 8589943910 rc 301/301 00000100:00100000:1.0:1746144658.025363:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10046 00000100:00100000:0.0:1746144658.028058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.028190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.028232:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746570624 00000100:00100000:0.0:1746144658.028239:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746570624 00010000:00010000:0.0:1746144658.028284:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.028309:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746570752 00000100:00100000:0.0:1746144658.028311:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746570752 00010000:00010000:0.0:1746144658.028321:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 26 pid: 8453 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.028322:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747450752:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144658.028336:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5761 00000100:00100000:0.0:1746144658.028343:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746570624:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.028356:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093f0ce00/0xa7c849b16e019ad5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e802 expref: 18 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.028357:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.028368:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f0ce00/0xa7c849b16e019ad5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e802 expref: 18 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.028375:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 737 lvb_type: 1 00010000:00010000:1.0:1746144658.028378:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0ce00, rc 0) 00010000:00010000:0.0:1746144658.028436:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.028459:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144658.028463:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019a5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7df expref: 17 pid: 29370 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.028489:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746570624:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 146us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.028492:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450496:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.028496:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5761 00000100:00100000:3.0:1746144658.028504:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450624:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.028510:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5762 00000100:00100000:0.0:1746144658.028515:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746570752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.028522:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.028529:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 26 pid: 8453 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.028539:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3530752->3821567] (req 3530752->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.028539:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 26 pid: 8453 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.028552:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c4400/0xa7c849b16e019a34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7b5 expref: 26 pid: 8453 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.028563:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.028565:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.028571:0:4760:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.028578:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.028657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.028982:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746570112:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11657us (11948us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144658.028990:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11588 00000100:00100000:2.0:1746144658.029056:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746571008 00000100:00100000:2.0:1746144658.029060:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746571008 00010000:00010000:0.0:1746144658.029096:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144658.029112:0:4760:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.029123:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450880:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144658.029415:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746570752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 898us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.029425:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5762 00000100:00100000:3.0:1746144658.029431:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.029475:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4039 00000100:00100000:0.0:1746144658.029480:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29007:x1830964746571008:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144658.031271:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29007:x1830964746571008:12345-192.168.204.23@tcp:35:cat.0 Request processed in 1785us (2608us total) trans 8589943911 rc 0/0 00000100:00100000:0.0:1746144658.031281:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4039 00000100:00100000:1.0:1746144658.031385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.031514:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746571136 00000100:00100000:0.0:1746144658.031520:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746571136 00000100:00100000:0.0:1746144658.031548:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11589 00000100:00100000:0.0:1746144658.031555:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:29004:x1830964746571136:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144658.031568:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144658.031585:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e810 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.031608:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.031615:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144658.031617:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144658.031620:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.031645:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.031656:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 28 pid: 8450 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746144658.031667:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747451008:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.031741:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144658.035011:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747450880:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144658.035045:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b43c5000, rc 0) 00000100:00100000:3.0:1746144658.035105:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29000:x1830964746569984:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 21988us (22424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.035115:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11587 00000100:00100000:0.0:1746144658.037942:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.038014:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746571264 00000100:00100000:1.0:1746144658.038023:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746571264 00000100:00100000:0.0:1746144658.038076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:1.0:1746144658.038092:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (241664->450559) req@ffff88009f437b80 x1830964746571264/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.038102:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437b80 with x1830964746571264 ext(241664->450559) 00010000:00010000:1.0:1746144658.038111:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 29 pid: 8450 timeout: 737 lvb_type: 0 00000100:00080000:0.0:1746144658.038114:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746144658.038125:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 29 pid: 8450 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746144658.038166:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f437b80 00000100:00100000:1.0:1746144658.038186:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 845 00000100:00100000:1.0:1746144658.038195:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746571264:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:2.0:1746144658.038433:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f434380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747451008:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.038474:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.038487:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46dc00, rc 0) 00000100:00100000:2.0:1746144658.038510:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:29004:x1830964746571136:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6955us (7125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.038516:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11589 00000100:00100000:3.0:1746144658.038528:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746571392 00000100:00100000:3.0:1746144658.038532:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746571392 00000100:00100000:3.0:1746144658.038576:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11590 00000100:00100000:3.0:1746144658.038583:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746571392:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.038591:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.038605:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29ac00/0xa7c849b16e019b06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e817 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.038643:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747451136:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144658.038717:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.039412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.039467:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746571648 00000100:00100000:1.0:1746144658.039471:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746571648 00002000:00100000:1.0:1746144658.039492:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3530752->3534847) req@ffff88009f437480 x1830964746571648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.039500:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437480 with x1830964746571648 ext(3530752->3534847) 00002000:00010000:1.0:1746144658.039504:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437480 00000100:00100000:1.0:1746144658.039528:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4382 00000100:00100000:1.0:1746144658.039534:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746571648:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144658.039924:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746571648:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 388us (510us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144658.039930:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4382 00002000:00100000:1.0:1746144658.039936:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3530752->3534847) req@ffff88009f437480 x1830964746571648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.039943:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437480 with x1830964746571648 ext(3530752->3534847) 00002000:00010000:1.0:1746144658.039946:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437480 00000100:00100000:3.0:1746144658.043424:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747451136:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144658.043782:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29ac00/0xa7c849b16e019b06 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e817 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.043803:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29ac00/0xa7c849b16e019b06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e817 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.043829:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ac00, rc 0) 00000100:00100000:1.0:1746144658.044406:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746571264:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 6209us (6472us total) trans 17179873228 rc 0/0 00000100:00100000:3.0:1746144658.044413:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746571392:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5829us (6337us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144658.044416:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 845 00000100:00100000:3.0:1746144658.044420:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11590 00002000:00100000:1.0:1746144658.044425:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (241664->450559) req@ffff88009f437b80 x1830964746571264/t17179873228(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.044434:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437b80 with x1830964746571264 ext(241664->450559) 00010000:00010000:1.0:1746144658.044441:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.044452:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746144658.044458:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f437b80 00000100:00100000:0.0:1746144658.048857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.049014:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746571776 00000100:00100000:2.0:1746144658.049024:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746571776 00010000:00010000:2.0:1746144658.049064:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.049107:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5763 00000100:00100000:2.0:1746144658.049116:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746571776:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.049131:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144658.049333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.049388:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746572032 00000100:00100000:1.0:1746144658.049392:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746572032 00002000:00100000:1.0:1746144658.049425:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3817472->3821567) req@ffff88009f434380 x1830964746572032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.049434:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434380 with x1830964746572032 ext(3817472->3821567) 00002000:00010000:1.0:1746144658.049439:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434380 00000100:00100000:1.0:1746144658.049452:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4383 00000100:00100000:1.0:1746144658.049458:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746572032:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:2.0:1746144658.049592:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.049605:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.049629:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019a2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->450559) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7ae expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.049646:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.049648:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.049656:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.049664:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.049702:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.049714:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747451264:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144658.050377:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.050490:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746572032:12345-192.168.204.23@tcp:3:cat.0 Request processed in 1031us (1155us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144658.050497:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4383 00002000:00100000:1.0:1746144658.050504:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3817472->3821567) req@ffff88009f434380 x1830964746572032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.050511:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434380 with x1830964746572032 ext(3817472->3821567) 00002000:00010000:1.0:1746144658.050515:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434380 00000100:00100000:1.0:1746144658.050624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.050692:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746572160 00000100:00100000:2.0:1746144658.050696:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746572160 00000100:00100000:2.0:1746144658.050731:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11591 00000100:00100000:2.0:1746144658.050737:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29007:x1830964746572160:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.050749:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.050900:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e81e expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.050919:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.050920:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.050930:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 32 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.050941:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 32 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.050949:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428a000, rc 0) 00000100:00100000:2.0:1746144658.050981:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29007:x1830964746572160:12345-192.168.204.23@tcp:101:cat.0 Request processed in 244us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.050987:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11591 00000100:00100000:0.0:1746144658.052412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.052672:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746572416 00000100:00100000:1.0:1746144658.052678:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746572416 00000100:00100000:1.0:1746144658.052720:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4040 00000100:00100000:1.0:1746144658.052725:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29000:x1830964746572416:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144658.052922:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29000:x1830964746572416:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 196us (512us total) trans 8589943912 rc 0/0 00000100:00100000:1.0:1746144658.052928:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4040 00000100:00100000:2.0:1746144658.053253:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747451264:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.053271:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.053306:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746571776:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4191us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.053314:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5763 00000100:00100000:0.0:1746144658.054428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.054474:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746572672 00000100:00100000:2.0:1746144658.054480:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746572672 00002000:00100000:2.0:1746144658.054515:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f39b100 x1830964746572672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.054524:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b100 with x1830964746572672 ext(0->1048575) 00002000:00010000:2.0:1746144658.054528:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f39b100 00000100:00100000:2.0:1746144658.054551:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4384 00000100:00100000:2.0:1746144658.054557:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746572672:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144658.058434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.059280:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746572928 00000100:00100000:1.0:1746144658.059291:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746572928 00002000:00100000:1.0:1746144658.059343:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136449c00 x1830964746572928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.059354:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449c00 with x1830964746572928 ext(0->1048575) 00002000:00010000:1.0:1746144658.059360:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449c00 00000100:00100000:1.0:1746144658.059513:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4385 00000100:00100000:1.0:1746144658.059523:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746572928:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144658.065028:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746572672:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10460us (10591us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.065040:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4384 00002000:00100000:2.0:1746144658.065054:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f39b100 x1830964746572672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.065063:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b100 with x1830964746572672 ext(0->1048575) 00002000:00010000:2.0:1746144658.065069:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f39b100 00000100:00100000:1.0:1746144658.073840:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746572928:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14303us (15402us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144658.073854:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4385 00002000:00100000:1.0:1746144658.073869:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136449c00 x1830964746572928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.073878:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449c00 with x1830964746572928 ext(0->1048575) 00002000:00010000:1.0:1746144658.073885:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449c00 00000100:00100000:0.0:1746144658.082865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.083602:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746573056 00000100:00100000:2.0:1746144658.083612:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746573056 00000100:00100000:2.0:1746144658.083682:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11592 00000100:00100000:2.0:1746144658.083691:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+16:29004:x1830964746573056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.083712:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.083731:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e825 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.083763:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.083771:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.083772:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.083776:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.083808:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.083820:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 23 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.083832:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747451392:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.084702:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.089704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.089730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.089825:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746573184 00000100:00100000:3.0:1746144658.089829:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746573440 00000100:00100000:3.0:1746144658.089836:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746573440 00000100:00100000:1.0:1746144658.089836:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746573184 00000100:00100000:0.0:1746144658.089838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.089876:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746573696 00000100:00100000:3.0:1746144658.089879:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746573696 00002000:00100000:1.0:1746144658.089882:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3530752->3821567) req@ffff88012ce86300 x1830964746573184/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.089890:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86300 with x1830964746573184 ext(3530752->3821567) 00002000:00100000:3.0:1746144658.089895:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ce86a00 x1830964746573696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 504/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746144658.089898:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00002000:00100000:3.0:1746144658.089902:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86a00 with x1830964746573696 ext(3145728->4194303) 00010000:00010000:3.0:1746144658.089907:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.089909:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746144658.089914:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce86300 00010000:00010000:3.0:1746144658.089917:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:3.0:1746144658.089922:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce86a00 00000100:00100000:1.0:1746144658.089935:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 846 00000100:00100000:1.0:1746144658.089940:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746573184:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144658.090095:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747451392:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.090129:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.090205:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428ac00, rc 0) 00000100:00100000:0.0:1746144658.090327:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 847 00000100:00100000:0.0:1746144658.090339:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746573696:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:3.0:1746144658.090383:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ce85c00 x1830964746573440/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.090390:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85c00 with x1830964746573440 ext(2097152->3145727) 00010000:00010000:3.0:1746144658.090396:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.090407:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:3.0:1746144658.090414:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce85c00 00000100:00100000:3.0:1746144658.090433:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 848 00000100:00100000:3.0:1746144658.090444:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746573440:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144658.091933:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:29004:x1830964746573056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8241us (9077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.091941:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11592 00000100:00100000:1.0:1746144658.096259:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746573184:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6309us (6553us total) trans 21474840470 rc 0/0 00000100:00100000:1.0:1746144658.096268:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 846 00002000:00100000:1.0:1746144658.096279:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3530752->3821567) req@ffff88012ce86300 x1830964746573184/t21474840470(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.096287:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86300 with x1830964746573184 ext(3530752->3821567) 00010000:00010000:1.0:1746144658.096295:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.096309:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746144658.096315:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce86300 00000100:00100000:2.0:1746144658.098796:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746573696:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8451us (8947us total) trans 0 rc 757760/757760 00000100:00100000:2.0:1746144658.098807:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 847 00002000:00100000:2.0:1746144658.098818:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ce86a00 x1830964746573696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 504/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.098827:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86a00 with x1830964746573696 ext(3145728->4194303) 00010000:00010000:2.0:1746144658.098837:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 28 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.098852:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 28 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.098859:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce86a00 00000100:00100000:3.0:1746144658.100843:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746573440:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10395us (11103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144658.100854:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 848 00002000:00100000:3.0:1746144658.100865:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ce85c00 x1830964746573440/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.100874:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85c00 with x1830964746573440 ext(2097152->3145727) 00010000:00010000:3.0:1746144658.100883:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.100897:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:3.0:1746144658.100903:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce85c00 00000100:00100000:0.0:1746144658.106130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.106745:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746573824 00000100:00100000:2.0:1746144658.106756:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746573824 00000100:00100000:2.0:1746144658.106804:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11593 00000100:00100000:2.0:1746144658.106812:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29007:x1830964746573824:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.106834:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.106854:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e82c expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.106885:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.106888:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.106892:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.106905:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.106915:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380600, rc 0) 00000100:00100000:2.0:1746144658.107887:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29007:x1830964746573824:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1070us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.107895:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11593 00000100:00100000:2.0:1746144658.108123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.108218:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746573952 00000100:00100000:0.0:1746144658.108222:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746573952 00010000:00010000:0.0:1746144658.108248:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 27 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746144658.108281:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5764 00000100:00100000:0.0:1746144658.108288:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746573952:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.108300:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.108323:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 27 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.108335:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 27 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.108352:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e019ace lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3530752->3821567) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e7fb expref: 27 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.108368:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.108370:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.108376:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.108384:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.108392:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.108393:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.108396:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.108402:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.108429:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144658.108446:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce87480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747451520:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144658.108527:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144658.108536:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747451648:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144658.108555:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.113097:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce87480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747451520:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144658.113113:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747451648:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144658.113185:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.113247:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746573952:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4957us (5122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.113258:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5764 00000100:00100000:0.0:1746144658.113812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.113976:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746574208 00000100:00100000:3.0:1746144658.113984:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746574208 00002000:00100000:3.0:1746144658.114037:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ce85880 x1830964746574208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.114047:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85880 with x1830964746574208 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.114053:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85880 00000100:00100000:3.0:1746144658.114188:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4386 00000100:00100000:3.0:1746144658.114197:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746574208:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144658.118977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.119023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.119203:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746574464 00000100:00100000:2.0:1746144658.119212:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746574464 00002000:00100000:2.0:1746144658.119254:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ce85f80 x1830964746574464/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.119264:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85f80 with x1830964746574464 ext(2097152->3145727) 00002000:00010000:2.0:1746144658.119270:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85f80 00000100:00100000:2.0:1746144658.119302:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746574720 00000100:00100000:2.0:1746144658.119305:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746574720 00002000:00100000:2.0:1746144658.119316:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ce87100 x1830964746574720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.119329:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce87100 with x1830964746574720 ext(3145728->4194303) 00002000:00010000:2.0:1746144658.119331:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce87100 00000100:00100000:2.0:1746144658.119343:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4387 00000100:00100000:2.0:1746144658.119351:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746574464:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144658.119572:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4388 00000100:00100000:1.0:1746144658.119586:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746574720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144658.122645:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746574208:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8442us (8825us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144658.122657:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4386 00002000:00100000:3.0:1746144658.122670:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ce85880 x1830964746574208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.122680:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85880 with x1830964746574208 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.122685:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85880 00000100:00100000:3.0:1746144658.130886:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746574464:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11525us (11908us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144658.130893:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746574720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11312us (11868us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144658.130899:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4387 00000100:00100000:1.0:1746144658.130902:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4388 00002000:00100000:3.0:1746144658.130910:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012ce85f80 x1830964746574464/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.130910:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012ce87100 x1830964746574720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.130919:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85f80 with x1830964746574464 ext(2097152->3145727) 00002000:00100000:1.0:1746144658.130919:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce87100 with x1830964746574720 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.130925:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85f80 00002000:00010000:1.0:1746144658.130925:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce87100 00000100:00100000:0.0:1746144658.140287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.140357:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746574976 00000100:00100000:3.0:1746144658.140548:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746574976 00000100:00100000:3.0:1746144658.140616:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4041 00000100:00100000:3.0:1746144658.140626:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:29004:x1830964746574976:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144658.141359:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:29004:x1830964746574976:12345-192.168.204.23@tcp:35:cat.0 Request processed in 734us (1083us total) trans 8589943913 rc 0/0 00000100:00100000:3.0:1746144658.141366:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4041 00000100:00100000:0.0:1746144658.170259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.170444:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746575104 00000100:00100000:2.0:1746144658.170454:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746575104 00000100:00100000:2.0:1746144658.170509:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11594 00000100:00100000:2.0:1746144658.170518:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:29001:x1830964746575104:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.170539:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.170561:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e833 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.170591:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 6 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.170601:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.170609:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 25 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.170615:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.170616:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.170620:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.170656:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 25 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.170667:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 25 pid: 8389 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.170679:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747451776:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.171407:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.171416:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.171425:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747451904:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.171453:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 6 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.171461:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 6 pid: 10724 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.171469:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452032:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.171482:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.175471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.175490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.175500:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747451776:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.175512:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747451904:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.175518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.175519:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452032:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.175988:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1417216->2097151] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.176007:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1200, rc 0) 00000100:00100000:2.0:1746144658.176054:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:29001:x1830964746575104:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5537us (5930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.176063:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11594 00000100:00100000:1.0:1746144658.176279:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746575232 00000100:00100000:1.0:1746144658.176286:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746575232 00000100:00100000:0.0:1746144658.176293:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746575360 00000100:00100000:0.0:1746144658.176297:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746575360 00010000:00010000:1.0:1746144658.176316:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 7 pid: 10724 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.176318:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 26 pid: 8389 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746144658.176346:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746575488 00000100:00100000:1.0:1746144658.176348:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746575488 00010000:00010000:1.0:1746144658.176357:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.176384:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5765 00000100:00100000:0.0:1746144658.176392:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746575232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.176403:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.176427:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 7 pid: 10724 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.176443:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 7 pid: 10724 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746144658.176455:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5766 00000100:00100000:1.0:1746144658.176463:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746575360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.176470:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.176470:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e0198a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6a4 expref: 7 pid: 10724 timeout: 737 lvb_type: 1 00010000:00010000:1.0:1746144658.176478:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 26 pid: 8389 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.176486:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144658.176488:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 26 pid: 8389 timeout: 737 lvb_type: 1 00010000:00010000:1.0:1746144658.176501:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7eba00/0xa7c849b16e0198eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ea expref: 26 pid: 8389 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.176504:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746575232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 112us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.176510:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5765 00010000:00010000:1.0:1746144658.176513:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144658.176526:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5767 00000100:00100000:1.0:1746144658.176529:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746575360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 68us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.176531:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746575488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144658.176535:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5766 00010000:00010000:0.0:1746144658.176538:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.176546:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.176555:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.176565:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b20de00/0xa7c849b16e019907 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e70d expref: 18 pid: 7257 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.176578:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.176580:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.176587:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.176595:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.176622:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144658.176636:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747452160:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144658.176679:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.180208:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747452160:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.180245:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.180286:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746575488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3753us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.180296:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5767 00000100:00100000:0.0:1746144658.181874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.182009:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746575744 00000100:00100000:3.0:1746144658.182024:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746575744 00002000:00100000:3.0:1746144658.182192:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1417216->1421311) req@ffff88012ce86d80 x1830964746575744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.182203:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86d80 with x1830964746575744 ext(1417216->1421311) 00002000:00010000:3.0:1746144658.182207:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce86d80 00000100:00100000:3.0:1746144658.182233:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4389 00000100:00100000:3.0:1746144658.182241:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746575744:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.183473:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746575744:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1229us (1837us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144658.183482:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4389 00002000:00100000:3.0:1746144658.183491:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1417216->1421311) req@ffff88012ce86d80 x1830964746575744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.183500:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86d80 with x1830964746575744 ext(1417216->1421311) 00002000:00010000:3.0:1746144658.183503:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce86d80 00000100:00100000:0.0:1746144658.189564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.189798:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746575872 00000100:00100000:2.0:1746144658.189809:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746575872 00000100:00100000:2.0:1746144658.189866:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11595 00000100:00100000:2.0:1746144658.189875:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:29001:x1830964746575872:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.189895:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.189914:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e83a expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.189944:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 5 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.189956:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.189963:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 24 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.189968:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.189970:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.189973:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.190005:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 24 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.190017:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 24 pid: 8389 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.190028:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452288:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.190130:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.190181:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.190189:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452416:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.190232:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 5 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.190241:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 5 pid: 8453 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.190248:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452544:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.190271:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.191966:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452288:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.191977:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452416:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.191984:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452544:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.192015:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.192031:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418ee00, rc 0) 00000100:00100000:2.0:1746144658.192070:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:29001:x1830964746575872:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2196us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.192078:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11595 00000100:00100000:0.0:1746144658.193496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.193532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.193763:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746576000 00000100:00100000:2.0:1746144658.193769:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746576000 00000100:00100000:0.0:1746144658.193779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144658.193802:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 25 pid: 8389 timeout: 737 lvb_type: 1 00000100:00100000:3.0:1746144658.193893:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746576256 00000100:00100000:2.0:1746144658.193894:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746576128 00000100:00100000:2.0:1746144658.193896:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746576128 00000100:00100000:3.0:1746144658.193897:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746576256 00010000:00010000:2.0:1746144658.193909:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 6 pid: 8453 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1746144658.193926:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.193939:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5768 00000100:00100000:3.0:1746144658.193943:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5769 00000100:00100000:2.0:1746144658.193945:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746576000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144658.193948:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746576128:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.193958:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.193958:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144658.193979:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 6 pid: 8453 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1746144658.193981:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 25 pid: 8389 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1746144658.193991:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 25 pid: 8389 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.194013:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5770 00000100:00100000:0.0:1746144658.194020:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746576256:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.194027:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144658.194127:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 6 pid: 8453 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.194203:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1746144658.194215:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7eb800/0xa7c849b16e0198f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f1 expref: 25 pid: 8389 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1746144658.194230:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009418f600/0xa7c849b16e0198ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ab expref: 6 pid: 8453 timeout: 737 lvb_type: 1 00010000:00010000:2.0:1746144658.194236:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144658.194244:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.194264:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746576128:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 315us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.194264:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746576000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 319us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.194270:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5769 00000100:00100000:2.0:1746144658.194273:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5768 00010000:00010000:0.0:1746144658.194382:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.194394:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136916a00/0xa7c849b16e019915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e714 expref: 18 pid: 8450 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.194421:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.194423:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.194429:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.194436:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.194465:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144658.194477:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce87480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747452672:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144658.194535:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.196553:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce87480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747452672:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.196584:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.196624:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746576256:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2604us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.196633:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5770 00000100:00100000:0.0:1746144658.202442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.202572:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746576512 00000100:00100000:3.0:1746144658.202582:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746576512 00002000:00100000:3.0:1746144658.202642:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1363968->1368063) req@ffff88012ce87800 x1830964746576512/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.202652:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce87800 with x1830964746576512 ext(1363968->1368063) 00002000:00010000:3.0:1746144658.202657:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce87800 00000100:00100000:3.0:1746144658.202727:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4390 00000100:00100000:3.0:1746144658.202738:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746576512:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.202946:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746576512:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 210us (514us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144658.202952:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4390 00002000:00100000:3.0:1746144658.202958:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1363968->1368063) req@ffff88012ce87800 x1830964746576512/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.202964:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce87800 with x1830964746576512 ext(1363968->1368063) 00002000:00010000:3.0:1746144658.202968:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce87800 00000100:00100000:0.0:1746144658.206100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.206831:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746576768 00000100:00100000:3.0:1746144658.206841:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746576768 00000100:00100000:3.0:1746144658.206917:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4042 00000100:00100000:3.0:1746144658.206927:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:29001:x1830964746576768:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144658.207292:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:29001:x1830964746576768:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 367us (1200us total) trans 8589943914 rc 0/0 00000100:00100000:3.0:1746144658.207299:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4042 00000100:00100000:0.0:1746144658.267660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.267854:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746577024 00000100:00100000:1.0:1746144658.267865:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746577024 00000100:00100000:1.0:1746144658.267932:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10047 00000100:00100000:1.0:1746144658.267941:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:29015:x1830964746577024:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.267970:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.267989:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d000/0xa7c849b16e019b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e841 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.268108:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268121:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268174:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268188:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268193:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268198:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268300:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268308:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268313:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144658.268321:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144658.268406:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268413:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268419:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268425:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013490c200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.268428:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268435:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268445:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144658.268448:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144658.268452:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268457:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c200/0xa7c849b16e019b45 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268490:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268495:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268500:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268503:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013490d600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.268505:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268510:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268515:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144658.268517:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144658.268519:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268523:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e019b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268530:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268534:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268539:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268542:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013490c800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144658.268543:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268547:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268551:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9200) 00010000:00010000:1.0:1746144658.268553:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144658.268555:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268559:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013490c800/0xa7c849b16e019b3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144658.268590:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d000/0xa7c849b16e019b30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e841 expref: 21 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.268598:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d000/0xa7c849b16e019b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e841 expref: 21 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.268605:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013490d000, rc 0) 00000100:00100000:1.0:1746144658.268663:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:29015:x1830964746577024:12345-192.168.204.23@tcp:101:cat.0 Request processed in 722us (1015us total) trans 8589943915 rc 301/301 00000100:00100000:1.0:1746144658.268670:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10047 00000100:00100000:0.0:1746144658.276921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.276977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.277102:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746577280 00000100:00100000:3.0:1746144658.277113:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746577280 00002000:00100000:3.0:1746144658.277229:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1417215) req@ffff88012ce84a80 x1830964746577280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.277239:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84a80 with x1830964746577280 ext(1048576->1417215) 00002000:00010000:3.0:1746144658.277244:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84a80 00000100:00100000:1.0:1746144658.277824:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746577408 00000100:00100000:1.0:1746144658.277828:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746577408 00000100:00100000:2.0:1746144658.277875:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4391 00000100:00100000:2.0:1746144658.277888:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746577280:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:1.0:1746144658.279893:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1368064->2097151) req@ffff88012ce87480 x1830964746577408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.279911:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce87480 with x1830964746577408 ext(1368064->2097151) 00002000:00010000:1.0:1746144658.279916:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce87480 00000100:00100000:1.0:1746144658.279956:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4392 00000100:00100000:1.0:1746144658.279968:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746577408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144658.288074:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746577408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8100us (11084us total) trans 0 rc 729088/729088 00000100:00100000:1.0:1746144658.288085:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4392 00002000:00100000:1.0:1746144658.288097:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1368064->2097151) req@ffff88012ce87480 x1830964746577408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 729088/729088 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.288111:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce87480 with x1830964746577408 ext(1368064->2097151) 00002000:00010000:1.0:1746144658.288118:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce87480 00000100:00100000:2.0:1746144658.288380:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746577280:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10495us (11468us total) trans 0 rc 368640/368640 00000100:00100000:2.0:1746144658.288387:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4391 00002000:00100000:2.0:1746144658.288392:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1417215) req@ffff88012ce84a80 x1830964746577280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.288398:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84a80 with x1830964746577280 ext(1048576->1417215) 00002000:00010000:2.0:1746144658.288402:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84a80 00000100:00100000:0.0:1746144658.289931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.291958:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746577792 00000100:00100000:3.0:1746144658.291971:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746577792 00000100:00100000:3.0:1746144658.292058:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10048 00000100:00100000:3.0:1746144658.292069:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29017:x1830964746577792:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.292111:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.292162:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019b53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e848 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.292299:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292313:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292329:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292344:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292349:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292354:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292756:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292765:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292771:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144658.292780:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.292862:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292868:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292874:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292880:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.292884:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292890:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292901:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.292904:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144658.292908:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.292912:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019b68 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294075:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294083:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294088:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294093:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.294096:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294101:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294111:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144658.294113:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.294116:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294120:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019b5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294206:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294212:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294216:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294220:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.294222:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294226:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294233:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639900) 00010000:00010000:3.0:1746144658.294235:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.294237:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294241:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019b61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.294293:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019b53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e848 expref: 309 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.294299:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019b53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e848 expref: 309 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.294306:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b200, rc 0) 00000100:00100000:3.0:1746144658.294557:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29017:x1830964746577792:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2488us (4626us total) trans 8589943916 rc 301/301 00000100:00100000:3.0:1746144658.294566:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10048 00000100:00100000:0.0:1746144658.304530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.304675:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746578048 00000100:00100000:1.0:1746144658.304686:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746578048 00000100:00100000:1.0:1746144658.304799:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4043 00000100:00100000:1.0:1746144658.304807:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:29015:x1830964746578048:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144658.307288:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+21:29015:x1830964746578048:12345-192.168.204.23@tcp:35:cat.0 Request processed in 2472us (2758us total) trans 8589943917 rc 0/0 00000100:00100000:1.0:1746144658.307303:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4043 00000100:00100000:0.0:1746144658.330018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.333873:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746578304 00000100:00100000:1.0:1746144658.333887:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746578304 00000100:00100000:1.0:1746144658.333953:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4044 00000100:00100000:1.0:1746144658.333961:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:28974:x1830964746578304:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:1.0:1746144658.334209:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28974:x1830964746578304:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 249us (4204us total) trans 8589943918 rc 0/0 00000100:00100000:1.0:1746144658.334216:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4044 00000100:00100000:0.0:1746144658.340210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.340327:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746578560 00000100:00100000:3.0:1746144658.340337:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746578560 00000100:00100000:3.0:1746144658.340421:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10049 00000100:00100000:3.0:1746144658.340430:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:29020:x1830964746578560:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.340458:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.340476:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019b76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e84f expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.340586:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340598:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340608:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340620:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340626:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340631:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340728:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019b8b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340740:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019b8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340747:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019b8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144658.340755:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.340833:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340840:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340846:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340851:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29ac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.340855:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340861:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340870:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144658.340873:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.340877:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340881:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019b7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340910:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340920:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340925:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340929:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29be00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.340931:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340935:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340940:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639700) 00010000:00010000:3.0:1746144658.340942:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.340943:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340947:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019b84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144658.340980:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019b76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e84f expref: 24 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.340991:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019b8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e84f expref: 23 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.340997:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.340998:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144658.341001:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a000, rc 0) 00000100:00100000:3.0:1746144658.341045:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:29020:x1830964746578560:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 616us (845us total) trans 8589943919 rc 0/0 00000100:00100000:3.0:1746144658.341052:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10049 00000100:00100000:1.0:1746144658.344041:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746144658.344063:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747452800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144658.344162:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144658.344296:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747452800 00000100:00100000:0.0:1746144658.344305:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747452800 00000100:00100000:1.0:1746144658.344348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.344358:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1746144658.344365:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747452800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746144658.344390:0:8455:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 3407872 granted 410320896 pending 15335424 free 3853516800 avail 3851419648 00000100:00100000:0.0:1746144658.344430:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747452800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.344436:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1746144658.344448:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746578816 00000100:00100000:2.0:1746144658.344452:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746578816 00000100:00100000:2.0:1746144658.344486:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4045 00000100:00100000:2.0:1746144658.344492:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:28974:x1830964746578816:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:2.0:1746144658.344677:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:28974:x1830964746578816:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 185us (333us total) trans 8589943920 rc 0/0 00000100:00100000:2.0:1746144658.344683:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4045 00000100:00100000:1.0:1746144658.346511:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747452800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144658.350347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.350387:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746578944 00000100:00100000:1.0:1746144658.350397:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746578944 00000100:00100000:1.0:1746144658.350856:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 623 00000100:00100000:1.0:1746144658.350866:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746578944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.350883:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.350910:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019b8b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e84f expref: 23 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.350935:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144658.350940:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.350982:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746578944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 118us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.350990:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 623 00000100:00100000:0.0:1746144658.358830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.358882:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746579072 00000100:00100000:2.0:1746144658.358893:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746579072 00000100:00100000:2.0:1746144658.358953:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11596 00000100:00100000:2.0:1746144658.358963:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:29020:x1830964746579072:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.358983:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.359002:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e856 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.359033:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.359046:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.359052:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.359054:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.359058:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2441216->2686975] (req 2441216->2686975) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.359087:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.359099:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 23 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.359111:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452928:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.359249:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.359257:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.359265:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747453056:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.359283:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.359478:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746144658.359489:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747453184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746144658.359521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144658.359549:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747453184 00000100:00100000:1.0:1746144658.359552:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747453184 00000100:00100000:1.0:1746144658.359576:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746144658.359581:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3294:x1830964747453184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746144658.359595:0:8455:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 434044928 pending 17039360 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746144658.359626:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3294:x1830964747453184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.359632:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746144658.359670:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747453184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746144658.359806:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1830964747453568:0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.359830:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144658.359844:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746144658.359848:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830964747453440:0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.359859:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144658.359874:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747453568 00000100:00100000:3.0:1746144658.359876:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747453568 00000100:00100000:3.0:1746144658.359914:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747453440 00000100:00100000:3.0:1746144658.359915:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747453440 00000100:00100000:3.0:1746144658.359932:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1746144658.359937:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830964747453568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.359959:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830964747453568:12345-0@lo:400:kworker.0 Request processed in 23us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.359964:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1746144658.359972:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1746144658.359976:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830964747453440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.359991:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830964747453440:12345-0@lo:400:kworker.0 Request processed in 15us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.359995:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1746144658.360013:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1830964747453440:0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.360019:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1830964747453568:0@lo:400:kworker.0 00000100:00080000:3.0:1746144658.360043:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144658.360093:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830964747453696:0@lo:400:kworker.0 00000100:00100000:2.0:1746144658.360115:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144658.360126:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746144658.360153:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3293:1830964747453312:0@lo:400:kworker.0 00000100:00100000:2.0:1746144658.360172:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144658.360197:0:14704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747453312 00000100:00100000:2.0:1746144658.360200:0:14704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747453312 00000100:00100000:2.0:1746144658.360221:0:14704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1746144658.360225:0:14704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013643dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3293:x1830964747453312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144658.360249:0:14704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013643dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3293:x1830964747453312:12345-0@lo:400:kworker.0 Request processed in 23us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.360255:0:14704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1746144658.360282:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3293:1830964747453312:0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.360689:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747453696 00000100:00100000:3.0:1746144658.360693:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747453696 00000100:00100000:3.0:1746144658.361156:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1746144658.361164:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830964747453696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144658.362459:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830964747453696:12345-0@lo:400:kworker.0 Request processed in 1292us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.362468:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1746144658.362583:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830964747453696:0@lo:400:kworker.0 00000100:00100000:2.0:1746144658.362817:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747452928:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.362827:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747453056:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.363186:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2441216->2686975] (req 2441216->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.363206:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1400, rc 0) 00000100:00100000:2.0:1746144658.363257:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:29020:x1830964746579072:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4295us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.363264:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11596 00000100:00100000:0.0:1746144658.366296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.366351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.366491:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746579200 00000100:00100000:1.0:1746144658.366501:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746579200 00010000:00010000:1.0:1746144658.366542:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.366581:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746579328 00000100:00100000:1.0:1746144658.366584:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746579328 00010000:00010000:1.0:1746144658.366594:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 24 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.366610:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5771 00000100:00100000:1.0:1746144658.366617:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746579200:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.366631:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.366656:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.366667:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.366690:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b428ac00/0xa7c849b16e019b14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e825 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.366709:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.366711:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5772 00000100:00100000:2.0:1746144658.366722:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746579328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.366735:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.366746:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 24 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.366749:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746579200:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 132us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.366756:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5771 00010000:00010000:2.0:1746144658.366757:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 24 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.366769:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e019b1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e82c expref: 24 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.366785:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.366787:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.366794:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.366801:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.366836:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.366848:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747453824:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144658.366902:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.378862:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747453824:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.378892:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.378952:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746579328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 12231us (12598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.378964:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5772 00000100:00100000:0.0:1746144658.381178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.381252:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746579584 00000100:00100000:3.0:1746144658.381261:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746579584 00000100:00100000:3.0:1746144658.381320:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10050 00000100:00100000:3.0:1746144658.381330:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29024:x1830964746579584:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.381357:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.381376:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019ba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e85d expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.381498:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381511:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381522:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381534:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381539:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381544:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381648:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019bb5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381657:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381663:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144658.381671:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.381754:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381761:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381766:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381772:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29aa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.381776:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381782:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381793:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144658.381796:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.381800:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381806:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381838:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381848:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381852:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381856:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.381858:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381863:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381869:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639700) 00010000:00010000:3.0:1746144658.381871:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.381873:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381878:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019bae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.381912:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019ba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e85d expref: 311 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.381923:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e85d expref: 310 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.381930:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.381932:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144658.381934:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29be00, rc 0) 00000100:00100000:3.0:1746144658.381983:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29024:x1830964746579584:12345-192.168.204.23@tcp:101:cat.0 Request processed in 655us (856us total) trans 8589943921 rc 0/0 00000100:00100000:3.0:1746144658.381989:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10050 00000100:00100000:0.0:1746144658.395530:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.402324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.402427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.402472:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746579968 00000100:00100000:0.0:1746144658.402480:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746579968 00000100:00100000:0.0:1746144658.402525:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 624 00000100:00100000:0.0:1746144658.402532:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1963:x1830964746579968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.402545:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.402570:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019bb5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e85d expref: 310 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.402597:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144658.402601:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144658.402648:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1963:x1830964746579968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 117us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.402654:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 624 00000100:00100000:2.0:1746144658.403047:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746579840 00000100:00100000:2.0:1746144658.403052:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746579840 00002000:00100000:2.0:1746144658.403095:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2441216->2445311) req@ffff880093989180 x1830964746579840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.403106:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989180 with x1830964746579840 ext(2441216->2445311) 00002000:00010000:2.0:1746144658.403111:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093989180 00000100:00100000:3.0:1746144658.404180:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746580224 00000100:00100000:3.0:1746144658.404186:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746580224 00000100:00100000:1.0:1746144658.404191:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4393 00000100:00100000:1.0:1746144658.404203:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746579840:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.404229:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4046 00000100:00100000:3.0:1746144658.404236:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29024:x1830964746580224:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144658.404369:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746579840:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 170us (8852us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144658.404375:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4393 00002000:00100000:1.0:1746144658.404381:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2441216->2445311) req@ffff880093989180 x1830964746579840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.404388:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989180 with x1830964746579840 ext(2441216->2445311) 00002000:00010000:1.0:1746144658.404392:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093989180 00000100:00100000:3.0:1746144658.404409:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29024:x1830964746580224:12345-192.168.204.23@tcp:35:cat.0 Request processed in 174us (2096us total) trans 8589943922 rc 0/0 00000100:00100000:3.0:1746144658.404415:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4046 00000100:00100000:0.0:1746144658.410723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.410766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.410814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.410914:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746580352 00000100:00100000:2.0:1746144658.410925:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746580352 00000100:00100000:3.0:1746144658.410953:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746580480 00000100:00100000:3.0:1746144658.410957:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746580480 00000100:00100000:2.0:1746144658.410981:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746580608 00000100:00100000:2.0:1746144658.410984:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746580608 00000100:00100000:3.0:1746144658.410991:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11597 00000100:00100000:3.0:1746144658.410998:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746580352:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144658.411004:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11598 00000100:00100000:2.0:1746144658.411010:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746580480:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.411018:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.411018:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.411036:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019bc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e864 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.411036:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019bca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e86b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.411087:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747454080:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.411087:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747453952:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.411204:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.411222:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11599 00000100:00100000:2.0:1746144658.411228:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746580608:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.411234:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.411241:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1600/0xa7c849b16e019bd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e872 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.411263:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747454208:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144658.412311:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.412796:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.415114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:2.0:1746144658.415646:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144657 -> 1746144659 00002000:00010000:2.0:1746144658.415651:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144657 -> 1746144659 00002000:00010000:2.0:1746144658.415653:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144657 -> 1746144659 00000100:00100000:2.0:1746144658.415675:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747453952:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144658.415708:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019bca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e86b expref: 28 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.415723:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019bca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e86b expref: 28 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.415744:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1000, rc 0) 00000100:00100000:2.0:1746144658.415784:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746580480:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4773us (5017us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.415791:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11598 00000100:00100000:1.0:1746144658.415812:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746580864 00000100:00100000:1.0:1746144658.415820:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746580864 00002000:00100000:1.0:1746144658.415865:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2682880->2686975) req@ffff880092937b80 x1830964746580864/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.415879:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092937b80 with x1830964746580864 ext(2682880->2686975) 00002000:00010000:1.0:1746144658.415884:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092937b80 00002000:00010000:3.0:1746144658.415897:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144657 -> 1746144659 00002000:00010000:3.0:1746144658.415900:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144657 -> 1746144659 00002000:00010000:3.0:1746144658.415902:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144657 -> 1746144659 00000100:00100000:1.0:1746144658.415904:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4394 00000100:00100000:3.0:1746144658.415912:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747454080:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144658.415914:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746580864:12345-192.168.204.23@tcp:3:multiop.0 00010000:00010000:3.0:1746144658.415939:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019bc3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e864 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.415953:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019bc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e864 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.415963:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ac00, rc 0) 00000100:00100000:3.0:1746144658.415981:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746580352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4983us (5268us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144658.415985:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11597 00002000:00010000:0.0:1746144658.416108:0:4760:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144658 -> 1746144659 00002000:00010000:0.0:1746144658.416112:0:4760:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144658 -> 1746144659 00002000:00010000:0.0:1746144658.416114:0:4760:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144658 -> 1746144659 00000100:00100000:0.0:1746144658.416162:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747454208:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144658.416183:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1600/0xa7c849b16e019bd1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e872 expref: 24 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.416193:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1600/0xa7c849b16e019bd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e872 expref: 24 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.416314:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1600, rc 0) 00000100:00100000:1.0:1746144658.416419:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746580864:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 505us (1314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144658.416426:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4394 00002000:00100000:1.0:1746144658.416432:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2682880->2686975) req@ffff880092937b80 x1830964746580864/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.416438:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092937b80 with x1830964746580864 ext(2682880->2686975) 00002000:00010000:1.0:1746144658.416441:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092937b80 00000100:00100000:0.0:1746144658.416526:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746580608:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5296us (5709us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144658.416533:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11599 00000100:00100000:0.0:1746144658.424293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.424401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.424488:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746580992 00000100:00100000:2.0:1746144658.424498:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746580992 00000100:00100000:2.0:1746144658.424549:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11600 00000100:00100000:2.0:1746144658.424558:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29024:x1830964746580992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.424578:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.424596:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e879 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.424628:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.424642:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.424644:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.424647:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.424678:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 16 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.424691:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 16 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.424704:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747454336:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.424796:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144658.424857:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746581248 00000100:00100000:3.0:1746144658.424861:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746581248 00000100:00100000:3.0:1746144658.424899:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4047 00000100:00100000:3.0:1746144658.424905:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+22:29020:x1830964746581248:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144658.427103:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:29020:x1830964746581248:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 2188us (2691us total) trans 8589943923 rc 0/0 00000100:00100000:3.0:1746144658.427115:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4047 00000100:00100000:0.0:1746144658.431288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.432175:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746581504 00000100:00100000:3.0:1746144658.432185:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746581504 00000100:00100000:3.0:1746144658.432250:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10051 00000100:00100000:3.0:1746144658.432258:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:29027:x1830964746581504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.432278:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.432299:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019bdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e880 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.432390:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.432409:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.432418:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144658.432428:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.432530:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e019bdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 26 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.432555:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 25 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.432563:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.432565:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746144658.432568:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a200, rc 0) 00000100:00100000:3.0:1746144658.432608:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:29027:x1830964746581504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 351us (1331us total) trans 8589943924 rc 0/0 00000100:00100000:3.0:1746144658.432613:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10051 00000100:00100000:1.0:1746144658.432640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.432657:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746581632 00000100:00100000:3.0:1746144658.432660:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746581632 00000100:00100000:3.0:1746144658.432679:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11601 00000100:00100000:3.0:1746144658.432685:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29017:x1830964746581632:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.432693:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.432704:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e887 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.432929:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747454336:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.432953:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.432966:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418fc00, rc 0) 00000100:00100000:2.0:1746144658.432996:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29024:x1830964746580992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8441us (8716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.433001:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11600 00000100:00100000:1.0:1746144658.433404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.433422:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746581760 00000100:00100000:1.0:1746144658.433425:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746581760 00002000:00100000:1.0:1746144658.433454:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1417216->2097151) req@ffff88009f39b480 x1830964746581760/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.433462:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b480 with x1830964746581760 ext(1417216->2097151) 00010000:00010000:1.0:1746144658.433469:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 17 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.433480:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 17 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:1.0:1746144658.433491:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f39b480 00000100:00100000:1.0:1746144658.433504:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 849 00000100:00100000:1.0:1746144658.433510:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746581760:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144658.434364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.434755:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746581888 00000100:00100000:2.0:1746144658.434761:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746581888 00000100:00100000:2.0:1746144658.434799:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11602 00000100:00100000:2.0:1746144658.434805:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746581888:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.434818:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.434830:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019bfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e88e expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.434885:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747454464:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.434954:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746144658.435702:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.435712:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.435719:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.435721:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.435724:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.435817:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.435828:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 32 pid: 4758 timeout: 737 lvb_type: 1 00000100:00100000:3.0:1746144658.435838:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747454592:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.437991:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.438009:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 17 pid: 7257 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.438024:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747454720:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144658.438335:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.438344:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747454464:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144658.438350:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747454592:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.438377:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019bfb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e88e expref: 20 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.438394:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019bfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e88e expref: 20 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.438414:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1000, rc 0) 00000100:00100000:2.0:1746144658.438444:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746581888:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3637us (4080us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.438452:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11602 00000100:00100000:0.0:1746144658.443601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.443627:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746582144 00000100:00100000:0.0:1746144658.443635:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746582144 00010000:00010000:0.0:1746144658.443670:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 33 pid: 4758 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.443702:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5773 00000100:00100000:0.0:1746144658.443711:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746582144:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.443738:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.443761:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 33 pid: 4758 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.443772:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 33 pid: 4758 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.443794:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e0199ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e78b expref: 33 pid: 4758 timeout: 737 lvb_type: 1 00010000:00010000:0.0:1746144658.443812:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144658.443851:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746582144:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 141us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.443858:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5773 00000100:00100000:3.0:1746144658.444038:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747454720:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.444079:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.444090:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a600, rc 0) 00000100:00100000:3.0:1746144658.444114:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29017:x1830964746581632:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 11430us (11476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.444120:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11601 00000100:00100000:0.0:1746144658.446027:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746581760:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 12507us (12614us total) trans 21474840471 rc 0/0 00000100:00100000:0.0:1746144658.446039:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 849 00002000:00100000:0.0:1746144658.446051:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1417216->2097151) req@ffff88009f39b480 x1830964746581760/t21474840471(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144658.446061:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b480 with x1830964746581760 ext(1417216->2097151) 00010000:00010000:0.0:1746144658.446070:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.446083:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746144658.446095:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f39b480 00000100:00100000:0.0:1746144658.451614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.451959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.452722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.452779:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746582016 00000100:00100000:1.0:1746144658.452789:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746582016 00010000:00010000:1.0:1746144658.452835:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 18 pid: 7257 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.452867:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746582272 00000100:00100000:3.0:1746144658.452871:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746582272 00000100:00100000:3.0:1746144658.453090:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11603 00000100:00100000:3.0:1746144658.453100:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:29027:x1830964746582272:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.453117:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.453153:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e895 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.453177:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.453180:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.453186:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.453201:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.453210:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a800, rc 0) 00000100:00100000:3.0:1746144658.453260:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:29027:x1830964746582272:12345-192.168.204.23@tcp:101:cat.0 Request processed in 163us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.453270:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11603 00000100:00100000:1.0:1746144658.453441:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746582400 00000100:00100000:1.0:1746144658.453444:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746582400 00010000:00010000:1.0:1746144658.453459:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.453497:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5774 00000100:00100000:2.0:1746144658.453506:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746582016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.453516:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.453540:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 19 pid: 7257 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.453550:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 19 pid: 7257 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.453571:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffff800/0xa7c849b16e01998c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e768 expref: 19 pid: 7257 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.453585:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.453587:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.453592:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144658.453761:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5775 00000100:00100000:0.0:1746144658.453768:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746582400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.453776:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.453791:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.453800:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.453811:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1200/0xa7c849b16e019b22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1417216->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e833 expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.453824:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.453825:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.453829:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.453835:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.453866:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 23 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144658.453878:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747454848:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144658.453929:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00010000:00010000:2.0:1746144658.454024:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.454043:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.454051:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747454976:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144658.454073:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144658.457521:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747454976:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144658.457545:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.457596:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746582016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4091us (5992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.457607:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5774 00000100:00100000:2.0:1746144658.458884:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747454848:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.458910:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.458945:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746582400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5178us (6223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.458953:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5775 00000100:00100000:0.0:1746144658.460301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.460667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.460745:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583040 00000100:00100000:1.0:1746144658.460754:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583040 00002000:00100000:1.0:1746144658.460808:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880092936d80 x1830964746583040/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.460817:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936d80 with x1830964746583040 ext(1048576->2097151) 00002000:00010000:1.0:1746144658.460822:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092936d80 00000100:00100000:1.0:1746144658.460854:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4395 00000100:00100000:1.0:1746144658.460861:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746583040:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.461232:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746582656 00000100:00100000:3.0:1746144658.461237:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746582656 00000100:00100000:3.0:1746144658.461278:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11604 00000100:00100000:3.0:1746144658.461285:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29017:x1830964746582656:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.461295:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.461312:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e89c expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.461338:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.461345:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144658.461346:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144658.461349:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3821567] (req 3145728->3821567) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.461375:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.461385:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 17 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.461396:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747455104:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144658.461457:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.461666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.461734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.461966:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583168 00000100:00100000:3.0:1746144658.461970:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583168 00002000:00100000:3.0:1746144658.461997:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092935f80 x1830964746583168/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.462004:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935f80 with x1830964746583168 ext(2097152->3145727) 00002000:00010000:3.0:1746144658.462008:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935f80 00000100:00100000:3.0:1746144658.462027:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583296 00000100:00100000:3.0:1746144658.462030:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583296 00002000:00100000:3.0:1746144658.462044:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880092935c00 x1830964746583296/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 504/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.462051:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935c00 with x1830964746583296 ext(2097152->3145727) 00010000:00010000:3.0:1746144658.462056:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.462066:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 18 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:3.0:1746144658.462072:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092935c00 00000100:00100000:3.0:1746144658.462437:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 850 00000100:00100000:3.0:1746144658.462446:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746583296:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144658.462530:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4396 00000100:00100000:2.0:1746144658.462540:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746583168:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144658.468659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.468787:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583424 00000100:00100000:2.0:1746144658.468801:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583424 00002000:00100000:2.0:1746144658.468854:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2441216->2686975) req@ffff880092937480 x1830964746583424/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.468865:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092937480 with x1830964746583424 ext(2441216->2686975) 00010000:00010000:2.0:1746144658.468874:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 20 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.468888:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 20 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.468895:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092937480 00000100:00100000:2.0:1746144658.468918:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 851 00000100:00100000:2.0:1746144658.468924:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746583424:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144658.469586:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747455104:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.469636:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3821567] (req 3145728->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.469652:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ba00, rc 0) 00000100:00100000:3.0:1746144658.470502:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29017:x1830964746582656:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 9215us (10201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.470511:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11604 00000100:00100000:1.0:1746144658.472633:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746583040:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11762us (11955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144658.472646:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4395 00002000:00100000:1.0:1746144658.472658:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880092936d80 x1830964746583040/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.472668:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936d80 with x1830964746583040 ext(1048576->2097151) 00002000:00010000:1.0:1746144658.472673:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092936d80 00000100:00100000:3.0:1746144658.476831:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746583296:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14376us (15086us total) trans 0 rc 802816/802816 00000100:00100000:3.0:1746144658.476844:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 850 00002000:00100000:3.0:1746144658.476857:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880092935c00 x1830964746583296/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 504/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.476867:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935c00 with x1830964746583296 ext(2097152->3145727) 00010000:00010000:3.0:1746144658.476878:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 20 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.476896:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 20 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:3.0:1746144658.476903:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092935c00 00000100:00100000:2.0:1746144658.477074:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746583168:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14535us (15407us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.477082:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4396 00002000:00100000:2.0:1746144658.477088:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092935f80 x1830964746583168/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.477096:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935f80 with x1830964746583168 ext(2097152->3145727) 00002000:00010000:2.0:1746144658.477100:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935f80 00000100:00100000:0.0:1746144658.478357:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746583424:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9426us (9699us total) trans 21474840472 rc 0/0 00000100:00100000:0.0:1746144658.478365:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 851 00002000:00100000:0.0:1746144658.478373:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2441216->2686975) req@ffff880092937480 x1830964746583424/t21474840472(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144658.478381:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092937480 with x1830964746583424 ext(2441216->2686975) 00010000:00010000:0.0:1746144658.478388:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 20 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.478402:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 20 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746144658.478408:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092937480 00000100:00100000:0.0:1746144658.483704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.483916:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583552 00000100:00100000:3.0:1746144658.483925:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583552 00000100:00100000:3.0:1746144658.483975:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11605 00000100:00100000:3.0:1746144658.483981:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29024:x1830964746583552:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.483999:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.484017:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8a3 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.484044:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.484049:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144658.484050:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144658.484053:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.484078:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.484085:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 19 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.484094:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747455232:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144658.484265:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.485525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.485557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.485657:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583808 00000100:00100000:1.0:1746144658.485664:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583808 00000100:00100000:1.0:1746144658.485704:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11606 00000100:00100000:1.0:1746144658.485712:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:29027:x1830964746583808:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.485727:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.485741:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8aa expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.485763:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144658.485765:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144658.485768:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.485779:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.485789:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013490d600, rc 0) 00000100:00100000:1.0:1746144658.485824:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:29027:x1830964746583808:12345-192.168.204.23@tcp:101:cat.0 Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.485831:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11606 00000100:00100000:2.0:1746144658.485907:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583680 00000100:00100000:2.0:1746144658.485911:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583680 00010000:00010000:2.0:1746144658.485931:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 21 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.485951:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5776 00000100:00100000:2.0:1746144658.485957:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746583680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.485965:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.485988:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 21 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.485998:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747455232:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.485998:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 21 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.486015:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2c1400/0xa7c849b16e019b99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2441216->2686975) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e856 expref: 21 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.486029:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.486035:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.486037:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.486041:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b200, rc 0) 00010000:00010000:2.0:1746144658.486043:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.486051:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.486057:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.486059:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.486062:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.486068:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.486079:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29024:x1830964746583552:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2097us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.486085:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11605 00010000:00010000:2.0:1746144658.486088:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.486098:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747455360:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.486183:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.486191:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747455488:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144658.486207:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.488477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.488540:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746583936 00000100:00100000:2.0:1746144658.488548:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746583936 00002000:00100000:2.0:1746144658.488588:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1368063) req@ffff88009f270e00 x1830964746583936/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.488598:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f270e00 with x1830964746583936 ext(1048576->1368063) 00010000:00010000:2.0:1746144658.488606:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 21 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.488620:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 21 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.488627:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f270e00 00000100:00100000:2.0:1746144658.488652:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 852 00000100:00100000:2.0:1746144658.488658:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746583936:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144658.490345:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747455360:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144658.490355:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747455488:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.490375:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.490412:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746583680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4454us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.490422:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5776 00000100:00100000:0.0:1746144658.490929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.491161:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746584192 00000100:00100000:2.0:1746144658.491168:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746584192 00002000:00100000:2.0:1746144658.491204:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f271880 x1830964746584192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.491214:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271880 with x1830964746584192 ext(2097152->3145727) 00002000:00010000:2.0:1746144658.491218:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f271880 00000100:00100000:2.0:1746144658.491251:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4397 00000100:00100000:2.0:1746144658.491259:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746584192:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144658.494091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.494167:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746584448 00000100:00100000:3.0:1746144658.494177:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746584448 00002000:00100000:3.0:1746144658.494229:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3817472->3821567) req@ffff88012ce84380 x1830964746584448/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.494240:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84380 with x1830964746584448 ext(3817472->3821567) 00002000:00010000:3.0:1746144658.494245:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84380 00000100:00100000:3.0:1746144658.494266:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4398 00000100:00100000:3.0:1746144658.494275:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746584448:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.494411:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746584448:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 137us (330us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144658.494417:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4398 00002000:00100000:3.0:1746144658.494422:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3817472->3821567) req@ffff88012ce84380 x1830964746584448/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.494429:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84380 with x1830964746584448 ext(3817472->3821567) 00002000:00010000:3.0:1746144658.494431:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84380 00000100:00100000:2.0:1746144658.494548:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746583936:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5889us (6076us total) trans 21474840473 rc 0/0 00000100:00100000:2.0:1746144658.494556:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 852 00002000:00100000:2.0:1746144658.494562:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1368063) req@ffff88009f270e00 x1830964746583936/t21474840473(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.494569:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f270e00 with x1830964746583936 ext(1048576->1368063) 00010000:00010000:2.0:1746144658.494578:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 24 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.494593:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 24 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.494598:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f270e00 00000100:00100000:2.0:1746144658.501008:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746584192:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9006us (9336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.501022:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4397 00002000:00100000:2.0:1746144658.501036:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f271880 x1830964746584192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.501045:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271880 with x1830964746584192 ext(2097152->3145727) 00000100:00100000:0.0:1746144658.501078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.501175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.501183:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746584576 00000100:00100000:3.0:1746144658.501192:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746584576 00010000:00010000:3.0:1746144658.501235:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 23 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.501271:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5777 00000100:00100000:3.0:1746144658.501278:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746584576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.501293:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144658.501313:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 23 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.501331:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 23 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.501353:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009418ee00/0xa7c849b16e019b29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e83a expref: 23 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.501359:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f271880 00010000:00010000:3.0:1746144658.501370:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.501372:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.501379:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.501388:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.501416:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.501427:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747455616:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144658.501480:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.501904:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746584832 00000100:00100000:0.0:1746144658.501908:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746584832 00000100:00100000:0.0:1746144658.501945:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4048 00000100:00100000:0.0:1746144658.501951:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29017:x1830964746584832:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:0.0:1746144658.502703:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29017:x1830964746584832:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 750us (1526us total) trans 8589943925 rc 0/0 00000100:00100000:0.0:1746144658.502710:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4048 00000100:00100000:0.0:1746144658.504758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.504851:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746584960 00000100:00100000:2.0:1746144658.504861:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746584960 00000100:00100000:2.0:1746144658.504918:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11607 00000100:00100000:2.0:1746144658.504927:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:29027:x1830964746584960:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.504948:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.504966:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8b1 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.504983:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747455616:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144658.504995:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.505003:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.505005:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144658.505009:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.505015:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144658.505035:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.505047:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 30 pid: 8450 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.505054:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746584576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3776us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.505062:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5777 00000100:00100000:2.0:1746144658.505065:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747455744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.506055:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.507192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.507330:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746585216 00000100:00100000:2.0:1746144658.507339:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746585216 00002000:00100000:2.0:1746144658.507390:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f271500 x1830964746585216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.507400:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271500 with x1830964746585216 ext(1048576->2097151) 00002000:00010000:2.0:1746144658.507405:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f271500 00000100:00100000:2.0:1746144658.507426:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4399 00000100:00100000:2.0:1746144658.507434:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746585216:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.507451:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747455744:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.507481:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.507496:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e3bd400, rc 0) 00000100:00100000:3.0:1746144658.507934:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:29027:x1830964746584960:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3008us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.507942:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11607 00000100:00100000:0.0:1746144658.508025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.508089:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746585344 00000100:00100000:0.0:1746144658.508092:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746585344 00002000:00100000:0.0:1746144658.508111:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4075520->4194303) req@ffff88009f273480 x1830964746585344/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144658.508118:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f273480 with x1830964746585344 ext(4075520->4194303) 00010000:00010000:0.0:1746144658.508124:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.508329:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 31 pid: 8450 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746144658.508336:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f273480 00000100:00100000:0.0:1746144658.508442:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 853 00000100:00100000:0.0:1746144658.508447:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746585344:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144658.511117:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746585344:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 2658us (3080us total) trans 17179873229 rc 0/0 00000100:00100000:0.0:1746144658.511157:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 853 00002000:00100000:0.0:1746144658.511172:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4075520->4194303) req@ffff88009f273480 x1830964746585344/t17179873229(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144658.511182:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f273480 with x1830964746585344 ext(4075520->4194303) 00010000:00010000:0.0:1746144658.511193:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 33 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:0.0:1746144658.511208:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 33 pid: 8450 timeout: 737 lvb_type: 0 00002000:00010000:0.0:1746144658.511215:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f273480 00000100:00100000:2.0:1746144658.515369:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746585216:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 7923us (8170us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.515381:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4399 00002000:00100000:2.0:1746144658.515394:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f271500 x1830964746585216/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.515403:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271500 with x1830964746585216 ext(1048576->2097151) 00002000:00010000:2.0:1746144658.515409:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f271500 00000100:00100000:0.0:1746144658.515578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.515725:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746585472 00000100:00100000:3.0:1746144658.515734:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746585472 00010000:00010000:3.0:1746144658.515780:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 33 pid: 8450 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.515817:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5778 00000100:00100000:3.0:1746144658.515827:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746585472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.515842:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144658.515861:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144658 -> 1746144659 00002000:00010000:3.0:1746144658.515864:0:16008:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144658 -> 1746144659 00010000:00010000:3.0:1746144658.515869:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 33 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.515880:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 33 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.515902:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a600/0xa7c849b16e019bf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4075520->18446744073709551615] (req 4075520->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e887 expref: 33 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.515925:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.515927:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.515934:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.515942:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.515975:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.515988:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747455872:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144658.516059:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144658.519529:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747455872:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144658.519568:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.519624:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746585472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3798us (4045us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.519635:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5778 00000100:00100000:0.0:1746144658.520786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.521047:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746585728 00000100:00100000:2.0:1746144658.521055:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746585728 00002000:00100000:2.0:1746144658.521099:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f273800 x1830964746585728/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.521112:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f273800 with x1830964746585728 ext(3145728->4194303) 00002000:00010000:2.0:1746144658.521118:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f273800 00000100:00100000:2.0:1746144658.521171:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4400 00000100:00100000:2.0:1746144658.521178:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746585728:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144658.527315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.528684:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746585856 00000100:00100000:3.0:1746144658.528695:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746585856 00000100:00100000:3.0:1746144658.528759:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11608 00000100:00100000:3.0:1746144658.528769:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29024:x1830964746585856:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.528788:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.528807:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8b8 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.528836:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.528837:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.528846:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 33 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.528860:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 33 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.528871:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b400, rc 0) 00000100:00100000:3.0:1746144658.528917:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29024:x1830964746585856:12345-192.168.204.23@tcp:101:cat.0 Request processed in 152us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.528924:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11608 00000100:00100000:2.0:1746144658.530439:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746585728:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9252us (9645us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.530449:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4400 00002000:00100000:2.0:1746144658.530460:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f273800 x1830964746585728/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.530470:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f273800 with x1830964746585728 ext(3145728->4194303) 00002000:00010000:2.0:1746144658.530476:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f273800 00000100:00100000:0.0:1746144658.533239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.533426:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746586112 00000100:00100000:2.0:1746144658.533436:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746586112 00002000:00100000:2.0:1746144658.533480:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f272d80 x1830964746586112/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.533490:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f272d80 with x1830964746586112 ext(2097152->3145727) 00002000:00010000:2.0:1746144658.533495:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f272d80 00000100:00100000:2.0:1746144658.533528:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4401 00000100:00100000:2.0:1746144658.533535:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746586112:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144658.535854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.536606:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746586240 00000100:00100000:1.0:1746144658.536616:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746586240 00000100:00100000:1.0:1746144658.536678:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11609 00000100:00100000:1.0:1746144658.536687:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:29027:x1830964746586240:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.536705:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.536725:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8bf expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.536754:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.536761:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144658.536763:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144658.536767:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.536797:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.536809:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 25 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.536821:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456000:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144658.536890:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.542818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.542942:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456000:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144658.542977:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.542995:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944a5000, rc 0) 00000100:00100000:1.0:1746144658.543043:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:29027:x1830964746586240:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6357us (7198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.543051:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11609 00000100:00100000:2.0:1746144658.543488:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746586368 00000100:00100000:2.0:1746144658.543495:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746586368 00002000:00100000:2.0:1746144658.543532:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3821567) req@ffff88009f272680 x1830964746586368/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.543541:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f272680 with x1830964746586368 ext(3145728->3821567) 00010000:00010000:2.0:1746144658.543547:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.543559:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 26 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.543565:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f272680 00000100:00100000:2.0:1746144658.543591:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 854 00000100:00100000:2.0:1746144658.543597:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746586368:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144658.545343:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746586112:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11799us (12105us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144658.545355:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4401 00002000:00100000:1.0:1746144658.545366:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f272d80 x1830964746586112/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144658.545374:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f272d80 with x1830964746586112 ext(2097152->3145727) 00002000:00010000:1.0:1746144658.545379:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f272d80 00000100:00100000:0.0:1746144658.551203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.551284:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746586496 00000100:00100000:1.0:1746144658.551295:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746586496 00000100:00100000:1.0:1746144658.551472:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11610 00000100:00100000:1.0:1746144658.551481:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29024:x1830964746586496:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.551499:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.551514:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8c6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.551538:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.551540:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.551546:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.551557:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.551567:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273800, rc 0) 00000100:00100000:1.0:1746144658.551625:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29024:x1830964746586496:12345-192.168.204.23@tcp:101:cat.0 Request processed in 145us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.551631:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11610 00000100:00100000:2.0:1746144658.551730:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746586368:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8129us (8919us total) trans 21474840474 rc 0/0 00000100:00100000:2.0:1746144658.551740:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 854 00002000:00100000:2.0:1746144658.551752:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3821567) req@ffff88009f272680 x1830964746586368/t21474840474(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.551761:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f272680 with x1830964746586368 ext(3145728->3821567) 00010000:00010000:2.0:1746144658.551770:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 29 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.551784:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 29 pid: 4760 timeout: 737 lvb_type: 0 00002000:00010000:2.0:1746144658.551791:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f272680 00000100:00100000:0.0:1746144658.556441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.556939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.556971:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746586752 00000100:00100000:2.0:1746144658.556982:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746586752 00002000:00100000:2.0:1746144658.557026:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f271f80 x1830964746586752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.557036:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271f80 with x1830964746586752 ext(2097152->3145727) 00002000:00010000:2.0:1746144658.557043:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f271f80 00000100:00100000:2.0:1746144658.557074:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4402 00000100:00100000:2.0:1746144658.557081:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746586752:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144658.557926:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746587136 00000100:00100000:3.0:1746144658.557931:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746587136 00010000:00010000:3.0:1746144658.557966:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.558083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.558267:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5779 00000100:00100000:3.0:1746144658.558276:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746587136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.558287:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144658.558303:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.558314:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.558340:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3821567) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e89c expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.558366:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.558368:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.558375:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.558383:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.558415:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.558427:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747456128:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144658.558493:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.558631:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746587008 00000100:00100000:0.0:1746144658.558635:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746587008 00002000:00100000:0.0:1746144658.558657:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ce84700 x1830964746587008/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144658.558670:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84700 with x1830964746587008 ext(3145728->4194303) 00002000:00010000:0.0:1746144658.558674:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84700 00000100:00100000:0.0:1746144658.558686:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4403 00000100:00100000:0.0:1746144658.558692:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746587008:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144658.564320:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747456128:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144658.564361:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.564418:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746587136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6142us (7477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.564430:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5779 00000100:00100000:2.0:1746144658.572029:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746586752:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14934us (15584us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.572041:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4402 00002000:00100000:2.0:1746144658.572054:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f271f80 x1830964746586752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.572063:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271f80 with x1830964746586752 ext(2097152->3145727) 00002000:00010000:2.0:1746144658.572069:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f271f80 00000100:00100000:0.0:1746144658.572993:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.573403:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746587392 00000100:00100000:3.0:1746144658.573413:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746587392 00002000:00100000:3.0:1746144658.573473:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093762680 x1830964746587392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.573489:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762680 with x1830964746587392 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.573494:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093762680 00000100:00100000:3.0:1746144658.573522:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4404 00000100:00100000:3.0:1746144658.573531:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746587392:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144658.574006:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746587008:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15312us (15921us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.574014:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4403 00002000:00100000:2.0:1746144658.574019:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012ce84700 x1830964746587008/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.574027:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84700 with x1830964746587008 ext(3145728->4194303) 00002000:00010000:2.0:1746144658.574030:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84700 00000100:00100000:3.0:1746144658.582401:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746587392:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8857us (9395us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144658.582416:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4404 00002000:00100000:3.0:1746144658.582429:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093762680 x1830964746587392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.582439:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762680 with x1830964746587392 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.582445:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093762680 00000100:00100000:0.0:1746144658.583053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.583209:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746587520 00000100:00100000:2.0:1746144658.583220:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746587520 00000100:00100000:2.0:1746144658.583259:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11611 00000100:00100000:2.0:1746144658.583266:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29024:x1830964746587520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.583282:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.583300:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8cd expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.583331:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.583332:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.583340:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 29 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.583355:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 29 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.583366:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbde000, rc 0) 00000100:00100000:2.0:1746144658.583389:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29024:x1830964746587520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.583395:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11611 00000100:00100000:0.0:1746144658.589122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.589812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.589961:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746587648 00000100:00100000:2.0:1746144658.589971:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746587648 00000100:00100000:2.0:1746144658.590009:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746587776 00000100:00100000:2.0:1746144658.590011:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746587776 00000100:00100000:2.0:1746144658.590039:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11612 00000100:00100000:2.0:1746144658.590047:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746587648:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144658.590060:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11613 00010000:00010000:2.0:1746144658.590065:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144658.590072:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746587776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.590079:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.590084:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8d4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.590088:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8db expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.590107:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.590107:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.590109:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.590109:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.590118:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144658.590118:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.590157:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144658.590158:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.590168:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbdf000, rc 0) 00010000:00010000:1.0:1746144658.590168:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428be00, rc 0) 00000100:00100000:1.0:1746144658.590304:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746587776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 235us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.590311:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11613 00000100:00100000:2.0:1746144658.591313:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746587648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1263us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.591319:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11612 00000100:00100000:0.0:1746144658.592242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.592348:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746588032 00000100:00100000:3.0:1746144658.592355:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746588032 00002000:00100000:3.0:1746144658.592404:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093763100 x1830964746588032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.592413:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763100 with x1830964746588032 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.592417:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093763100 00000100:00100000:3.0:1746144658.592766:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4405 00000100:00100000:3.0:1746144658.592775:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746588032:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144658.599594:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746588032:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6807us (7339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144658.599607:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4405 00002000:00100000:3.0:1746144658.599621:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093763100 x1830964746588032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.599631:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763100 with x1830964746588032 ext(3145728->4194303) 00002000:00010000:3.0:1746144658.599638:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093763100 00000100:00100000:0.0:1746144658.600829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.600935:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746588288 00000100:00100000:3.0:1746144658.600943:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746588288 00002000:00100000:3.0:1746144658.600994:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093761500 x1830964746588288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.601002:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761500 with x1830964746588288 ext(4194304->4935679) 00002000:00010000:3.0:1746144658.601006:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093761500 00000100:00100000:3.0:1746144658.601486:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4406 00000100:00100000:3.0:1746144658.601496:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746588288:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144658.608887:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746588288:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7381us (8050us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144658.608900:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4406 00002000:00100000:3.0:1746144658.609270:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093761500 x1830964746588288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.609280:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761500 with x1830964746588288 ext(4194304->4935679) 00002000:00010000:3.0:1746144658.609287:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093761500 00000100:00100000:0.0:1746144658.609928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.610018:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746588544 00000100:00100000:3.0:1746144658.610026:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746588544 00002000:00100000:3.0:1746144658.611625:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093763b80 x1830964746588544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.611635:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763b80 with x1830964746588544 ext(4194304->4935679) 00002000:00010000:3.0:1746144658.611642:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093763b80 00000100:00100000:3.0:1746144658.611686:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4407 00000100:00100000:3.0:1746144658.611707:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746588544:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144658.623712:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746588544:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12005us (13771us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144658.623724:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4407 00002000:00100000:3.0:1746144658.623736:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093763b80 x1830964746588544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.623745:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763b80 with x1830964746588544 ext(4194304->4935679) 00002000:00010000:3.0:1746144658.623752:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093763b80 00000100:00100000:0.0:1746144658.630439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.630698:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746588800 00000100:00100000:3.0:1746144658.630710:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746588800 00000100:00100000:3.0:1746144658.630830:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10052 00000100:00100000:3.0:1746144658.630839:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29031:x1830964746588800:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.630864:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.630881:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019c4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8e2 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.630977:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.630992:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 24 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.630998:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 312 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.631009:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.631042:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 312 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.631053:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 312 pid: 14709 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.631066:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747456256:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.631218:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 24 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.631226:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 24 pid: 20319 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.631234:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747456384:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144658.631253:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.635776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.635829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.636156:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746588928 00000100:00100000:2.0:1746144658.636166:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746588928 00010000:00010000:2.0:1746144658.636208:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 313 pid: 14709 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.636235:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746589056 00000100:00100000:2.0:1746144658.636238:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746589056 00010000:00010000:2.0:1746144658.636248:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 25 pid: 20319 timeout: 737 lvb_type: 0 00000100:00100000:3.0:1746144658.636431:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747456256:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144658.636441:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747456384:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144658.636475:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144658.637301:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5780 00000100:00100000:2.0:1746144658.637312:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:1961:x1830964746588928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.637327:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.637334:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 313 pid: 14709 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.637345:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 313 pid: 14709 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.637370:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b20d600/0xa7c849b16e0199bd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e776 expref: 313 pid: 14709 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.637398:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144658.637402:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.637410:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.637415:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.637462:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:1961:x1830964746588928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 152us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.637469:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5780 00000100:00100000:2.0:1746144658.637492:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5781 00000100:00100000:2.0:1746144658.637496:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746589056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.637503:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.637507:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 25 pid: 20319 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.637515:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 25 pid: 20319 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.637526:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273200/0xa7c849b16e019969 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e745 expref: 25 pid: 20319 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.637534:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144658.637537:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.637544:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.637550:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.637567:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.637581:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746589056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 84us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.637586:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5781 00010000:00010000:3.0:1746144658.637731:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.637737:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144658.637758:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.637906:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e019c4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 313 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.638522:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 312 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.638530:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.638533:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144658.638535:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a600, rc 0) 00000100:00100000:3.0:1746144658.639074:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:29031:x1830964746588800:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8234us (8643us total) trans 8589943926 rc 0/0 00000100:00100000:3.0:1746144658.639082:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10052 00000100:00100000:0.0:1746144658.676299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.676372:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746589312 00000100:00100000:3.0:1746144658.676383:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746589312 00000100:00100000:3.0:1746144658.676457:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10053 00000100:00100000:3.0:1746144658.676467:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:29035:x1830964746589312:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144658.676494:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.676514:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019c64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8e9 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.676627:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676641:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676651:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676665:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676669:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676674:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676774:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676781:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676787:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144658.676795:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.676878:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676885:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676890:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676896:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29aa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.676900:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676906:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676917:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144658.676919:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.676923:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676928:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019c6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676951:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676956:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676960:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676963:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.676965:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676970:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676977:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639100) 00010000:00010000:3.0:1746144658.676979:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.676981:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.676985:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e019c72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.677017:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 27 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.677028:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 26 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.677033:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.677035:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144658.677037:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29be00, rc 0) 00000100:00100000:3.0:1746144658.677090:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+26:29035:x1830964746589312:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 626us (803us total) trans 8589943927 rc 0/0 00000100:00100000:3.0:1746144658.677095:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10053 00000100:00100000:0.0:1746144658.700523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.700620:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746589440 00000100:00100000:2.0:1746144658.700630:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746589440 00000100:00100000:2.0:1746144658.701705:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11614 00000100:00100000:2.0:1746144658.701716:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29031:x1830964746589440:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.701738:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.701759:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8f0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.701791:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.701800:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.701806:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.701808:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.701812:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1511424->2039807] (req 1511424->2039807) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.701845:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.701858:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 23 pid: 8453 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.701870:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456512:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.705390:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.705408:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.705423:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456640:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.705500:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e99c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144658.705587:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144658.707081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.709487:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746589568 00000100:00100000:3.0:1746144658.709498:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746589568 00010000:00010000:3.0:1746144658.709548:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 24 pid: 8453 timeout: 737 lvb_type: 1 00000100:00100000:3.0:1746144658.709583:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5782 00000100:00100000:3.0:1746144658.709592:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746589568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.709607:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144658.709629:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 24 pid: 8453 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1746144658.709641:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 24 pid: 8453 timeout: 737 lvb_type: 1 00010000:00010000:3.0:1746144658.709666:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.709705:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746589568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 114us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.709715:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5782 00010000:00010000:2.0:1746144658.710120:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b428be00/0xa7c849b16e019c48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8db expref: 23 pid: 8453 timeout: 737 lvb_type: 1 00000100:00100000:2.0:1746144658.710170:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456512:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.710182:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456640:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.710209:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1511424->2039807] (req 1511424->2039807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.710224:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbde400, rc 0) 00000100:00100000:2.0:1746144658.710254:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29031:x1830964746589440:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8542us (9743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.710261:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11614 00000100:00100000:0.0:1746144658.711181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.711292:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746589696 00000100:00100000:1.0:1746144658.711298:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746589696 00010000:00010000:1.0:1746144658.711317:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.711346:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5783 00000100:00100000:1.0:1746144658.711351:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746589696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.711360:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.711374:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.711383:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.711398:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8a3 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:1.0:1746144658.711422:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.711424:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.711431:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.711439:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.711467:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144658.711477:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747456768:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144658.712530:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.713743:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747456768:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144658.713761:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.713790:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746589696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2438us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.713798:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5783 00000100:00100000:0.0:1746144658.714429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.714487:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746589952 00000100:00100000:3.0:1746144658.714493:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746589952 00002000:00100000:3.0:1746144658.714541:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1511424->1515519) req@ffff880093761c00 x1830964746589952/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.714551:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761c00 with x1830964746589952 ext(1511424->1515519) 00002000:00010000:3.0:1746144658.714556:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761c00 00000100:00100000:3.0:1746144658.714649:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4408 00000100:00100000:3.0:1746144658.714658:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746589952:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.715043:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746589952:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 387us (615us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144658.715050:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4408 00002000:00100000:3.0:1746144658.715055:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1511424->1515519) req@ffff880093761c00 x1830964746589952/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.715062:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761c00 with x1830964746589952 ext(1511424->1515519) 00002000:00010000:3.0:1746144658.715065:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761c00 00000100:00100000:0.0:1746144658.722183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.722909:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746590208 00000100:00100000:3.0:1746144658.722919:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746590208 00002000:00100000:3.0:1746144658.722982:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (2035712->2039807) req@ffff880093760e00 x1830964746590208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.722993:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760e00 with x1830964746590208 ext(2035712->2039807) 00002000:00010000:3.0:1746144658.722999:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093760e00 00000100:00100000:3.0:1746144658.723080:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4409 00000100:00100000:3.0:1746144658.723091:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746590208:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144658.723321:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746590208:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 233us (1202us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144658.723328:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4409 00002000:00100000:3.0:1746144658.723334:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (2035712->2039807) req@ffff880093760e00 x1830964746590208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.723341:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760e00 with x1830964746590208 ext(2035712->2039807) 00002000:00010000:3.0:1746144658.723344:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093760e00 00000100:00100000:0.0:1746144658.735080:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.736908:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746590464 00000100:00100000:3.0:1746144658.736920:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746590464 00000100:00100000:3.0:1746144658.736998:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10054 00000100:00100000:3.0:1746144658.737007:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+26:29039:x1830964746590464:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.737033:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.737054:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e019c8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8f7 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.737210:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737223:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737233:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737247:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737252:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737262:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737364:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019ca3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737373:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737379:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144658.737387:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144658.737472:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737478:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737484:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737489:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.737492:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737498:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737508:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144658.737510:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.737515:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737523:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e019c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737883:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737890:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737894:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737898:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29ba00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144658.737901:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737905:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737913:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639600) 00010000:00010000:3.0:1746144658.737915:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144658.737917:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737921:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e019c9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144658.737960:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e019c8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f7 expref: 29 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.737971:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f7 expref: 28 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.737982:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144658.737984:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144658.737986:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ac00, rc 0) 00000100:00100000:3.0:1746144658.738809:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:29039:x1830964746590464:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1802us (3737us total) trans 8589943928 rc 0/0 00000100:00100000:3.0:1746144658.738817:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10054 00000100:00100000:0.0:1746144658.741904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.741935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.742014:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746590848 00000100:00100000:1.0:1746144658.742078:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746590848 00000100:00100000:1.0:1746144658.742203:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 625 00000100:00100000:1.0:1746144658.742212:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746590848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.742224:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.742244:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019ca3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f7 expref: 28 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.742261:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144658.742264:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.742299:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746590848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.742305:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 625 00000100:00100000:2.0:1746144658.742733:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746590720 00000100:00100000:2.0:1746144658.742742:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746590720 00000100:00100000:2.0:1746144658.742796:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4049 00000100:00100000:2.0:1746144658.742803:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+27:29039:x1830964746590720:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144658.743047:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+28:29039:x1830964746590720:12345-192.168.204.23@tcp:35:cat.0 Request processed in 244us (1149us total) trans 8589943929 rc 0/0 00000100:00100000:2.0:1746144658.743054:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4049 00000100:00100000:0.0:1746144658.745516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.745953:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746590976 00000100:00100000:3.0:1746144658.745961:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746590976 00000100:00100000:3.0:1746144658.746016:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11615 00000100:00100000:3.0:1746144658.746024:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746590976:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.746039:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.746054:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29b800/0xa7c849b16e019cb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e8fe expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.746357:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456896:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144658.746567:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.753233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.753237:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747456896:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144658.753286:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29b800/0xa7c849b16e019cb1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8fe expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.753301:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b800/0xa7c849b16e019cb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8fe expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144658.753316:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b800, rc 0) 00000100:00100000:2.0:1746144658.753318:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746591232 00000100:00100000:2.0:1746144658.753326:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746591232 00000100:00100000:3.0:1746144658.753364:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746590976:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7340us (7853us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.753370:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10055 00000100:00100000:3.0:1746144658.753372:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11615 00000100:00100000:2.0:1746144658.753376:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:29042:x1830964746591232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.753411:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.753426:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5000/0xa7c849b16e019cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e905 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.753537:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.753549:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.753560:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.753572:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.753577:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.753582:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754252:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754260:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754266:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144658.754275:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144658.754356:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754362:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754368:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754374:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144658.754378:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754384:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754394:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144658.754397:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144658.754401:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754405:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019cbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754417:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754421:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754425:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754429:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a4e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144658.754431:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754435:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754439:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8100) 00010000:00010000:2.0:1746144658.754441:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144658.754442:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754446:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019cc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.754480:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5000/0xa7c849b16e019cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 315 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.754491:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 314 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.754496:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144658.754498:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144658.754500:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5c00, rc 0) 00000100:00100000:2.0:1746144658.755981:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+314:29042:x1830964746591232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2599us (2749us total) trans 8589943930 rc 0/0 00000100:00100000:2.0:1746144658.755990:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10055 00000100:00100000:0.0:1746144658.758099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.758257:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746591488 00000100:00100000:2.0:1746144658.758267:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746591488 00000100:00100000:2.0:1746144658.758307:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4050 00000100:00100000:2.0:1746144658.758314:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+314:29042:x1830964746591488:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144658.758527:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:29042:x1830964746591488:12345-192.168.204.23@tcp:35:cat.0 Request processed in 212us (434us total) trans 8589943931 rc 0/0 00000100:00100000:2.0:1746144658.758533:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4050 00000100:00100000:0.0:1746144658.759548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.760006:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746591744 00000100:00100000:2.0:1746144658.760012:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746591744 00002000:00100000:2.0:1746144658.760044:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880093760380 x1830964746591744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.760053:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760380 with x1830964746591744 ext(1048576->2097151) 00002000:00010000:2.0:1746144658.760058:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093760380 00000100:00100000:2.0:1746144658.760083:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4410 00000100:00100000:2.0:1746144658.760089:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746591744:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144658.767763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.767839:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592000 00000100:00100000:3.0:1746144658.767849:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592000 00002000:00100000:3.0:1746144658.767909:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f434e00 x1830964746592000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 504/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.767919:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434e00 with x1830964746592000 ext(1048576->2097151) 00002000:00010000:3.0:1746144658.767925:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434e00 00000100:00100000:3.0:1746144658.767944:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4411 00000100:00100000:3.0:1746144658.767952:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746592000:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144658.768265:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746591744:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8174us (8717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144658.768272:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4410 00002000:00100000:2.0:1746144658.768279:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880093760380 x1830964746591744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.768285:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760380 with x1830964746591744 ext(1048576->2097151) 00002000:00010000:2.0:1746144658.768289:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093760380 00000100:00100000:3.0:1746144658.776105:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746592000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8147us (8347us total) trans 0 rc 520192/520192 00000100:00100000:3.0:1746144658.776115:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4411 00002000:00100000:3.0:1746144658.776166:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f434e00 x1830964746592000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 504/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 520192/520192 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.776175:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434e00 with x1830964746592000 ext(1048576->2097151) 00002000:00010000:3.0:1746144658.776180:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434e00 00000100:00100000:0.0:1746144658.779941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.780930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.781015:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592128 00000100:00100000:1.0:1746144658.781022:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592128 00000100:00100000:1.0:1746144658.781063:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592256 00000100:00100000:1.0:1746144658.781065:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592256 00000100:00100000:1.0:1746144658.781075:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11616 00000100:00100000:1.0:1746144658.781081:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:29039:x1830964746592128:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.781095:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.781108:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e90c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.781155:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.781161:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144658.781163:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144658.781166:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.781191:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.781201:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 28 pid: 8450 timeout: 737 lvb_type: 0 00000100:00100000:1.0:1746144658.781211:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747457024:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.781274:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11617 00000100:00100000:0.0:1746144658.781280:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:29035:x1830964746592256:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144658.781285:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144658.781293:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e913 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.781304:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.781310:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.781315:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.781316:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144658.781318:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.781330:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.781336:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 26 pid: 8450 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.781343:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747457152:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144658.781394:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.781401:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 28 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:0.0:1746144658.781407:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747457280:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144658.781424:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.782796:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.787052:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747457152:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.787063:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747457280:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.787099:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1679360->2097151] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.787114:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135786400, rc 0) 00000100:00100000:2.0:1746144658.787189:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:29035:x1830964746592256:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5907us (6259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.787196:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11617 00000100:00100000:1.0:1746144658.787274:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747457024:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144658.787290:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.787299:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ac600, rc 0) 00000100:00100000:1.0:1746144658.787313:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:29039:x1830964746592128:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6233us (7379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.787317:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11616 00000100:00100000:1.0:1746144658.788964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.788999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.789025:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592384 00000100:00100000:3.0:1746144658.789032:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592384 00002000:00100000:3.0:1746144658.789076:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1511424->2039807) req@ffff88012ce85500 x1830964746592384/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.789085:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85500 with x1830964746592384 ext(1511424->2039807) 00010000:00010000:3.0:1746144658.789092:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 29 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.789108:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 29 pid: 8450 timeout: 737 lvb_type: 0 00002000:00010000:3.0:1746144658.789113:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce85500 00000100:00100000:3.0:1746144658.789159:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 855 00000100:00100000:3.0:1746144658.789166:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746592384:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144658.789208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.789224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.789260:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592512 00000100:00100000:2.0:1746144658.789263:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592512 00010000:00010000:2.0:1746144658.789281:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00000100:00100000:2.0:1746144658.789305:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5784 00000100:00100000:2.0:1746144658.789311:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746592512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144658.789319:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144658.789333:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.789343:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.789359:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009418fc00/0xa7c849b16e019bd8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e879 expref: 30 pid: 4760 timeout: 737 lvb_type: 0 00010000:00010000:2.0:1746144658.789373:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144658.789397:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746592512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 87us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.789403:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5784 00000100:00100000:1.0:1746144658.789539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.789550:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592896 00000100:00100000:1.0:1746144658.789553:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592896 00010000:00010000:1.0:1746144658.789566:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 25 pid: 8450 timeout: 737 lvb_type: 1 00000100:00100000:1.0:1746144658.789581:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5785 00000100:00100000:1.0:1746144658.789586:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746592896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.789593:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.789600:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 25 pid: 8450 timeout: 737 lvb_type: 1 00010000:00010000:1.0:1746144658.789607:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 25 pid: 8450 timeout: 737 lvb_type: 1 00000100:00100000:0.0:1746144658.789641:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592640 00000100:00100000:0.0:1746144658.789645:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592640 00010000:00010000:1.0:1746144658.789760:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019c41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8d4 expref: 25 pid: 8450 timeout: 737 lvb_type: 1 00010000:00010000:1.0:1746144658.789774:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.789776:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.789782:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.789789:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.789818:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144658.789828:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747457408:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144658.789868:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.790048:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746592768 00000100:00100000:0.0:1746144658.790051:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746592768 00000100:00100000:2.0:1746144658.790278:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11618 00000100:00100000:2.0:1746144658.790285:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746592640:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.790295:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.790304:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e019ce9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e91a expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.790332:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11619 00000100:00100000:3.0:1746144658.790341:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746592768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144658.790348:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144658.790355:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019cf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e921 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.790384:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747457536:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144658.790425:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.790458:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747457664:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.790478:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.793288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.793367:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747457664:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144658.793368:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747457408:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144658.793382:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144658.793389:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e019ce9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e91a expref: 33 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.793405:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5000/0xa7c849b16e019ce9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e91a expref: 33 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144658.793413:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746592896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3826us (3873us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144658.793415:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5000, rc 0) 00000100:00100000:1.0:1746144658.793421:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5785 00000100:00100000:2.0:1746144658.793433:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746592640:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3150us (4225us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.793439:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11618 00000100:00100000:2.0:1746144658.793475:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747457536:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144658.793492:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019cf0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e921 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.793500:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29aa00/0xa7c849b16e019cf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e921 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.793506:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29aa00, rc 0) 00000100:00100000:2.0:1746144658.793529:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746592768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3191us (4303us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.793533:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11619 00000100:00100000:2.0:1746144658.793556:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746593152 00000100:00100000:2.0:1746144658.793560:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746593152 00002000:00100000:2.0:1746144658.793795:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1679360->1683455) req@ffff88012cef8e00 x1830964746593152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.793804:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8e00 with x1830964746593152 ext(1679360->1683455) 00002000:00010000:2.0:1746144658.793807:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8e00 00000100:00100000:2.0:1746144658.793825:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4412 00000100:00100000:2.0:1746144658.793831:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746593152:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144658.794065:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746593152:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 234us (782us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144658.794072:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4412 00002000:00100000:2.0:1746144658.794076:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1679360->1683455) req@ffff88012cef8e00 x1830964746593152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.794082:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8e00 with x1830964746593152 ext(1679360->1683455) 00002000:00010000:2.0:1746144658.794085:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8e00 00000100:00100000:3.0:1746144658.798398:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746592384:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9224us (9430us total) trans 21474840475 rc 0/0 00000100:00100000:3.0:1746144658.798408:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 855 00002000:00100000:3.0:1746144658.798418:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1511424->2039807) req@ffff88012ce85500 x1830964746592384/t21474840475(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/448 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.798427:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85500 with x1830964746592384 ext(1511424->2039807) 00010000:00010000:3.0:1746144658.798436:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 30 pid: 8450 timeout: 737 lvb_type: 0 00010000:00010000:3.0:1746144658.798455:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144658.798461:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce85500 00000100:00100000:1.0:1746144658.799387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.799413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.799478:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746593280 00000100:00100000:2.0:1746144658.799484:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746593280 00000100:00100000:2.0:1746144658.799510:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746593408 00000100:00100000:2.0:1746144658.799513:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746593408 00000100:00100000:2.0:1746144658.799536:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11620 00000100:00100000:2.0:1746144658.799543:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746593280:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.799554:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.799568:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e019cf7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e928 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.799620:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747457792:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.799671:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144658.800118:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11621 00000100:00100000:1.0:1746144658.800175:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746593408:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144658.800181:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144658.800189:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019cfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e92f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144658.800208:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130929880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747457920:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144658.800236:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.800465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.800537:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746593536 00000100:00100000:0.0:1746144658.800541:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746593536 00000100:00100000:0.0:1746144658.800561:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11622 00000100:00100000:0.0:1746144658.800566:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:29035:x1830964746593536:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144658.800573:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144658.800579:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e936 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.800592:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144658.800596:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.800602:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144658.800605:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1347583] (req 1048576->1347583) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.800627:0:4760:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.800647:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1347583] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144658.800654:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabd600, rc 0) 00000100:00100000:0.0:1746144658.800675:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:29035:x1830964746593536:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 108us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.800680:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11622 00000100:00100000:0.0:1746144658.801953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.802063:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747457792:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144658.802081:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e019cf7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e928 expref: 33 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.802095:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e019cf7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e928 expref: 33 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.802104:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135787600, rc 0) 00000100:00100000:1.0:1746144658.802155:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746593664 00000100:00100000:1.0:1746144658.802160:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746593664 00000100:00100000:2.0:1746144658.802167:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746593280:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2625us (2782us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.802173:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11620 00010000:00010000:1.0:1746144658.802180:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.802209:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5786 00000100:00100000:1.0:1746144658.802215:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746593664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.802225:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.802234:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.802243:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.802257:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.802258:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.802263:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.802270:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.802289:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.802298:0:7102:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 24 pid: 8453 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.802307:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747458176:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144658.802355:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf03c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144658.802931:0:8453:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff880130929880 x1830964747457920) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.802946:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde400/0xa7c849b16e019c87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1511424->2039807) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8f0 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.802995:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130929880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747457920:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144658.803014:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019cfe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e92f expref: 31 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144658.803022:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019cfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e92f expref: 31 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144658.803027:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ad000, rc 0) 00000100:00100000:1.0:1746144658.803055:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746593408:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2883us (3641us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144658.803061:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11621 00000100:00100000:1.0:1746144658.803979:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747458176:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144658.803989:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.804008:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746593664:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1792us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.804013:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5786 00000100:00100000:0.0:1746144658.807394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.807475:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746593920 00000100:00100000:3.0:1746144658.807485:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746593920 00002000:00100000:3.0:1746144658.807534:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a4dd4380 x1830964746593920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.807542:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4380 with x1830964746593920 ext(1048576->2097151) 00010000:00010000:3.0:1746144658.807550:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.807563:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144658.807569:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd4380 00000100:00100000:3.0:1746144658.807757:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 856 00000100:00100000:3.0:1746144658.807766:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746593920:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144658.808865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.808903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.808944:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746594048 00000100:00100000:2.0:1746144658.808950:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746594048 00000100:00100000:2.0:1746144658.808977:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746594176 00000100:00100000:2.0:1746144658.808979:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746594176 00000100:00100000:2.0:1746144658.808991:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11623 00000100:00100000:2.0:1746144658.808996:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746594048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.809005:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.809018:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb34600/0xa7c849b16e019d0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e93d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.809054:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458304:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.809153:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.809169:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11624 00000100:00100000:2.0:1746144658.809174:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746594176:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.809181:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.809187:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e944 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.809202:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.809210:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d13 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e944 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.809218:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e944 expref: 32 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.809228:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099929800, rc 0) 00000100:00100000:2.0:1746144658.809247:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746594176:12345-192.168.204.23@tcp:101:cat.0 Request processed in 72us (343us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.809252:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11624 00000100:00100000:0.0:1746144658.814772:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458304:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144658.814802:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb34600/0xa7c849b16e019d0c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e93d expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.814815:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb34600/0xa7c849b16e019d0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e93d expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144658.815221:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb34600, rc 0) 00000100:00100000:0.0:1746144658.815707:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746594048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6707us (6840us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144658.815718:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11623 00000100:00100000:3.0:1746144658.820732:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746593920:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 12959us (13341us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144658.820743:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 856 00002000:00100000:3.0:1746144658.820754:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a4dd4380 x1830964746593920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/440 e 0 to 0 dl 1746144669 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.820763:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4380 with x1830964746593920 ext(1048576->2097151) 00010000:00010000:3.0:1746144658.820772:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.820786:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144658.820792:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd4380 00000100:00100000:0.0:1746144658.827687:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.827779:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746594304 00000100:00100000:1.0:1746144658.827791:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746594304 00010000:00010000:1.0:1746144658.827830:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.827880:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5787 00000100:00100000:1.0:1746144658.827887:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746594304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.827898:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.827916:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.827925:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.827943:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019cdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e90c expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.827965:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.827967:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.827972:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.827979:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.828002:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144658.828020:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747458432:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144658.828278:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.831074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.831890:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746594432 00000100:00100000:2.0:1746144658.831900:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746594432 00000100:00100000:2.0:1746144658.831952:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11625 00000100:00100000:2.0:1746144658.831960:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746594432:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144658.831974:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.831989:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e94b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144658.832031:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458560:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144658.832098:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.833598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.833886:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458560:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144658.833910:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d1a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e94b expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144658.833925:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e94b expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144658.833945:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747458432:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144658.833958:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.833977:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746594688 00000100:00100000:3.0:1746144658.833982:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746594688 00002000:00100000:3.0:1746144658.834019:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1343488->1347583) req@ffff88012cef8a80 x1830964746594688/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.834027:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8a80 with x1830964746594688 ext(1343488->1347583) 00002000:00010000:3.0:1746144658.834031:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8a80 00000100:00100000:3.0:1746144658.834044:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4413 00000100:00100000:3.0:1746144658.834051:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746594688:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144658.834080:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746594304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6192us (6403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.834088:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5787 00000100:00100000:3.0:1746144658.834212:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746594688:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 161us (617us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144658.834218:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4413 00002000:00100000:3.0:1746144658.834223:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1343488->1347583) req@ffff88012cef8a80 x1830964746594688/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144658.834229:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8a80 with x1830964746594688 ext(1343488->1347583) 00002000:00010000:3.0:1746144658.834232:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8a80 00010000:00010000:2.0:1746144658.834450:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52b9c00, rc 0) 00000100:00100000:2.0:1746144658.834483:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746594432:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2524us (3419us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144658.834489:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11625 00000100:00100000:0.0:1746144658.835953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.836027:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746594944 00000100:00100000:2.0:1746144658.836032:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746594944 00000100:00100000:2.0:1746144658.836057:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4051 00000100:00100000:2.0:1746144658.836063:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:29035:x1830964746594944:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144658.836236:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+29:29035:x1830964746594944:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 172us (284us total) trans 8589943932 rc 0/0 00000100:00100000:2.0:1746144658.836242:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4051 00000100:00100000:0.0:1746144658.845694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.846070:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746595200 00000100:00100000:2.0:1746144658.846079:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746595200 00000100:00100000:2.0:1746144658.846363:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10056 00000100:00100000:2.0:1746144658.846371:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:29045:x1830964746595200:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.846389:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.846403:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e019d21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e952 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.846486:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846501:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846510:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846520:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846526:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846531:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846607:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099929800/0xa7c849b16e019d36 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846614:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099929800/0xa7c849b16e019d36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846619:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099929800/0xa7c849b16e019d36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144658.846626:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144658.846684:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846690:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846696:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846704:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52b9c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144658.846707:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846712:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846720:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144658.846723:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144658.846726:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846730:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9c00/0xa7c849b16e019d28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846755:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846760:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846765:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846768:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52b9000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144658.846770:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846775:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846780:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8d00) 00010000:00010000:2.0:1746144658.846781:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144658.846784:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846788:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b9000/0xa7c849b16e019d2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144658.846815:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b21f8a00/0xa7c849b16e019d21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e952 expref: 318 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.846825:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099929800/0xa7c849b16e019d36 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e952 expref: 317 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.846831:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144658.846832:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144658.846834:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099929800, rc 0) 00000100:00100000:2.0:1746144658.846887:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29045:x1830964746595200:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 517us (1199us total) trans 8589943933 rc 0/0 00000100:00100000:2.0:1746144658.846893:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10056 00000100:00100000:0.0:1746144658.849131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.849207:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746595584 00000100:00100000:2.0:1746144658.849214:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746595584 00000100:00100000:2.0:1746144658.849254:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4052 00000100:00100000:2.0:1746144658.849259:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29045:x1830964746595584:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144658.849406:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:29045:x1830964746595584:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 146us (289us total) trans 8589943934 rc 0/0 00000100:00100000:2.0:1746144658.849411:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4052 00000100:00100000:0.0:1746144658.849951:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.850158:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746595328 00000100:00100000:1.0:1746144658.850166:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746595328 00000100:00100000:1.0:1746144658.850490:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 626 00000100:00100000:1.0:1746144658.850498:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:1962:x1830964746595328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.850512:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.850541:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099929800/0xa7c849b16e019d36 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e952 expref: 318 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.850572:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144658.850577:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.850609:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:1962:x1830964746595328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 113us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.850615:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 626 00000100:00100000:0.0:1746144658.900475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.900640:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746595712 00000100:00100000:2.0:1746144658.900650:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746595712 00000100:00100000:2.0:1746144658.900710:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11626 00000100:00100000:2.0:1746144658.900718:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29045:x1830964746595712:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.900740:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.900762:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e959 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900793:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900805:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900812:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900822:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900828:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144658.900829:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144658.900833:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2531328->3145727] (req 2531328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900866:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.900878:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144658.900891:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458688:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.901007:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.901016:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 23 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144658.901024:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458816:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.901057:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 30 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.901063:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 30 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144658.901070:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458944:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.901089:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.901094:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144658.901101:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747459072:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.901117:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.903906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.903946:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.904051:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458688:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.904066:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458816:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.904074:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747458944:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.904081:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747459072:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.904156:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2531328->3145727] (req 2531328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.904175:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099929800, rc 0) 00000100:00100000:2.0:1746144658.904214:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29045:x1830964746595712:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3497us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.904223:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11626 00000100:00100000:1.0:1746144658.904305:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746595968 00000100:00100000:1.0:1746144658.904312:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746595968 00010000:00010000:1.0:1746144658.904341:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 24 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.904359:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746595840 00000100:00100000:1.0:1746144658.904361:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746595840 00000100:00100000:0.0:1746144658.904460:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5788 00000100:00100000:0.0:1746144658.904469:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746595968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.904483:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144658.904511:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 24 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.904514:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144658.904521:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 24 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.904536:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5789 00000100:00100000:1.0:1746144658.904540:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746595840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144658.904543:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013490d600/0xa7c849b16e019c17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8aa expref: 24 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.904547:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.904554:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144658.904557:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144658.904562:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.904573:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273800/0xa7c849b16e019c33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8c6 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144658.904573:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746595968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 107us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144658.904578:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5788 00010000:00010000:1.0:1746144658.904584:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.904597:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746595840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 57us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.904602:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5789 00000100:00100000:0.0:1746144658.905271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.905331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.905346:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746596096 00000100:00100000:3.0:1746144658.905357:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746596096 00000100:00100000:1.0:1746144658.905391:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746596224 00000100:00100000:1.0:1746144658.905395:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746596224 00010000:00010000:3.0:1746144658.905402:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.905410:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 29 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.905429:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5790 00000100:00100000:1.0:1746144658.905435:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746596224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144658.905441:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5791 00010000:00010000:1.0:1746144658.905442:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144658.905449:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746596096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144658.905454:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 29 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.905461:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.905463:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 29 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.905477:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbde000/0xa7c849b16e019c3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8cd expref: 29 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.905480:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.905491:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.905499:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144658.905510:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944a5000/0xa7c849b16e019c2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8bf expref: 23 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.905517:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746596224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.905523:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5790 00010000:00010000:3.0:1746144658.905529:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.905531:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144658.905537:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.905544:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144658.905569:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144658.905580:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747459200:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144658.905675:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.908733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.910457:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746596480 00000100:00100000:2.0:1746144658.910469:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746596480 00002000:00100000:2.0:1746144658.910519:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2531328->2535423) req@ffff88009f16aa00 x1830964746596480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.910528:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16aa00 with x1830964746596480 ext(2531328->2535423) 00002000:00010000:2.0:1746144658.910534:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16aa00 00000100:00100000:2.0:1746144658.910560:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4414 00000100:00100000:2.0:1746144658.910567:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746596480:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144658.910792:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746596480:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 224us (2068us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144658.910799:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4414 00002000:00100000:2.0:1746144658.910805:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2531328->2535423) req@ffff88009f16aa00 x1830964746596480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.910812:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16aa00 with x1830964746596480 ext(2531328->2535423) 00002000:00010000:2.0:1746144658.910816:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16aa00 00000100:00100000:3.0:1746144658.910896:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747459200:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144658.910929:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.910968:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746596096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5520us (5698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.910977:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5791 00000100:00100000:0.0:1746144658.920866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144658.921098:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746596608 00000100:00100000:2.0:1746144658.921108:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746596608 00000100:00100000:2.0:1746144658.921193:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11627 00000100:00100000:2.0:1746144658.921202:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29045:x1830964746596608:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144658.921222:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144658.921243:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e960 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.921278:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.921286:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.921292:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.921294:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144658.921297:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3162111] (req 3145728->3162111) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.921326:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.921337:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144658.921348:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747459328:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.921454:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.921462:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 18 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144658.921470:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747459456:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.921489:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144658.923044:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747459328:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144658.923056:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747459456:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144658.923087:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3162111] (req 3145728->3162111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144658.923102:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b060c00, rc 0) 00000100:00100000:2.0:1746144658.923181:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:29045:x1830964746596608:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1980us (4060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144658.923188:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11627 00000100:00100000:0.0:1746144658.931507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144658.931549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144658.931596:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746596736 00000100:00100000:3.0:1746144658.931608:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746596736 00000100:00100000:1.0:1746144658.931665:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746596864 00010000:00010000:3.0:1746144658.931669:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 19 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144658.931669:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746596864 00010000:00010000:1.0:1746144658.931698:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144658.931703:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5792 00000100:00100000:3.0:1746144658.931712:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746596736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144658.931717:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5793 00000100:00100000:1.0:1746144658.931722:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746596864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144658.931729:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.931729:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144658.931749:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.931751:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 19 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.931760:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.932116:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 19 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.932188:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e3bd400/0xa7c849b16e019c1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b1 expref: 19 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144658.932211:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144658.932258:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746596736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 548us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144658.932265:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5792 00010000:00010000:1.0:1746144658.933063:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e019c25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8b8 expref: 34 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144658.933084:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.933086:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144658.933094:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.933102:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144658.933160:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144658.933173:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747459584:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144658.933254:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144658.937567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144658.937682:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747459584:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144658.937708:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144658.937765:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746596864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6041us (6214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144658.937776:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5793 00000100:00100000:2.0:1746144658.937889:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746597120 00000100:00100000:2.0:1746144658.937896:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746597120 00002000:00100000:2.0:1746144658.937937:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3158016->3162111) req@ffff88012b5f6680 x1830964746597120/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/0 e 0 to 0 dl 1746144669 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.937947:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6680 with x1830964746597120 ext(3158016->3162111) 00002000:00010000:2.0:1746144658.937952:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6680 00000100:00100000:2.0:1746144658.937966:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4415 00000100:00100000:2.0:1746144658.937972:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746597120:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144658.938178:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746597120:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 204us (620us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144658.938426:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4415 00002000:00100000:2.0:1746144658.938432:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3158016->3162111) req@ffff88012b5f6680 x1830964746597120/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:299/0 lens 488/4536 e 0 to 0 dl 1746144669 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144658.938439:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6680 with x1830964746597120 ext(3158016->3162111) 00002000:00010000:2.0:1746144658.938443:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6680 00000100:00100000:0.0:1746144659.043638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.044186:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746597376 00000100:00100000:3.0:1746144659.044197:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746597376 00000100:00100000:3.0:1746144659.045397:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10057 00000100:00100000:3.0:1746144659.045410:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29052:x1830964746597376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.045437:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.045457:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e967 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.045570:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045583:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045594:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045607:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045613:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045619:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045719:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019d67 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045725:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019d67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.045729:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019d67 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144659.045742:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.046067:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.046075:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.046080:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.046086:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135787600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.046091:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.046096:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.046106:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144659.046109:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.046112:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.046127:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135787600/0xa7c849b16e019d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048269:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048282:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048287:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048295:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1f0000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.048298:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048304:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048315:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639600) 00010000:00010000:3.0:1746144659.048317:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.048320:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048325:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144659.048386:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a000/0xa7c849b16e019d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e967 expref: 320 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.048399:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019d67 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e967 expref: 319 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.048406:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.048408:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144659.048410:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1000, rc 0) 00000100:00100000:3.0:1746144659.049156:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:29052:x1830964746597376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3727us (5505us total) trans 8589943935 rc 0/0 00000100:00100000:3.0:1746144659.049165:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10057 00000100:00100000:0.0:1746144659.052369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.053751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.053799:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746597504 00000100:00100000:1.0:1746144659.053810:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746597504 00000100:00100000:2.0:1746144659.053815:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746597760 00000100:00100000:2.0:1746144659.053819:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746597760 00000100:00100000:2.0:1746144659.053868:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4053 00000100:00100000:2.0:1746144659.053875:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:29052:x1830964746597760:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144659.053879:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 627 00000100:00100000:1.0:1746144659.053886:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:1962:x1830964746597504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.053902:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.053927:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1000/0xa7c849b16e019d67 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e967 expref: 320 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.053954:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.053959:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.054006:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:1962:x1830964746597504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.054013:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 627 00000100:00100000:2.0:1746144659.054046:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:29052:x1830964746597760:12345-192.168.204.23@tcp:35:cat.0 Request processed in 171us (299us total) trans 8589943936 rc 0/0 00000100:00100000:2.0:1746144659.054052:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4053 00000100:00100000:0.0:1746144659.058288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.058386:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746597888 00000100:00100000:2.0:1746144659.058395:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746597888 00000100:00100000:2.0:1746144659.058442:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11628 00000100:00100000:2.0:1746144659.058449:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746597888:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.058469:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.058489:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e96e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.058550:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747459712:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144659.059645:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.059806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.060000:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746598016 00000100:00100000:0.0:1746144659.060005:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746598016 00000100:00100000:0.0:1746144659.060044:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11629 00000100:00100000:0.0:1746144659.060051:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746598016:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.060062:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.060073:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e019d7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e975 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.060106:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747459840:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.060162:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.060420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.060624:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746598144 00000100:00100000:0.0:1746144659.060627:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746598144 00000100:00100000:0.0:1746144659.060658:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11630 00000100:00100000:0.0:1746144659.060664:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746598144:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.060672:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.060683:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4273800/0xa7c849b16e019d83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e97c expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.060712:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747459968:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.060758:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.064700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.064764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:0.0:1746144659.064860:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144658 -> 1746144659 00000100:00100000:0.0:1746144659.064884:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747459968:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.064930:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273800/0xa7c849b16e019d83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e97c expref: 34 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.064945:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273800/0xa7c849b16e019d83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e97c expref: 34 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.064959:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273800, rc 0) 00000100:00100000:0.0:1746144659.065001:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746598144:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4336us (4580us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.065009:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11630 00000100:00100000:0.0:1746144659.065153:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746598528 00000100:00100000:0.0:1746144659.065159:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746598528 00000100:00100000:0.0:1746144659.065189:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746598656 00000100:00100000:0.0:1746144659.065191:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746598656 00000100:00100000:0.0:1746144659.065206:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10058 00000100:00100000:0.0:1746144659.065212:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:29054:x1830964746598528:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144659.065231:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.065245:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e019d8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e983 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.065597:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747459840:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.065620:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e019d7c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e975 expref: 31 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.065629:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e019d7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e975 expref: 31 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.065643:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428a800, rc 0) 00000100:00100000:1.0:1746144659.065666:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746598016:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5615us (5861us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.065671:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11629 00000100:00100000:1.0:1746144659.065750:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10059 00000100:00100000:1.0:1746144659.065759:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+29:29060:x1830964746598656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.065769:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.065776:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e019d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e98a expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.065861:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747459712:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.065872:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.065884:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d75 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e96e expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.065886:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.065893:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019d75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e96e expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.065896:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.065906:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0000, rc 0) 00010000:00010000:1.0:1746144659.065907:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.065913:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.065918:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144659.065933:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746597888:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7484us (7657us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.065939:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11628 00010000:00010000:1.0:1746144659.066021:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019da6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.066029:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019da6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.066035:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019da6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144659.066043:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144659.066109:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066127:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066149:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066158:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066163:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066168:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066222:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019dc2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066228:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066234:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144659.066242:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144659.066285:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066292:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066300:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066305:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4587a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144659.066309:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066322:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066333:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144659.066335:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144659.066339:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066344:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4587a00/0xa7c849b16e019db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066352:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066357:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066362:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066366:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a4e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144659.066368:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066372:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066381:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9200) 00010000:00010000:0.0:1746144659.066382:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144659.066384:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066388:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4e00/0xa7c849b16e019dbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144659.066414:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e019d8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e983 expref: 322 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.066425:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e983 expref: 321 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.066430:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144659.066431:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144659.066433:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5a00, rc 0) 00000100:00100000:0.0:1746144659.066462:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:29054:x1830964746598528:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1249us (1773us total) trans 8589943938 rc 0/0 00000100:00100000:0.0:1746144659.066467:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10058 00010000:00010000:1.0:1746144659.067940:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.067950:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.067960:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.067965:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3ade00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144659.067968:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.067972:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.067982:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144659.067984:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144659.067988:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.067992:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ade00/0xa7c849b16e019d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068000:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068005:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068010:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068014:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3ada00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144659.068016:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068020:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068029:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9200) 00010000:00010000:1.0:1746144659.068031:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144659.068033:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068037:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ada00/0xa7c849b16e019d9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.068071:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3acc00/0xa7c849b16e019d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e98a expref: 32 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.068080:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019da6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e98a expref: 31 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.068085:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.068087:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144659.068089:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ad400, rc 0) 00000100:00100000:1.0:1746144659.068159:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+31:29060:x1830964746598656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2401us (3392us total) trans 8589943937 rc 0/0 00000100:00100000:1.0:1746144659.068166:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10059 00000100:00100000:2.0:1746144659.069040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.069193:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746598912 00000100:00100000:0.0:1746144659.069202:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746598912 00000100:00100000:1.0:1746144659.069255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.069268:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4054 00000100:00100000:0.0:1746144659.069279:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:29054:x1830964746598912:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144659.069322:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746599040 00000100:00100000:3.0:1746144659.069326:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746599040 00000100:00100000:3.0:1746144659.069379:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 628 00000100:00100000:3.0:1746144659.069385:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:1960:x1830964746599040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.069397:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.069412:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019dc2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e983 expref: 322 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.069425:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.069429:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.069452:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:1960:x1830964746599040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.069458:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 628 00000100:00100000:0.0:1746144659.069648:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:29054:x1830964746598912:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 369us (611us total) trans 8589943939 rc 0/0 00000100:00100000:0.0:1746144659.069654:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4054 00000100:00100000:0.0:1746144659.070232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.070395:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746599168 00000100:00100000:2.0:1746144659.070399:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746599168 00000100:00100000:2.0:1746144659.070435:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11631 00000100:00100000:2.0:1746144659.070441:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29052:x1830964746599168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.070451:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.070464:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e991 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.070487:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.070494:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.070496:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.070499:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.070527:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.070537:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 21 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.070549:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747460096:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.070612:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.071961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.072180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.072513:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746599552 00000100:00100000:1.0:1746144659.072519:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746599552 00000100:00100000:0.0:1746144659.072585:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746599424 00000100:00100000:0.0:1746144659.072588:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746599424 00000100:00100000:0.0:1746144659.072614:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4055 00000100:00100000:0.0:1746144659.072620:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:29060:x1830964746599424:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144659.072784:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:29060:x1830964746599424:12345-192.168.204.23@tcp:35:cat.0 Request processed in 164us (831us total) trans 8589943940 rc 0/0 00000100:00100000:0.0:1746144659.072790:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4055 00000100:00100000:3.0:1746144659.073664:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747460096:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.073691:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.073707:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f0ce00, rc 0) 00000100:00100000:3.0:1746144659.073731:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29052:x1830964746599168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3290us (3500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.073739:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11631 00000100:00100000:1.0:1746144659.074289:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 629 00000100:00100000:1.0:1746144659.074297:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746599552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.074309:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.074335:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019da6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e98a expref: 32 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.074352:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.074355:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.074380:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+31:1961:x1830964746599552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 85us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.074386:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 629 00000100:00100000:0.0:1746144659.076474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.076992:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746599680 00000100:00100000:2.0:1746144659.077001:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746599680 00002000:00100000:2.0:1746144659.077050:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1679360->2097151) req@ffff88008c7d2680 x1830964746599680/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.077059:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2680 with x1830964746599680 ext(1679360->2097151) 00010000:00010000:2.0:1746144659.077068:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 22 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.077082:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 22 pid: 7257 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.077088:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c7d2680 00000100:00100000:2.0:1746144659.077130:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 857 00000100:00100000:2.0:1746144659.077180:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746599680:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144659.089030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.089078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.089174:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600064 00000100:00100000:3.0:1746144659.089187:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600064 00000100:00100000:2.0:1746144659.089201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.089246:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600192 00000100:00100000:3.0:1746144659.089249:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600192 00000100:00100000:2.0:1746144659.089261:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600320 00000100:00100000:2.0:1746144659.089267:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600320 00000100:00100000:3.0:1746144659.089273:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11632 00000100:00100000:3.0:1746144659.089281:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746600064:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.089301:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144659.089302:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11633 00000100:00100000:2.0:1746144659.089310:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746600192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.089321:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e019dd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e998 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.089321:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.089335:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b061800/0xa7c849b16e019dde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9a6 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.089376:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747460352:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144659.089377:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747460224:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.089569:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11634 00000100:00100000:1.0:1746144659.089581:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746600320:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.089591:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.089602:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019de5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9ad expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.089635:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747460480:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.089964:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.090231:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.090401:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.093478:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747460224:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.093509:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b061800/0xa7c849b16e019dde lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9a6 expref: 19 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.093522:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b061800/0xa7c849b16e019dde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9a6 expref: 19 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144659.093528:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747460352:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.093537:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b061800, rc 0) 00010000:00010000:3.0:1746144659.093558:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e019dd7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e998 expref: 27 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.093568:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135787600/0xa7c849b16e019dd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e998 expref: 27 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144659.093574:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746600192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4265us (4496us total) trans 0 rc 301/301 00010000:00010000:3.0:1746144659.093579:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135787600, rc 0) 00000100:00100000:2.0:1746144659.093581:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11633 00000100:00100000:3.0:1746144659.093600:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746600064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4321us (4582us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.093607:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11632 00000100:00100000:1.0:1746144659.093806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.093826:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746599936 00000100:00100000:1.0:1746144659.093832:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746599936 00000100:00100000:1.0:1746144659.093866:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10060 00000100:00100000:1.0:1746144659.093873:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+31:29059:x1830964746599936:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144659.093894:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.093908:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e99f expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.094011:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094024:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094035:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094046:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094051:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094055:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094188:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac200/0xa7c849b16e019e01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094196:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac200/0xa7c849b16e019e01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094201:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac200/0xa7c849b16e019e01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:1.0:1746144659.094210:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144659.094288:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094295:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094300:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094304:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3ad000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144659.094306:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094313:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.094322:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00000100:00100000:0.0:1746144659.094412:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747460480:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.094435:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019de5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9ad expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.094445:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3ad400/0xa7c849b16e019de5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9ad expref: 25 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.094459:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ad400, rc 0) 00000100:00100000:0.0:1746144659.094514:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746600320:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4935us (5313us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.094521:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11634 00010000:00010000:1.0:1746144659.095501:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144659.095508:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095512:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ad000/0xa7c849b16e019df3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095526:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095531:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095535:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095538:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3aca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144659.095541:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095545:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095552:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9600) 00010000:00010000:1.0:1746144659.095554:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144659.095555:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095559:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3aca00/0xa7c849b16e019dfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.095601:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac600/0xa7c849b16e019dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e99f expref: 34 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.095611:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac200/0xa7c849b16e019e01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e99f expref: 33 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.095617:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.095619:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144659.095621:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3ac200, rc 0) 00000100:00100000:1.0:1746144659.095646:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:29059:x1830964746599936:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1773us (1841us total) trans 8589943941 rc 0/0 00000100:00100000:1.0:1746144659.095652:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10060 00000100:00100000:2.0:1746144659.097629:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746599680:12345-192.168.204.23@tcp:4:cat.0 Request processed in 20444us (21154us total) trans 21474840476 rc 0/0 00000100:00100000:2.0:1746144659.097639:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 857 00002000:00100000:2.0:1746144659.097649:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1679360->2097151) req@ffff88008c7d2680 x1830964746599680/t21474840476(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.097658:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2680 with x1830964746599680 ext(1679360->2097151) 00010000:00010000:2.0:1746144659.097667:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 24 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.097680:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 24 pid: 7257 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.097687:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c7d2680 00000100:00100000:0.0:1746144659.101573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.103423:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600448 00000100:00100000:2.0:1746144659.103435:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600448 00000100:00100000:2.0:1746144659.103493:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11635 00000100:00100000:2.0:1746144659.103501:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:29060:x1830964746600448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.103519:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.103539:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9b4 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.103566:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.103570:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.103581:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.103595:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b21f8400, rc 0) 00000100:00100000:2.0:1746144659.103649:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:29060:x1830964746600448:12345-192.168.204.23@tcp:101:cat.0 Request processed in 149us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.103655:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11635 00000100:00100000:2.0:1746144659.105368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.105488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.105540:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600576 00000100:00100000:1.0:1746144659.105546:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600576 00000100:00100000:1.0:1746144659.105599:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600704 00000100:00100000:1.0:1746144659.105602:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600704 00010000:00010000:1.0:1746144659.105616:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 25 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.105634:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5794 00000100:00100000:1.0:1746144659.105639:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746600704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.105651:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.105672:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 25 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.105684:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 25 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.105704:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135786400/0xa7c849b16e019ce2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1679360->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e913 expref: 25 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.105721:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.105722:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.105728:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.105737:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.105742:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 630 00010000:00010000:1.0:1746144659.105743:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.105744:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.105747:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.105753:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.105779:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 24 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.105790:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747460608:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.105866:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.105878:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747460736:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.105893:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.106056:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746600576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.106069:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.106087:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3ac200/0xa7c849b16e019e01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e99f expref: 33 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.106108:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.106113:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.106191:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746600576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 438us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.106201:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 630 00000100:00100000:0.0:1746144659.112782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.113090:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747460608:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.113101:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747460736:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.113132:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.113212:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746600704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7571us (7724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.113224:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5794 00000100:00100000:2.0:1746144659.113602:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746600960 00000100:00100000:2.0:1746144659.113610:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746600960 00002000:00100000:2.0:1746144659.113649:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88013129d180 x1830964746600960/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.113658:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129d180 with x1830964746600960 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.113662:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129d180 00000100:00100000:2.0:1746144659.113677:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4416 00000100:00100000:2.0:1746144659.113682:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746600960:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.126044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.126127:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746601216 00000100:00100000:2.0:1746144659.126160:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746601216 00000100:00100000:0.0:1746144659.126293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.126685:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746600960:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13000us (13911us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.126695:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4416 00002000:00100000:3.0:1746144659.126709:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88013129d180 x1830964746600960/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.126717:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129d180 with x1830964746600960 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.126723:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129d180 00002000:00100000:2.0:1746144659.126890:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012b1cfb80 x1830964746601216/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.126899:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cfb80 with x1830964746601216 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.126902:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cfb80 00000100:00100000:3.0:1746144659.126974:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746601344 00000100:00100000:3.0:1746144659.126979:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746601344 00002000:00100000:3.0:1746144659.127017:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1347584->2097151) req@ffff88012b1cf800 x1830964746601344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.127025:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf800 with x1830964746601344 ext(1347584->2097151) 00002000:00010000:3.0:1746144659.127029:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf800 00000100:00100000:3.0:1746144659.127051:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4417 00000100:00100000:3.0:1746144659.127060:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746601216:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.128437:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4418 00000100:00100000:0.0:1746144659.128447:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746601344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.139422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.140522:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746601344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12074us (14226us total) trans 0 rc 749568/749568 00000100:00100000:1.0:1746144659.140533:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4418 00002000:00100000:1.0:1746144659.140546:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1347584->2097151) req@ffff88012b1cf800 x1830964746601344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.140556:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf800 with x1830964746601344 ext(1347584->2097151) 00002000:00010000:1.0:1746144659.140561:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf800 00000100:00100000:3.0:1746144659.140818:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746601600 00000100:00100000:3.0:1746144659.140827:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746601600 00000100:00100000:3.0:1746144659.140872:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11636 00000100:00100000:3.0:1746144659.140880:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29052:x1830964746601600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.140895:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.140913:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9bb expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.140947:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.140955:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144659.140957:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144659.140961:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 30 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.140989:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.141000:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 25 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.141011:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747460864:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.141078:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.144376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.144510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.144587:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747460864:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.144626:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 30 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144645:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ac00, rc 0) 00000100:00100000:0.0:1746144659.144684:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29052:x1830964746601600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3805us (5272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.144693:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11636 00000100:00100000:0.0:1746144659.144721:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746601728 00000100:00100000:0.0:1746144659.144726:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746601728 00000100:00100000:0.0:1746144659.144756:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11637 00000100:00100000:0.0:1746144659.144762:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29054:x1830964746601728:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144659.144778:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.144791:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9c2 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144813:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144820:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144827:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.144829:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.144832:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1482752->2052095] (req 1482752->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144856:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144866:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 25 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.144876:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747460992:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.144934:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.144942:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.144949:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747461120:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144659.144967:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.145037:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746601856 00000100:00100000:1.0:1746144659.145041:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746601856 00002000:00100000:1.0:1746144659.145067:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1347583) req@ffff88012b1ce680 x1830964746601856/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.145076:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ce680 with x1830964746601856 ext(1048576->1347583) 00010000:00010000:1.0:1746144659.145082:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.145096:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00002000:00010000:1.0:1746144659.145101:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1ce680 00000100:00100000:1.0:1746144659.145155:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 858 00000100:00100000:1.0:1746144659.145163:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746601856:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144659.146684:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746601216:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19622us (20648us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.146693:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4417 00002000:00100000:3.0:1746144659.146701:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012b1cfb80 x1830964746601216/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.146708:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cfb80 with x1830964746601216 ext(1048576->2097151) 00010000:00010000:3.0:1746144659.146714:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.146729:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.146735:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1cfb80 00000100:00100000:1.0:1746144659.149666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.149746:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747460992:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144659.149817:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747461120:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.149847:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1482752->2052095] (req 1482752->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.149863:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a5a00, rc 0) 00000100:00100000:2.0:1746144659.150064:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746601984 00000100:00100000:2.0:1746144659.150075:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746601984 00010000:00010000:2.0:1746144659.150106:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.150173:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5795 00000100:00100000:2.0:1746144659.150181:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746601984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.150193:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.150213:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.150223:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.150245:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019dd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e991 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.150264:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29054:x1830964746601728:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5500us (5897us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.150272:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11637 00010000:00010000:2.0:1746144659.151337:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.151370:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746601984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1188us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.151378:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5795 00000100:00100000:0.0:1746144659.155932:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746601856:12345-192.168.204.23@tcp:4:cat.0 Request processed in 10758us (11409us total) trans 21474840477 rc 0/0 00000100:00100000:0.0:1746144659.155946:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 858 00002000:00100000:0.0:1746144659.155958:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1347583) req@ffff88012b1ce680 x1830964746601856/t21474840477(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.155966:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ce680 with x1830964746601856 ext(1048576->1347583) 00010000:00010000:0.0:1746144659.155977:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.155989:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00002000:00010000:0.0:1746144659.155995:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1ce680 00000100:00100000:0.0:1746144659.160833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.160956:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746602112 00000100:00100000:2.0:1746144659.160965:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746602112 00010000:00010000:2.0:1746144659.161005:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.161017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.161081:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5796 00000100:00100000:2.0:1746144659.161090:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746602112:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.161106:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144659.161126:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746602240 00000100:00100000:1.0:1746144659.161131:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746602240 00010000:00010000:2.0:1746144659.161162:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.161173:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.161194:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f8400/0xa7c849b16e019e0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9b4 expref: 26 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.161215:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.161216:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.161223:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.161232:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746144659.161245:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746144659.161265:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.161277:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747461248:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.161277:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10061 00000100:00100000:1.0:1746144659.161286:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29061:x1830964746602240:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144659.161307:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.161322:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9c9 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.161344:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746144659.161378:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144659.161379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144659.161388:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.161396:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.161408:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.161413:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.161419:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:0.0:1746144659.161437:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746602368 00000100:00100000:0.0:1746144659.161441:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746602368 00000100:00100000:0.0:1746144659.161475:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11638 00000100:00100000:0.0:1746144659.161481:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:29060:x1830964746602368:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.161489:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.161497:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9d0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.161511:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144659.161517:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.161526:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.161535:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdad600, rc 0) 00000100:00100000:0.0:1746144659.161559:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+27:29060:x1830964746602368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.161565:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11638 00010000:00010000:1.0:1746144659.161740:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.161750:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 320 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.161755:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.161774:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 320 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.161784:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 320 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.161793:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747461376:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.161863:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.162270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.162614:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746602496 00000100:00100000:3.0:1746144659.162619:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746602496 00010000:00010000:3.0:1746144659.162638:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 27 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.162691:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5797 00000100:00100000:3.0:1746144659.162699:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746602496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.162707:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.162722:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 27 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.162730:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 27 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.162741:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fabd600/0xa7c849b16e019d05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1347583) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e936 expref: 27 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.162765:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.162767:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.162771:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.162782:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.162789:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.162790:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.162793:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.162799:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.163092:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.163102:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747461504:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144659.163204:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.163213:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747461632:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144659.163230:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.164177:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747461248:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144659.164193:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.164217:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746602112:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3127us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.164226:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5796 00000100:00100000:0.0:1746144659.164786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.165160:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747461376:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.165178:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:1.0:1746144659.165252:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746602752 00000100:00100000:1.0:1746144659.165257:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746602752 00002000:00100000:1.0:1746144659.165291:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1482752->1486847) req@ffff88012b1cd180 x1830964746602752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.165300:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cd180 with x1830964746602752 ext(1482752->1486847) 00002000:00010000:1.0:1746144659.165304:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cd180 00000100:00100000:1.0:1746144659.165318:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4419 00000100:00100000:1.0:1746144659.165324:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746602752:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144659.165481:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746602752:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 156us (695us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144659.165486:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4419 00002000:00100000:1.0:1746144659.165491:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1482752->1486847) req@ffff88012b1cd180 x1830964746602752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.165497:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cd180 with x1830964746602752 ext(1482752->1486847) 00002000:00010000:1.0:1746144659.165501:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cd180 00000100:00100000:0.0:1746144659.165709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.165875:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747461504:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144659.165884:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747461632:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144659.165903:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.165923:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746602496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3226us (3653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.165930:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5797 00000100:00100000:3.0:1746144659.165948:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746602880 00000100:00100000:3.0:1746144659.165951:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746602880 00010000:00010000:3.0:1746144659.165963:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 321 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.165977:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5798 00000100:00100000:3.0:1746144659.165983:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:1961:x1830964746602880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.165991:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.165995:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 321 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.166005:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 321 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.166023:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e019c56 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e2 expref: 321 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.166035:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.166039:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.166047:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.166053:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.166067:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.166079:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:1961:x1830964746602880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.166084:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5798 00010000:00010000:2.0:1746144659.166228:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166235:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144659.166278:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144659.166282:0:15388:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144659.166297:0:15388:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166306:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166315:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166321:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166327:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166332:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428a800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.166336:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166342:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166351:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144659.166353:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144659.166356:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166360:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a800/0xa7c849b16e019e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166369:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166373:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166377:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166381:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428be00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.166383:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166387:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166392:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9000) 00010000:00010000:2.0:1746144659.166393:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144659.166395:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166399:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428be00/0xa7c849b16e019e32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.166427:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093f0ce00/0xa7c849b16e019e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.166439:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.166445:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.166447:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144659.166449:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428b000, rc 0) 00000100:00100000:2.0:1746144659.166471:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29061:x1830964746602240:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5188us (5452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.166477:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10061 00000100:00100000:0.0:1746144659.168403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.168527:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746603136 00000100:00100000:2.0:1746144659.168535:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746603136 00002000:00100000:2.0:1746144659.168569:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b1cdf80 x1830964746603136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.168577:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cdf80 with x1830964746603136 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.168582:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cdf80 00000100:00100000:0.0:1746144659.168890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.169330:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746603392 00000100:00100000:2.0:1746144659.169334:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746603392 00002000:00100000:2.0:1746144659.169351:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b1cf480 x1830964746603392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.169359:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf480 with x1830964746603392 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.169363:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf480 00000100:00100000:0.0:1746144659.169501:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4420 00000100:00100000:0.0:1746144659.169509:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746603136:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144659.169669:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4421 00000100:00100000:2.0:1746144659.169677:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746603392:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.175905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.175943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.175966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.175980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.176002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.176025:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746603520 00000100:00100000:3.0:1746144659.176034:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746603520 00000100:00100000:3.0:1746144659.176082:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746603648 00000100:00100000:3.0:1746144659.176084:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746603648 00000100:00100000:3.0:1746144659.176111:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746603776 00000100:00100000:3.0:1746144659.176125:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746603776 00000100:00100000:3.0:1746144659.176172:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746603904 00000100:00100000:3.0:1746144659.176175:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746603904 00000100:00100000:3.0:1746144659.176189:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746604032 00000100:00100000:3.0:1746144659.176191:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746604032 00000100:00100000:3.0:1746144659.176206:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11639 00000100:00100000:3.0:1746144659.176214:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746603520:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144659.176234:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.176253:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9d7 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.176276:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.176278:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.176288:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.176304:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.176315:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a000, rc 0) 00000100:00100000:3.0:1746144659.176360:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746603520:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 146us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.176366:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11639 00000100:00100000:3.0:1746144659.176388:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11640 00000100:00100000:3.0:1746144659.176395:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746603648:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144659.176402:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.176413:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019e4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9de expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.176456:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747461760:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.176526:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00080000:3.0:1746144659.176544:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746144659.176547:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144659.176573:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11641 00000100:00100000:3.0:1746144659.176582:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746603776:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144659.176589:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.176596:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9e5 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.176607:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.176608:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.176614:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 9 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.176628:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 9 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.176635:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132568200, rc 0) 00000100:00100000:3.0:1746144659.176651:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746603776:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 72us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.176656:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11641 00000100:00100000:3.0:1746144659.176668:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11642 00000100:00100000:3.0:1746144659.176674:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746603904:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144659.176680:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.176687:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132568400/0xa7c849b16e019e5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9ec expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.176712:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747461888:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.176732:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.176746:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11643 00000100:00100000:3.0:1746144659.176754:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746604032:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144659.176761:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.176767:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132568a00/0xa7c849b16e019e63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9f3 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.176788:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747462016:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.176806:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.178187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.178843:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746604288 00000100:00100000:2.0:1746144659.178853:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746604288 00002000:00100000:2.0:1746144659.178899:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (2048000->2052095) req@ffff88013092b800 x1830964746604288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.178908:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092b800 with x1830964746604288 ext(2048000->2052095) 00002000:00010000:2.0:1746144659.178914:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013092b800 00000100:00100000:2.0:1746144659.178945:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4422 00000100:00100000:2.0:1746144659.178952:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746604288:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144659.179158:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746604288:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 181us (950us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144659.179165:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4422 00002000:00100000:2.0:1746144659.179171:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (2048000->2052095) req@ffff88013092b800 x1830964746604288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.179178:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092b800 with x1830964746604288 ext(2048000->2052095) 00002000:00010000:2.0:1746144659.179181:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013092b800 00000100:00100000:1.0:1746144659.194691:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747462016:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.194708:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747461760:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.194735:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019e4e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9de expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.194735:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132568a00/0xa7c849b16e019e63 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9f3 expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144659.194747:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746603136:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 25236us (26346us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746144659.194748:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1f0000/0xa7c849b16e019e4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9de expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.194748:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132568a00/0xa7c849b16e019e63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9f3 expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144659.194758:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4420 00010000:00010000:3.0:1746144659.194762:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1f0000, rc 0) 00010000:00010000:1.0:1746144659.194762:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132568a00, rc 0) 00002000:00100000:2.0:1746144659.194769:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b1cdf80 x1830964746603136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.194777:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cdf80 with x1830964746603136 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.194782:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cdf80 00000100:00100000:3.0:1746144659.194783:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746603648:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 18390us (18840us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.194790:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11640 00000100:00100000:1.0:1746144659.194792:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746604032:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 18039us (18788us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.194798:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11643 00000100:00100000:0.0:1746144659.194886:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747461888:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.194905:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132568400/0xa7c849b16e019e5c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9ec expref: 8 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.194914:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132568400/0xa7c849b16e019e5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9ec expref: 8 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.194931:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132568400, rc 0) 00000100:00100000:0.0:1746144659.194950:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746603904:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 18277us (18968us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.194962:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11642 00000100:00100000:3.0:1746144659.195036:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746603392:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25360us (26146us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.195047:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4421 00002000:00100000:3.0:1746144659.195053:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b1cf480 x1830964746603392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.195059:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf480 with x1830964746603392 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.195063:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf480 00000100:00100000:1.0:1746144659.195396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.195442:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746604544 00000100:00100000:3.0:1746144659.195448:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746604544 00000100:00100000:3.0:1746144659.195661:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4056 00000100:00100000:3.0:1746144659.195672:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:29054:x1830964746604544:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144659.195846:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:29054:x1830964746604544:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 177us (451us total) trans 8589943942 rc 0/0 00000100:00100000:3.0:1746144659.195852:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4056 00000100:00100000:0.0:1746144659.200416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.200526:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746604800 00000100:00100000:3.0:1746144659.200537:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746604800 00000100:00100000:3.0:1746144659.200600:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10062 00000100:00100000:3.0:1746144659.200609:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29061:x1830964746604800:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144659.200632:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.200650:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132569200/0xa7c849b16e019e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152e9fa expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.200751:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.200767:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.200773:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.200804:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.200817:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 11 pid: 15388 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.200828:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747462144:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.200896:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.202348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.202382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.202399:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746604928 00000100:00100000:1.0:1746144659.202403:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746604928 00000100:00100000:1.0:1746144659.202428:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746605056 00000100:00100000:1.0:1746144659.202431:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746605056 00000100:00100000:1.0:1746144659.202443:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11644 00000100:00100000:1.0:1746144659.202448:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29052:x1830964746604928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.202459:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.202471:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea01 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.202490:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.202492:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.202499:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.202512:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.202520:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3bc00, rc 0) 00000100:00100000:1.0:1746144659.202546:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:29052:x1830964746604928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.202552:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11644 00000100:00100000:1.0:1746144659.202565:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11645 00000100:00100000:1.0:1746144659.202569:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746605056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.202575:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.202583:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3b800/0xa7c849b16e019e7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea08 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.202611:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747462272:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.202644:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.202665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.202677:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746605184 00000100:00100000:1.0:1746144659.202679:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746605184 00000100:00100000:1.0:1746144659.202693:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11646 00000100:00100000:1.0:1746144659.202696:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746605184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.202703:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.202707:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b200/0xa7c849b16e019e86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea0f expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.202727:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747462400:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.202742:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.202776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.202949:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746605312 00000100:00100000:2.0:1746144659.202953:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746605312 00000100:00100000:2.0:1746144659.202974:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11647 00000100:00100000:2.0:1746144659.202979:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746605312:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.202985:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.202993:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019e8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea16 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.203015:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747462528:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144659.203036:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.204469:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747462400:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.204496:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b200/0xa7c849b16e019e86 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea0f expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.204508:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b200/0xa7c849b16e019e86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea0f expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.204517:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3b200, rc 0) 00000100:00100000:0.0:1746144659.204545:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746605184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1847us (1879us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.204551:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11646 00000100:00100000:3.0:1746144659.204677:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747462144:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.204705:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144659.204783:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747462528:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.204801:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019e8d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea16 expref: 28 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.204809:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019e8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea16 expref: 28 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.204820:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbdf000, rc 0) 00000100:00100000:2.0:1746144659.204840:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746605312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1860us (2063us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.204845:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11647 00000100:00100000:1.0:1746144659.204966:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747462272:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.204986:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3b800/0xa7c849b16e019e7f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea08 expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.204993:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3b800/0xa7c849b16e019e7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea08 expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.205008:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3b800, rc 0) 00000100:00100000:1.0:1746144659.205025:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746605056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2455us (2643us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.205029:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11645 00000100:00100000:0.0:1746144659.205692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.205743:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746605440 00000100:00100000:1.0:1746144659.205749:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746605440 00010000:00010000:1.0:1746144659.205774:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 12 pid: 15388 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.206042:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5799 00000100:00100000:1.0:1746144659.206049:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746605440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.206063:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.206068:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 12 pid: 15388 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.206078:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 12 pid: 15388 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.206094:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e019e40 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c9 expref: 12 pid: 15388 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.206105:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.206110:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.206127:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.206169:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144659.206675:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144659.206731:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.206738:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144659.206759:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.206901:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132569200/0xa7c849b16e019e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9fa expref: 13 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.206926:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9fa expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.206932:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.206934:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144659.206936:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132569400, rc 0) 00000100:00100000:1.0:1746144659.206984:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746605440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 934us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.206990:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5799 00000100:00100000:3.0:1746144659.207086:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29061:x1830964746604800:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 6478us (6682us total) trans 8589943943 rc 0/0 00000100:00100000:3.0:1746144659.207092:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10062 00000100:00100000:0.0:1746144659.211249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.211283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.211296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.211306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.211337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.211370:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746605568 00000100:00100000:0.0:1746144659.211383:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746605568 00000100:00100000:0.0:1746144659.211432:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11648 00000100:00100000:0.0:1746144659.211440:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:29060:x1830964746605568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.211459:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.211478:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea1d expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.211508:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.211516:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144659.211517:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144659.211521:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.211552:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.211565:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 29 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.211578:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747462656:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144659.211659:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.211738:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746605824 00000100:00100000:3.0:1746144659.211742:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746605824 00002000:00100000:3.0:1746144659.211791:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093e33800 x1830964746605824/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.211800:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33800 with x1830964746605824 ext(2097152->3145727) 00002000:00010000:3.0:1746144659.211805:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e33800 00000100:00100000:3.0:1746144659.211818:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746606080 00000100:00100000:3.0:1746144659.211821:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746606080 00002000:00100000:3.0:1746144659.211834:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3162112->4194303) req@ffff880093e30700 x1830964746606080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.211840:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30700 with x1830964746606080 ext(3162112->4194303) 00002000:00010000:3.0:1746144659.211845:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30700 00000100:00100000:3.0:1746144659.211853:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746606336 00000100:00100000:3.0:1746144659.211855:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746606336 00002000:00100000:3.0:1746144659.211868:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3760127) req@ffff880093e31880 x1830964746606336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 504/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.211874:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31880 with x1830964746606336 ext(2097152->3760127) 00010000:00010000:3.0:1746144659.211879:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.211889:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 30 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.211900:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e31880 00000100:00100000:3.0:1746144659.211913:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746606592 00000100:00100000:3.0:1746144659.211915:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746606592 00002000:00100000:3.0:1746144659.211929:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3760128->4194303) req@ffff880093e33100 x1830964746606592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.211935:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33100 with x1830964746606592 ext(3760128->4194303) 00010000:00010000:3.0:1746144659.211939:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.211947:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.211952:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e33100 00000100:00100000:3.0:1746144659.211963:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 859 00000100:00100000:3.0:1746144659.211970:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746606336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.213298:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 860 00000100:00100000:3.0:1746144659.213312:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746606592:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.213720:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4423 00000100:00100000:2.0:1746144659.213730:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746605824:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.214410:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4424 00000100:00100000:0.0:1746144659.214418:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746606080:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.215992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.216056:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746606848 00000100:00100000:2.0:1746144659.216063:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746606848 00000100:00100000:2.0:1746144659.216103:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10063 00000100:00100000:2.0:1746144659.216109:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29061:x1830964746606848:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144659.216149:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.216154:0:15388:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144659.216182:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132569400/0xa7c849b16e019e71 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9fa expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.216208:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.216213:0:15388:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144659.216224:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019ea2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea24 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.216313:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216324:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216333:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216342:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216348:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216353:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216358:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bbde400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.216361:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216366:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216375:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.216377:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144659.216380:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216384:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbde400/0xa7c849b16e019ea9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.216404:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019ea2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea24 expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.216410:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdf000/0xa7c849b16e019ea2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea24 expref: 11 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.216417:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbdf000, rc 0) 00000100:00100000:2.0:1746144659.216446:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29061:x1830964746606848:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 337us (458us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.216452:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10063 00000100:00100000:1.0:1746144659.220077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.220186:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746607232 00000100:00100000:0.0:1746144659.220195:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746607232 00000100:00100000:0.0:1746144659.220295:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4057 00000100:00100000:0.0:1746144659.220304:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29061:x1830964746607232:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:0.0:1746144659.220551:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29061:x1830964746607232:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 246us (484us total) trans 8589943944 rc 0/0 00000100:00100000:0.0:1746144659.220559:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4057 00000100:00100000:0.0:1746144659.220902:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747462656:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.220934:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.220952:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46ec00, rc 0) 00000100:00100000:0.0:1746144659.220989:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:29060:x1830964746605568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9549us (9750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.220996:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11648 00000100:00100000:2.0:1746144659.222877:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746606336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10903us (11563us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.222886:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 859 00002000:00100000:2.0:1746144659.222897:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3760127) req@ffff880093e31880 x1830964746606336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 504/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.222906:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31880 with x1830964746606336 ext(2097152->3760127) 00010000:00010000:2.0:1746144659.222915:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.222935:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 32 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.222941:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e31880 00000100:00100000:0.0:1746144659.228361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.228597:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746606976 00000100:00100000:2.0:1746144659.228607:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746606976 00002000:00100000:2.0:1746144659.228650:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2531328->3145727) req@ffff880093e32680 x1830964746606976/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.228660:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32680 with x1830964746606976 ext(2531328->3145727) 00010000:00010000:2.0:1746144659.228669:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.228683:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.228685:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746606592:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15379us (17346us total) trans 0 rc 434176/434176 00002000:00010000:2.0:1746144659.228691:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e32680 00000100:00100000:3.0:1746144659.228694:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 860 00002000:00100000:3.0:1746144659.228701:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3760128->4194303) req@ffff880093e33100 x1830964746606592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 434176/434176 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.228707:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33100 with x1830964746606592 ext(3760128->4194303) 00000100:00100000:2.0:1746144659.228709:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 861 00010000:00010000:3.0:1746144659.228711:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.228715:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746606976:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:3.0:1746144659.228719:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 31 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.228725:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e33100 00000100:00100000:2.0:1746144659.229801:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746605824:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16069us (18511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.229809:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4423 00002000:00100000:2.0:1746144659.229815:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093e33800 x1830964746605824/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.229822:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33800 with x1830964746605824 ext(2097152->3145727) 00002000:00010000:2.0:1746144659.229827:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e33800 00000100:00100000:2.0:1746144659.232671:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746606080:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18242us (21361us total) trans 0 rc 1032192/1032192 00000100:00100000:2.0:1746144659.232688:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4424 00002000:00100000:2.0:1746144659.234921:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3162112->4194303) req@ffff880093e30700 x1830964746606080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746144659.234927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:2.0:1746144659.234933:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30700 with x1830964746606080 ext(3162112->4194303) 00002000:00010000:2.0:1746144659.234938:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30700 00000100:00100000:0.0:1746144659.234952:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746607360 00000100:00100000:0.0:1746144659.234959:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746607360 00000100:00100000:0.0:1746144659.234994:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11649 00000100:00100000:0.0:1746144659.235001:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29052:x1830964746607360:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.235018:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.235036:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea2b expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.235061:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144659.235066:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.235076:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.235091:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46fa00, rc 0) 00000100:00100000:0.0:1746144659.235800:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29052:x1830964746607360:12345-192.168.204.23@tcp:101:cat.0 Request processed in 796us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.235806:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11649 00000100:00100000:2.0:1746144659.240905:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746606976:12345-192.168.204.23@tcp:4:cat.0 Request processed in 12178us (12543us total) trans 21474840478 rc 0/0 00000100:00100000:2.0:1746144659.240918:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 861 00002000:00100000:2.0:1746144659.240931:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2531328->3145727) req@ffff880093e32680 x1830964746606976/t21474840478(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.240940:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32680 with x1830964746606976 ext(2531328->3145727) 00010000:00010000:2.0:1746144659.240949:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.240962:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.240969:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e32680 00000100:00100000:0.0:1746144659.244967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.245073:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746607488 00000100:00100000:1.0:1746144659.245083:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746607488 00010000:00010000:1.0:1746144659.245167:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.245366:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5800 00000100:00100000:1.0:1746144659.245374:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746607488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.245389:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.245415:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.245428:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.245450:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099929800/0xa7c849b16e019d44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2531328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e959 expref: 33 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.245797:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.245800:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.245808:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.245817:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.245825:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.245826:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.245829:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 32 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.245840:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 32 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.245871:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 32 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.245883:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747462784:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.246618:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.246667:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747462912:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.246704:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.249319:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747462784:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.250653:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747462912:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.250678:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.250729:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746607488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5355us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.250739:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5800 00000100:00100000:0.0:1746144659.257531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.257571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.257649:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746607744 00000100:00100000:2.0:1746144659.257660:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746607744 00000100:00100000:0.0:1746144659.257668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.257689:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746608128 00000100:00100000:2.0:1746144659.257692:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746608128 00002000:00100000:2.0:1746144659.257733:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee01500 x1830964746608128/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.257743:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01500 with x1830964746608128 ext(3145728->4194303) 00002000:00010000:2.0:1746144659.257749:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee01500 00000100:00100000:3.0:1746144659.257755:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746608000 00000100:00100000:3.0:1746144659.257758:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746608000 00000100:00100000:2.0:1746144659.257770:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4425 00000100:00100000:2.0:1746144659.257777:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746608128:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:3.0:1746144659.257789:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee00700 x1830964746608000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.257795:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00700 with x1830964746608000 ext(2097152->3145727) 00002000:00010000:3.0:1746144659.257797:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee00700 00000100:00100000:3.0:1746144659.257819:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4426 00000100:00100000:3.0:1746144659.257825:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746608000:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144659.259076:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee02680 x1830964746607744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.259086:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02680 with x1830964746607744 ext(2097152->3145727) 00002000:00010000:2.0:1746144659.259090:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee02680 00000100:00100000:2.0:1746144659.259119:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4427 00000100:00100000:2.0:1746144659.259129:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746607744:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.259714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.259738:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746608384 00000100:00100000:0.0:1746144659.259743:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746608384 00000100:00100000:0.0:1746144659.259765:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11650 00000100:00100000:0.0:1746144659.259770:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:29059:x1830964746608384:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144659.259779:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.259797:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea32 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.259821:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 35 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.259830:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 5 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.259836:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.259846:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.259848:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.259851:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1294336->2097151] (req 1294336->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 29 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.259878:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.259888:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.259899:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463040:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.259979:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 5 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.259987:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 5 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746144659.259995:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463168:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.260734:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 35 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.260743:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 35 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.260757:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463296:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144659.260806:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.264296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.264341:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746608512 00000100:00100000:0.0:1746144659.264351:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746608512 00010000:00010000:0.0:1746144659.264389:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 6 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746144659.264435:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5801 00000100:00100000:0.0:1746144659.264442:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746608512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144659.264455:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144659.264478:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 6 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.264488:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 6 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.264513:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144659.264552:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746608512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 110us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.264559:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5801 00000100:00100000:1.0:1746144659.266404:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463040:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.266420:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132568200/0xa7c849b16e019e55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9e5 expref: 5 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746144659.266450:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463168:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.266461:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463296:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.266493:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1294336->2097151] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 29 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.266507:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46f600, rc 0) 00000100:00100000:1.0:1746144659.266542:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+29:29059:x1830964746608384:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6771us (6828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.266549:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11650 00000100:00100000:0.0:1746144659.268330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.270698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.271443:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746608128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13663us (13868us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.271455:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4425 00002000:00100000:2.0:1746144659.271468:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee01500 x1830964746608128/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.271477:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01500 with x1830964746608128 ext(3145728->4194303) 00002000:00010000:2.0:1746144659.271483:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee01500 00000100:00100000:1.0:1746144659.271562:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746608640 00000100:00100000:1.0:1746144659.271572:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746608640 00010000:00010000:1.0:1746144659.271605:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.271628:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746608768 00000100:00100000:1.0:1746144659.271629:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746608768 00010000:00010000:1.0:1746144659.271638:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 34 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.271651:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5802 00000100:00100000:1.0:1746144659.271657:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746608640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.271671:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.271690:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.271699:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.271724:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdad600/0xa7c849b16e019e39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d0 expref: 29 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.271740:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.271758:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746608640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 101us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.271764:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5802 00000100:00100000:1.0:1746144659.271777:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5803 00000100:00100000:1.0:1746144659.271782:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746608768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.271789:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.271795:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 34 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.271804:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 34 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.271815:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ac00/0xa7c849b16e019e16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9bb expref: 34 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.271823:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.271825:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.271832:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.272398:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.272433:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.272446:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747463424:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.272653:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.273689:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746608000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15861us (16017us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.273697:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4426 00002000:00100000:2.0:1746144659.273705:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee00700 x1830964746608000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.273719:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00700 with x1830964746608000 ext(2097152->3145727) 00002000:00010000:2.0:1746144659.273723:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee00700 00000100:00100000:2.0:1746144659.274592:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746607744:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15464us (17068us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.274599:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4427 00002000:00100000:2.0:1746144659.274605:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee02680 x1830964746607744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.274612:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02680 with x1830964746607744 ext(2097152->3145727) 00002000:00010000:2.0:1746144659.274616:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee02680 00000100:00100000:0.0:1746144659.277223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.277325:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747463424:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.277352:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.277503:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746608768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5719us (6813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.277514:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5803 00000100:00100000:2.0:1746144659.277801:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609024 00000100:00100000:2.0:1746144659.277810:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609024 00002000:00100000:2.0:1746144659.277857:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1294336->1298431) req@ffff8800920af100 x1830964746609024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.277866:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af100 with x1830964746609024 ext(1294336->1298431) 00002000:00010000:2.0:1746144659.277871:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920af100 00000100:00100000:2.0:1746144659.277902:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4428 00000100:00100000:2.0:1746144659.277909:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746609024:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144659.278068:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746609024:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 159us (855us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144659.278073:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4428 00002000:00100000:2.0:1746144659.278077:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1294336->1298431) req@ffff8800920af100 x1830964746609024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.278084:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af100 with x1830964746609024 ext(1294336->1298431) 00002000:00010000:2.0:1746144659.278088:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920af100 00000100:00100000:2.0:1746144659.282694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.282747:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.282766:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609152 00000100:00100000:1.0:1746144659.282777:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609152 00000100:00100000:3.0:1746144659.282806:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609280 00000100:00100000:3.0:1746144659.282810:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609280 00000100:00100000:1.0:1746144659.282840:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11651 00000100:00100000:3.0:1746144659.282845:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11652 00000100:00100000:1.0:1746144659.282848:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746609152:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144659.282850:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746609280:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.282867:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.282867:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.282885:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009423bc00/0xa7c849b16e019ebe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea40 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.282885:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e019ec5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea39 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.282937:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747463552:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.282937:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463680:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.284127:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.284267:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.285650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.286049:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609408 00000100:00100000:2.0:1746144659.286058:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609408 00000100:00100000:2.0:1746144659.286101:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11653 00000100:00100000:2.0:1746144659.286108:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:29060:x1830964746609408:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.286162:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.286181:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea47 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.286973:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.286983:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.286985:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.286988:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.287021:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.287033:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 35 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.287046:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747463808:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.287177:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.291791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:1.0:1746144659.291912:0:8453:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144659 -> 1746144660 00002000:00010000:1.0:1746144659.291917:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144659 -> 1746144660 00002000:00010000:1.0:1746144659.291919:0:8453:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144659 -> 1746144660 00000100:00100000:1.0:1746144659.291943:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747463680:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.291979:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e019ec5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea39 expref: 32 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.291993:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e019ec5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea39 expref: 32 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.292011:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a800, rc 0) 00000100:00100000:0.0:1746144659.292688:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747463808:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.292711:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.292726:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70ac00, rc 0) 00000100:00100000:0.0:1746144659.292771:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+19:29060:x1830964746609408:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6662us (7126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.292781:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11653 00002000:00010000:3.0:1746144659.292997:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144659 -> 1746144660 00000100:00100000:3.0:1746144659.293024:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747463552:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.293063:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009423bc00/0xa7c849b16e019ebe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea40 expref: 35 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.293076:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009423bc00/0xa7c849b16e019ebe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea40 expref: 35 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.293102:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009423bc00, rc 0) 00000100:00100000:1.0:1746144659.293106:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746609152:12345-192.168.204.23@tcp:101:cat.0 Request processed in 10256us (10422us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.293123:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11651 00000100:00100000:3.0:1746144659.293176:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746609280:12345-192.168.204.23@tcp:101:cat.0 Request processed in 10324us (10428us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.293183:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11652 00000100:00100000:3.0:1746144659.293217:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609536 00000100:00100000:3.0:1746144659.293227:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609536 00002000:00100000:3.0:1746144659.293255:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3162111) req@ffff8800920ae680 x1830964746609536/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 16872/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.293264:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ae680 with x1830964746609536 ext(3145728->3162111) 00010000:00010000:3.0:1746144659.293270:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 34 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.293280:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 34 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.293286:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800920ae680 00000100:00100000:3.0:1746144659.293308:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 862 00000100:00100000:3.0:1746144659.293315:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746609536:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144659.293668:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746609536:12345-192.168.204.23@tcp:4:cat.0 Request processed in 353us (1890us total) trans 17179873230 rc 0/0 00000100:00100000:3.0:1746144659.293674:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 862 00002000:00100000:3.0:1746144659.293679:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3162111) req@ffff8800920ae680 x1830964746609536/t17179873230(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 16872/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.293685:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ae680 with x1830964746609536 ext(3145728->3162111) 00010000:00010000:3.0:1746144659.293690:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 36 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.293698:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 36 pid: 8450 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.293703:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800920ae680 00000100:00100000:0.0:1746144659.295691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.295777:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609664 00000100:00100000:3.0:1746144659.295786:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609664 00000100:00100000:3.0:1746144659.295839:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11654 00000100:00100000:3.0:1746144659.295848:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:29059:x1830964746609664:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144659.295861:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.295875:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea4e expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.295897:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.295903:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 35 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.295908:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.295913:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.295915:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.295918:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.295953:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.295962:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 6 pid: 8453 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.295971:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747463936:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.296058:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 35 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.296070:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 35 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.296078:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747464064:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.296101:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.296123:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.296130:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747464192:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.296225:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.296513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.296564:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609792 00000100:00100000:1.0:1746144659.296571:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609792 00000100:00100000:1.0:1746144659.296615:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11655 00000100:00100000:1.0:1746144659.296622:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29052:x1830964746609792:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.296635:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.296649:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea55 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.296668:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144659.296670:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144659.296674:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->4935679] (req 4194304->4935679) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 37 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.296683:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->4935679] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 37 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.296692:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a000, rc 0) 00000100:00100000:1.0:1746144659.296729:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29052:x1830964746609792:12345-192.168.204.23@tcp:101:cat.0 Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.296735:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11655 00000100:00100000:3.0:1746144659.297917:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747463936:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.297928:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747464064:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.297936:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747464192:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.297975:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.297986:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099929800, rc 0) 00000100:00100000:3.0:1746144659.298022:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:29059:x1830964746609664:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2176us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.298031:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11654 00000100:00100000:0.0:1746144659.298533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.298637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.299177:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746609920 00000100:00100000:1.0:1746144659.299184:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746609920 00010000:00010000:1.0:1746144659.299215:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 7 pid: 8453 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746144659.299235:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746610048 00000100:00100000:1.0:1746144659.299237:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746610048 00010000:00010000:1.0:1746144659.299249:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 37 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.299265:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5804 00000100:00100000:1.0:1746144659.299272:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746609920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.299285:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144659.299307:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5805 00010000:00010000:1.0:1746144659.299310:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 7 pid: 8453 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.299319:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746610048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.299320:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 7 pid: 8453 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.299327:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.299340:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 37 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.299340:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e0198ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6b2 expref: 7 pid: 8453 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.299349:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 37 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.299351:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144659.299363:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b060c00/0xa7c849b16e019d4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3162111) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e960 expref: 37 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.299374:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144659.299374:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746609920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 103us (842us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144659.299376:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.299383:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.299383:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5804 00010000:00010000:3.0:1746144659.299392:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.299401:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.299402:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.299405:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.299411:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.299441:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.299452:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747464320:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144659.299515:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.299524:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747464448:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144659.299543:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.299852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.299943:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746610176 00000100:00100000:2.0:1746144659.299948:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746610176 00010000:00010000:2.0:1746144659.299964:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 37 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746144659.299978:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5806 00000100:00100000:2.0:1746144659.299983:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746610176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.299990:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.300000:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 37 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.300007:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 37 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.300018:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e0198f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6f8 expref: 37 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.300031:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.300051:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746610176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.300056:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5806 00000100:00100000:0.0:1746144659.301099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.301283:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746610304 00000100:00100000:2.0:1746144659.301289:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746610304 00010000:00010000:2.0:1746144659.301308:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.301340:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5807 00000100:00100000:2.0:1746144659.301348:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746610304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.301359:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.301371:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.301381:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.301395:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4587600/0xa7c849b16e019812 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e65e expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.301404:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.301406:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.301411:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.301418:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.301443:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.301451:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747464576:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144659.302379:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.302441:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747464320:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144659.305375:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747464448:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144659.305417:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.305461:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746610048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6146us (6823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.305473:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5805 00000100:00100000:0.0:1746144659.306462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.306584:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747464576:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144659.306598:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.306636:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746610304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5288us (5536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.307077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.307108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.307189:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5807 00000100:00100000:3.0:1746144659.307269:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746610560 00000100:00100000:3.0:1746144659.307275:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746610560 00002000:00100000:3.0:1746144659.307381:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f445c00 x1830964746610560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.307391:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445c00 with x1830964746610560 ext(4194304->4935679) 00002000:00010000:3.0:1746144659.307396:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f445c00 00000100:00100000:3.0:1746144659.307411:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746610816 00000100:00100000:3.0:1746144659.307413:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746610816 00002000:00100000:3.0:1746144659.307425:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1138688->1142783) req@ffff88009f445180 x1830964746610816/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.307432:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445180 with x1830964746610816 ext(1138688->1142783) 00002000:00010000:3.0:1746144659.307434:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f445180 00000100:00100000:3.0:1746144659.307453:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746611200 00000100:00100000:3.0:1746144659.307455:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746611200 00002000:00100000:3.0:1746144659.307464:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f444e00 x1830964746611200/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.307469:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444e00 with x1830964746611200 ext(3145728->4194303) 00002000:00010000:3.0:1746144659.307472:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f444e00 00000100:00100000:1.0:1746144659.307480:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4429 00000100:00100000:1.0:1746144659.307492:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746610560:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.307808:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4430 00000100:00100000:2.0:1746144659.307813:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4431 00000100:00100000:3.0:1746144659.307816:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746610816:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144659.307819:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746611200:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144659.307930:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746610816:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 115us (852us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144659.307936:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4430 00002000:00100000:3.0:1746144659.307940:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1138688->1142783) req@ffff88009f445180 x1830964746610816/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.307947:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445180 with x1830964746610816 ext(1138688->1142783) 00002000:00010000:3.0:1746144659.307950:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f445180 00000100:00100000:2.0:1746144659.308209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.308222:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746611328 00000100:00100000:0.0:1746144659.308225:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746611328 00002000:00100000:0.0:1746144659.308245:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013644a680 x1830964746611328/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.308252:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644a680 with x1830964746611328 ext(3145728->4194303) 00002000:00010000:0.0:1746144659.308256:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644a680 00000100:00100000:0.0:1746144659.308462:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4432 00000100:00100000:0.0:1746144659.308468:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746611328:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144659.312042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.312101:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746611584 00000100:00100000:2.0:1746144659.312120:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746611584 00000100:00100000:2.0:1746144659.312194:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4058 00000100:00100000:2.0:1746144659.312203:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:29059:x1830964746611584:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144659.312488:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:29059:x1830964746611584:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 285us (461us total) trans 8589943945 rc 0/0 00000100:00100000:2.0:1746144659.312497:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4058 00000100:00100000:3.0:1746144659.319810:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746611200:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11978us (12688us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.319822:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4431 00002000:00100000:3.0:1746144659.319834:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f444e00 x1830964746611200/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.319844:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f444e00 with x1830964746611200 ext(3145728->4194303) 00002000:00010000:3.0:1746144659.319851:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f444e00 00000100:00100000:2.0:1746144659.320329:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746610560:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12839us (13868us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144659.320337:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4429 00002000:00100000:2.0:1746144659.320343:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f445c00 x1830964746610560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.320350:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445c00 with x1830964746610560 ext(4194304->4935679) 00002000:00010000:2.0:1746144659.320353:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f445c00 00000100:00100000:0.0:1746144659.324078:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746611328:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 15598us (15953us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144659.324090:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4432 00002000:00100000:0.0:1746144659.324101:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013644a680 x1830964746611328/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.324119:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644a680 with x1830964746611328 ext(3145728->4194303) 00002000:00010000:0.0:1746144659.324125:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644a680 00000100:00100000:0.0:1746144659.327617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.327869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.327952:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746611840 00000100:00100000:3.0:1746144659.327961:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746611840 00000100:00100000:1.0:1746144659.328105:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746611712 00000100:00100000:1.0:1746144659.328109:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746611712 00000100:00100000:1.0:1746144659.328191:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11656 00000100:00100000:1.0:1746144659.328200:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746611712:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144659.328204:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11657 00000100:00100000:3.0:1746144659.328210:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746611840:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.328221:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.328221:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.328240:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb200/0xa7c849b16e019ee1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea63 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.328240:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dad4c00/0xa7c849b16e019ee8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea5c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.328289:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747464704:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.328289:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747464832:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.328581:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.328630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.328630:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.328783:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746611968 00000100:00100000:0.0:1746144659.328786:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746611968 00000100:00100000:0.0:1746144659.328817:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11658 00000100:00100000:0.0:1746144659.328823:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746611968:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.328831:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.328839:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e864e00/0xa7c849b16e019eef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea6a expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.329000:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747464960:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.329037:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afd80 going to sleep for 11 seconds 00002000:00010000:3.0:1746144659.330712:0:22208:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746144657 -> 1746144660 00002000:00010000:3.0:1746144659.330718:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746144654 -> 1746144660 00002000:00010000:3.0:1746144659.330720:0:22208:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746144657 -> 1746144660 00000100:00100000:3.0:1746144659.330745:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747464704:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.330781:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb200/0xa7c849b16e019ee1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea63 expref: 36 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.330793:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb200/0xa7c849b16e019ee1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea63 expref: 36 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.330814:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bb200, rc 0) 00000100:00100000:3.0:1746144659.330849:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746611840:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2638us (3243us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.330857:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11657 00000100:00100000:2.0:1746144659.330947:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747464832:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.330970:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dad4c00/0xa7c849b16e019ee8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea5c expref: 32 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.330983:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dad4c00/0xa7c849b16e019ee8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea5c expref: 32 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.331006:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dad4c00, rc 0) 00000100:00100000:2.0:1746144659.331051:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746611712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2852us (3182us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.331056:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11656 00002000:00010000:0.0:1746144659.331167:0:10724:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144659 -> 1746144660 00002000:00010000:0.0:1746144659.331170:0:10724:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144659 -> 1746144660 00002000:00010000:0.0:1746144659.331172:0:10724:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144659 -> 1746144660 00000100:00100000:0.0:1746144659.331181:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f445880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747464960:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.331197:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e864e00/0xa7c849b16e019eef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea6a expref: 27 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.331209:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e864e00/0xa7c849b16e019eef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea6a expref: 27 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.331231:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864e00, rc 0) 00000100:00100000:0.0:1746144659.331260:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746611968:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2437us (2630us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.331266:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11658 00000100:00100000:2.0:1746144659.334422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.334524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.334608:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612096 00000100:00100000:1.0:1746144659.334617:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612096 00000100:00100000:1.0:1746144659.334661:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612224 00000100:00100000:1.0:1746144659.334663:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612224 00000100:00100000:1.0:1746144659.334679:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11659 00000100:00100000:1.0:1746144659.334686:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746612096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.334705:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.334728:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5e600/0xa7c849b16e019ef6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea71 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.334783:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747465088:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.334862:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.334883:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11660 00000100:00100000:1.0:1746144659.334888:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746612224:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.334896:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.334907:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee5ec00/0xa7c849b16e019efd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea78 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.334934:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747465216:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.334953:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.337659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.337793:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612480 00000100:00100000:2.0:1746144659.337805:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612480 00002000:00100000:2.0:1746144659.337865:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f445880 x1830964746612480/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.337876:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445880 with x1830964746612480 ext(4194304->4935679) 00002000:00010000:2.0:1746144659.337882:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f445880 00000100:00100000:1.0:1746144659.338022:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747465216:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.338063:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5ec00/0xa7c849b16e019efd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea78 expref: 36 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.338076:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5ec00/0xa7c849b16e019efd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea78 expref: 36 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.338100:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5ec00, rc 0) 00000100:00100000:1.0:1746144659.338186:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746612224:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3296us (3661us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.338788:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747465088:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.338825:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5e600/0xa7c849b16e019ef6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea71 expref: 32 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.338837:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5e600/0xa7c849b16e019ef6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea71 expref: 32 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144659.338847:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4433 00010000:00010000:0.0:1746144659.338851:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5e600, rc 0) 00000100:00100000:2.0:1746144659.338859:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746612480:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.338892:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746612096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4206us (4483us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.338901:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11659 00000100:00100000:1.0:1746144659.339548:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11660 00000100:00100000:2.0:1746144659.343858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.343964:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612608 00000100:00100000:0.0:1746144659.343974:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612608 00000100:00100000:0.0:1746144659.344029:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10064 00000100:00100000:0.0:1746144659.344037:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29065:x1830964746612608:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144659.344063:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.344084:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865000/0xa7c849b16e019f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea7f expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.344197:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344211:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344222:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344239:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344245:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344250:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344363:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344371:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344376:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144659.344407:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:0.0:1746144659.344411:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144659.344426:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344435:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344442:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344447:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344453:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344458:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e865200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144659.344461:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344467:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344477:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144659.344479:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144659.344482:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344487:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865200/0xa7c849b16e019f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344511:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344516:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344520:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344523:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e865400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144659.344526:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344530:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344535:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d100) 00010000:00010000:0.0:1746144659.344536:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144659.344538:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344615:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865400/0xa7c849b16e019f12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.344640:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865000/0xa7c849b16e019f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.344651:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.344657:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144659.344664:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144659.344666:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e865600, rc 0) 00000100:00100000:0.0:1746144659.345033:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29065:x1830964746612608:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 995us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.345040:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10064 00000100:00100000:2.0:1746144659.348449:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746612480:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9582us (10786us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144659.348461:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4433 00002000:00100000:2.0:1746144659.348473:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f445880 x1830964746612480/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.348482:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f445880 with x1830964746612480 ext(4194304->4935679) 00002000:00010000:2.0:1746144659.348489:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f445880 00000100:00100000:0.0:1746144659.348956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.349058:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.349077:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612736 00000100:00100000:0.0:1746144659.349084:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612736 00000100:00100000:0.0:1746144659.349153:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612864 00000100:00100000:0.0:1746144659.349156:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612864 00000100:00100000:0.0:1746144659.349173:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11661 00000100:00100000:0.0:1746144659.349179:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746612736:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144659.349195:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.349212:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e865c00/0xa7c849b16e019f20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea86 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.349264:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747465344:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.349327:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.349354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.349393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.349420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.349490:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746612992 00000100:00100000:1.0:1746144659.349493:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746612992 00000100:00100000:3.0:1746144659.349507:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746613120 00000100:00100000:1.0:1746144659.349515:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746613248 00000100:00100000:1.0:1746144659.349517:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746613248 00000100:00100000:3.0:1746144659.349518:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746613120 00000100:00100000:1.0:1746144659.349536:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11662 00000100:00100000:1.0:1746144659.349542:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746612864:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144659.349549:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.349557:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e019f27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea8d expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.349564:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11663 00000100:00100000:0.0:1746144659.349574:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746612992:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144659.349590:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144659.349592:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747465472:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.349596:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11664 00010000:00010000:0.0:1746144659.349604:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e864600/0xa7c849b16e019f2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea94 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.349605:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746613248:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144659.349615:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144659.349620:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00010000:00010000:3.0:1746144659.349624:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eaa2 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.349635:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11665 00010000:00010000:3.0:1746144659.349636:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.349637:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144659.349641:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746613120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144659.349644:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 10 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144659.349647:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f444a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747465600:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.349648:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.349656:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ea9b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.349657:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 10 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.349666:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ba800, rc 0) 00010000:00010000:1.0:1746144659.349668:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.349669:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.349676:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.349688:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144659.349697:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746613248:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 95us (277us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144659.349697:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f400, rc 0) 00000100:00100000:0.0:1746144659.349700:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.349703:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11664 00000100:00100000:1.0:1746144659.349717:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746613120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.349722:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11665 00000100:00100000:0.0:1746144659.350593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.350675:0:14707:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746613376 00000100:00100000:2.0:1746144659.350679:0:14707:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746613376 00000100:00100000:2.0:1746144659.350740:0:14707:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:2.0:1746144659.350746:0:14707:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013643d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:087a468c-8f92-434b-ae24-50378d554a48+15:1963:x1830964746613376:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1746144659.350851:0:14707:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013643d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:087a468c-8f92-434b-ae24-50378d554a48+15:1963:x1830964746613376:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 104us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.350857:0:14707:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:2.0:1746144659.352180:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f444380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747465344:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.352207:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e865c00/0xa7c849b16e019f20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea86 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.352219:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e865c00/0xa7c849b16e019f20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea86 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.352240:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e865c00, rc 0) 00000100:00100000:2.0:1746144659.352284:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746612736:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3104us (3329us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.352290:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11661 00000100:00100000:1.0:1746144659.352307:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747465472:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.352461:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f444a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747465600:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.352478:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e864600/0xa7c849b16e019f2e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea94 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.352489:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e864600/0xa7c849b16e019f2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea94 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.352510:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864600, rc 0) 00000100:00100000:0.0:1746144659.352549:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746612992:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2976us (3194us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144659.352555:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11663 00010000:00010000:1.0:1746144659.352883:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e019f27 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea8d expref: 7 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.352895:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e019f27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea8d expref: 7 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.352918:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5ee00, rc 0) 00000100:00100000:1.0:1746144659.352951:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746612864:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3408us (3892us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.352956:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11662 00000100:00100000:0.0:1746144659.355080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.355118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.355167:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746613760 00000100:00100000:1.0:1746144659.355168:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746613504 00000100:00100000:0.0:1746144659.355176:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746613760 00000100:00100000:1.0:1746144659.355177:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746613504 00000100:00100000:0.0:1746144659.355217:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10065 00000100:00100000:1.0:1746144659.355221:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11666 00000100:00100000:0.0:1746144659.355224:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29065:x1830964746613760:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:1.0:1746144659.355227:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746613504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.355241:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.355242:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.355255:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019f43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eaa9 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.355257:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e864200/0xa7c849b16e019f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eab0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.355296:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747465728:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144659.355353:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.355367:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.355375:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.355401:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.355525:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00010000:00010000:0.0:1746144659.355526:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 13 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.355542:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f447b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747465856:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144659.355580:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.356901:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f447b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747465856:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.356923:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144659.356974:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.357008:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746613888 00000100:00100000:2.0:1746144659.357012:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746613888 00010000:00010000:2.0:1746144659.357032:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 14 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.357060:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5808 00000100:00100000:2.0:1746144659.357065:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746613888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144659.357066:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747465728:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.357073:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.357077:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 14 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.357085:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 14 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.357095:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019f43 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa9 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.357099:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865600/0xa7c849b16e019f19 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea7f expref: 14 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.357107:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019f43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa9 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.357109:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.357123:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.357131:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144659.357159:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f200, rc 0) 00010000:00010000:2.0:1746144659.357163:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.357178:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144659.357186:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.357192:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144659.357197:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746613504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1968us (2124us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.357200:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746613888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 134us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.357206:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5808 00000004:00200000:3.0:1746144659.357208:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:1.0:1746144659.357208:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11666 00010000:00010000:3.0:1746144659.357334:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e864200/0xa7c849b16e019f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.357368:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.357379:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.357382:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144659.357384:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e865a00, rc 0) 00000100:00100000:3.0:1746144659.357420:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29065:x1830964746613760:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2196us (2311us total) trans 8589943946 rc 0/0 00000100:00100000:3.0:1746144659.357427:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10065 00000100:00100000:0.0:1746144659.359399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.359433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.359456:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614016 00000100:00100000:1.0:1746144659.359464:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614016 00000100:00100000:3.0:1746144659.359491:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614144 00000100:00100000:3.0:1746144659.359495:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614144 00000100:00100000:1.0:1746144659.359510:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11667 00000100:00100000:1.0:1746144659.359518:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746614016:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144659.359528:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10066 00010000:00010000:1.0:1746144659.359530:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144659.359534:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29065:x1830964746614144:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144659.359542:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f600/0xa7c849b16e019f5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eab7 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.359545:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.359555:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba600/0xa7c849b16e019f66 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eabe expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.359580:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747465984:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.359609:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.359621:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.359628:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.359644:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.359654:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 14 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.359656:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.359662:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747466112:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.359682:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.360655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.360708:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747466112:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.360727:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144659.360775:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747465984:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144659.360779:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614272 00000100:00100000:2.0:1746144659.360783:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614272 00010000:00010000:1.0:1746144659.360790:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f600/0xa7c849b16e019f5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab7 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.360798:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f600/0xa7c849b16e019f5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab7 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.360800:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 15 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.360804:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f600, rc 0) 00000100:00100000:2.0:1746144659.360816:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5809 00000100:00100000:2.0:1746144659.360821:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746614272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144659.360821:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746614016:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1306us (1431us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.360827:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11667 00010000:00010000:2.0:1746144659.360830:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.360835:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 15 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.360843:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 15 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.360856:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e865a00/0xa7c849b16e019f51 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eab0 expref: 15 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.360864:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.360867:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.360873:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.360879:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.360890:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.360908:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746614272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.360913:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5809 00010000:00010000:3.0:1746144659.360962:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.360968:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144659.360993:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144659.361000:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144659.361013:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.361032:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba600/0xa7c849b16e019f66 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eabe expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.361041:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eabe expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.361046:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.361048:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144659.361050:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ba400, rc 0) 00000100:00100000:3.0:1746144659.361082:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29065:x1830964746614144:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1548us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.361091:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10066 00000100:00100000:0.0:1746144659.367437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.367474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.367547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.367678:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614400 00000100:00100000:3.0:1746144659.367686:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614400 00000100:00100000:1.0:1746144659.367706:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614528 00000100:00100000:1.0:1746144659.367711:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614528 00000100:00100000:3.0:1746144659.367728:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614656 00000100:00100000:3.0:1746144659.367730:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614656 00000100:00100000:1.0:1746144659.367741:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11668 00000100:00100000:1.0:1746144659.367746:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746614400:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144659.367760:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.367775:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f000/0xa7c849b16e019f74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eac5 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.367782:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11669 00000100:00100000:3.0:1746144659.367789:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746614528:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144659.367796:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.367804:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5bac00/0xa7c849b16e019f7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eacc expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.367815:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747466240:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.367829:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747466368:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144659.367883:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11670 00000100:00100000:1.0:1746144659.367886:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.367890:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746614656:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144659.367898:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.367907:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70b800/0xa7c849b16e019f82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ead3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.367931:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747466496:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.367972:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.368029:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.370289:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747466240:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.370327:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f000/0xa7c849b16e019f74 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eac5 expref: 9 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.370340:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f000/0xa7c849b16e019f74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eac5 expref: 9 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.370351:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f000, rc 0) 00000100:00100000:1.0:1746144659.370392:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746614400:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2645us (2962us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.370399:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11668 00000100:00100000:3.0:1746144659.370533:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747466368:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.370560:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bac00/0xa7c849b16e019f7b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eacc expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.370568:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bac00/0xa7c849b16e019f7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eacc expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.370574:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bac00, rc 0) 00000100:00100000:3.0:1746144659.370590:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746614528:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2804us (3117us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.370595:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11669 00000100:00100000:2.0:1746144659.370596:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747466496:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.370616:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f70b800/0xa7c849b16e019f82 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ead3 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.370626:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70b800/0xa7c849b16e019f82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ead3 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.370639:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70b800, rc 0) 00000100:00100000:2.0:1746144659.370658:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746614656:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2769us (3111us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.370664:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11670 00000100:00100000:0.0:1746144659.372692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.372937:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746614912 00000100:00100000:3.0:1746144659.372946:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746614912 00000100:00100000:3.0:1746144659.373010:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10067 00000100:00100000:3.0:1746144659.373019:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29065:x1830964746614912:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144659.373040:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.373058:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019f89 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eada expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.373199:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.373213:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.373224:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144659.373235:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.373353:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019f89 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.373368:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.373376:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.373379:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144659.373382:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bbe00, rc 0) 00000100:00100000:3.0:1746144659.373435:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29065:x1830964746614912:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 416us (750us total) trans 8589943947 rc 0/0 00000100:00100000:3.0:1746144659.373441:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10067 00000100:00100000:0.0:1746144659.375427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.375461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.375484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.375676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.375791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.375805:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615040 00000100:00100000:3.0:1746144659.375812:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615040 00000100:00100000:3.0:1746144659.375850:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615168 00000100:00100000:3.0:1746144659.375852:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615168 00000100:00100000:3.0:1746144659.375864:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615296 00000100:00100000:3.0:1746144659.375866:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615296 00000100:00100000:3.0:1746144659.375875:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615424 00000100:00100000:3.0:1746144659.375876:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615424 00000100:00100000:3.0:1746144659.375889:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11671 00000100:00100000:3.0:1746144659.375896:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746615040:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:3.0:1746144659.375931:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.376280:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11672 00000100:00100000:1.0:1746144659.376287:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11673 00000100:00100000:2.0:1746144659.376290:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746615168:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:1.0:1746144659.376297:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746615296:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144659.376313:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.376317:0:4760:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376327:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 30 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.376328:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376334:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144659.376334:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.376336:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144659.376336:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.376339:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.376339:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376367:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 30 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.376367:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376380:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 30 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.376380:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 25 pid: 8453 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.376392:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747466624:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.376392:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747466752:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.376443:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.376450:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.376457:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 34 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.376462:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.376463:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.376466:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.376483:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 34 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.376491:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 34 pid: 4760 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.376501:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747466880:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.376618:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.376635:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615552 00000100:00100000:2.0:1746144659.376638:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615552 00000100:00100000:2.0:1746144659.376657:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11674 00000100:00100000:2.0:1746144659.376662:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746615424:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144659.376678:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376688:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376698:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.376700:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.376702:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376718:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.376726:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.376734:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747467008:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.376770:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.376778:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 9 pid: 29370 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.376787:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747467136:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.377411:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.377429:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11675 00000100:00100000:2.0:1746144659.377435:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746615552:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144659.377452:0:22208:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377463:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.377467:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377470:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.377475:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 18 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.377476:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144659.377483:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747467264:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377485:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377492:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.377498:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7180 going to sleep for 11 seconds 00010000:00010000:2.0:1746144659.377498:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144659.377500:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144659.377502:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 8/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377518:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377526:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 34 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.377534:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467392:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377562:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377570:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.377577:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467520:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377597:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.377604:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746144659.377610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.377611:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467648:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377628:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377635:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 18 pid: 29370 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.377642:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467776:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377661:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377668:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 18 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.377675:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467904:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.377689:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.377716:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615680 00000100:00100000:2.0:1746144659.377719:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615680 00000100:00100000:2.0:1746144659.377738:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11676 00000100:00100000:2.0:1746144659.377743:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746615680:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144659.377770:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377779:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377786:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.377793:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 30 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377799:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.377801:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.377803:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.377812:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00010000:00010000:2.0:1746144659.377818:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 30 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377826:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 30 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.377834:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747468032:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377858:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.377870:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 8 pid: 8388 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746144659.377878:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747468160:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.377897:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.377905:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 25 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.377912:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747468288:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.377925:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1832f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.382335:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747467008:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.382364:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.382485:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467392:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.382528:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467904:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.382552:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467520:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.382600:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467648:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.382630:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747466752:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.382649:0:4760:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.383119:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747466624:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.383156:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.383211:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747467136:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.383219:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747467264:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.383526:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747467776:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.383530:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747468032:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.383552:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.383555:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747468160:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.383597:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747468288:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.383612:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.383886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.383904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.383924:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616064 00000100:00100000:2.0:1746144659.383931:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616064 00010000:00010000:2.0:1746144659.383964:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 35 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.383987:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616192 00000100:00100000:2.0:1746144659.383989:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616192 00010000:00010000:2.0:1746144659.383998:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 19 pid: 8450 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.384018:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5810 00000100:00100000:2.0:1746144659.384024:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746616064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.384039:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.384060:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 35 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.384069:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 35 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.384091:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e019e78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea01 expref: 35 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.384104:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.384162:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746616064:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 137us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.384167:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5810 00000100:00100000:2.0:1746144659.384210:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5811 00000100:00100000:2.0:1746144659.384214:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746616192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.384222:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.384228:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 19 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.384235:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 19 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.384244:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a800/0xa7c849b16e019c02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e895 expref: 19 pid: 8450 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.384250:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.384260:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746616192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 47us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.384265:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5811 00000100:00100000:3.0:1746144659.384393:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747466880:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.384420:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.387259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.387296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.387329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.387349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.387359:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615808 00000100:00100000:0.0:1746144659.387364:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616576 00000100:00100000:3.0:1746144659.387368:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615808 00000100:00100000:0.0:1746144659.387369:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616576 00010000:00010000:0.0:1746144659.387402:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 10 pid: 8450 timeout: 738 lvb_type: 1 00002000:00100000:3.0:1746144659.387416:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1482752->2052095) req@ffff88013092b100 x1830964746615808/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144659.387417:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746615936 00002000:00100000:3.0:1746144659.387426:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092b100 with x1830964746615808 ext(1482752->2052095) 00000100:00100000:1.0:1746144659.387429:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746615936 00000100:00100000:0.0:1746144659.387429:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5812 00010000:00010000:3.0:1746144659.387433:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 31 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.387435:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746616576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.387443:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 31 pid: 7257 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.387449:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013092b100 00010000:00010000:0.0:1746144659.387449:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144659.387461:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616320 00000100:00100000:3.0:1746144659.387464:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616320 00010000:00010000:1.0:1746144659.387467:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 11 pid: 29370 timeout: 738 lvb_type: 1 00002000:00100000:3.0:1746144659.387475:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1142783) req@ffff88013644aa00 x1830964746616320/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.387481:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644aa00 with x1830964746616320 ext(1048576->1142783) 00010000:00010000:3.0:1746144659.387487:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.387493:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.387498:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013644aa00 00000100:00100000:1.0:1746144659.387507:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5813 00000100:00100000:1.0:1746144659.387515:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746615936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.387527:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.387545:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 11 pid: 29370 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746144659.387554:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 11 pid: 29370 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746144659.387571:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a000/0xa7c849b16e019e47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9d7 expref: 11 pid: 29370 timeout: 738 lvb_type: 1 00010000:00010000:1.0:1746144659.387588:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.387634:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746615936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.387640:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5813 00010000:00010000:0.0:1746144659.387659:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.387670:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.387683:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 863 00010000:00010000:0.0:1746144659.387691:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f400/0xa7c849b16e019f3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea9b expref: 9 pid: 8450 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.387692:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746615808:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:0.0:1746144659.387708:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144659.387733:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746616576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 298us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.387739:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5812 00000100:00100000:2.0:1746144659.387922:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 864 00000100:00100000:2.0:1746144659.387934:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746616320:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144659.388287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.388304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.388318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.388328:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616448 00000100:00100000:0.0:1746144659.388331:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616448 00010000:00010000:0.0:1746144659.388341:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.388344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.388359:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616960 00000100:00100000:0.0:1746144659.388361:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616960 00000100:00100000:3.0:1746144659.388364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144659.388369:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 9 pid: 8388 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.388378:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617088 00000100:00100000:0.0:1746144659.388380:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5814 00000100:00100000:3.0:1746144659.388381:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617088 00000100:00100000:0.0:1746144659.388384:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746616448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144659.388391:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.388397:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 33 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.388399:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.388407:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.388408:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616832 00000100:00100000:3.0:1746144659.388409:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616832 00010000:00010000:3.0:1746144659.388419:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.388419:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e46dc00/0xa7c849b16e019aff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e810 expref: 20 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.388427:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.388428:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5815 00000100:00100000:3.0:1746144659.388433:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746616960:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144659.388440:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746616448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 56us (154us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144659.388442:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144659.388445:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5814 00010000:00010000:3.0:1746144659.388454:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 9 pid: 8388 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746144659.388455:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5816 00000100:00100000:0.0:1746144659.388459:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746617088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.388462:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 9 pid: 8388 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.388464:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.388474:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5ba800/0xa7c849b16e019f35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaa2 expref: 9 pid: 8388 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.388480:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 33 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.388485:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144659.388488:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 33 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.388500:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746616960:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (181us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144659.388500:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e46fa00/0xa7c849b16e019eb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea2b expref: 33 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.388506:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5815 00010000:00010000:0.0:1746144659.388509:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.388516:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5817 00000100:00100000:3.0:1746144659.388523:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746616832:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144659.388523:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746617088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 64us (180us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144659.388529:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144659.388529:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5816 00010000:00010000:3.0:1746144659.388536:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.388544:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.388555:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a000/0xa7c849b16e019eda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea55 expref: 34 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.388567:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.388579:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746616832:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.388585:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5817 00000100:00100000:2.0:1746144659.388728:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746616704 00000100:00100000:2.0:1746144659.388732:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746616704 00002000:00100000:2.0:1746144659.388750:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1294336->2097151) req@ffff8800920ac700 x1830964746616704/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.388757:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac700 with x1830964746616704 ext(1294336->2097151) 00010000:00010000:2.0:1746144659.388762:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 26 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.388771:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 26 pid: 8453 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.388782:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920ac700 00000100:00100000:2.0:1746144659.388806:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 865 00000100:00100000:2.0:1746144659.388812:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746616704:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144659.389904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.390293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.391973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.392003:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617216 00000100:00100000:3.0:1746144659.392011:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617216 00000100:00100000:0.0:1746144659.392018:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617344 00000100:00100000:0.0:1746144659.392022:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617344 00010000:00010000:3.0:1746144659.392049:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.392049:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 28 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.392072:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617472 00000100:00100000:3.0:1746144659.392074:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617472 00000100:00100000:0.0:1746144659.392077:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5818 00000100:00100000:0.0:1746144659.392084:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746617216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.392086:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 33 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.392097:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144659.392101:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5819 00000100:00100000:3.0:1746144659.392107:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746617344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.392126:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144659.392131:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.392152:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 28 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.392158:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.392161:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 28 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.392180:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70ac00/0xa7c849b16e019ecc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea47 expref: 19 pid: 29370 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.392181:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e46ec00/0xa7c849b16e019e9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea1d expref: 28 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.392194:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.392196:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.392196:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.392198:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.392201:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.392201:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392209:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.392209:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392230:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.392263:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746617344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 156us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.392269:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5819 00000100:00100000:3.0:1746144659.392283:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5820 00000100:00100000:3.0:1746144659.392289:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746617472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.392295:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.392305:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 33 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.392313:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 33 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.392324:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b428a000/0xa7c849b16e019b0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e81e expref: 33 pid: 4760 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.392333:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.392334:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.392337:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392344:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392356:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.392371:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746617472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.392376:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5820 00010000:00010000:3.0:1746144659.392394:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392402:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392418:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392424:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392432:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392438:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7f8000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144659.392442:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392456:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392464:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392469:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e019fc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.392521:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746615680:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 14776us (14910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.392528:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11676 00010000:00010000:3.0:1746144659.392553:0:22208:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392560:0:22208:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392571:0:22208:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392577:0:22208:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392583:0:22208:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392592:0:22208:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70a400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144659.392595:0:22208:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392601:0:22208:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392609:0:22208:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.392632:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746615552:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 15197us (16841us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.392637:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11675 00010000:00010000:3.0:1746144659.392654:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392661:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392673:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392679:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392685:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392691:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bb600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144659.392694:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392700:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392708:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.392714:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5bb600/0xa7c849b16e019f9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.392742:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746615040:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 16847us (17321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.392748:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11671 00010000:00010000:0.0:1746144659.393266:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a400/0xa7c849b16e019fba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.393282:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144659.393317:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746617216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1232us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.393323:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5818 00000100:00100000:2.0:1746144659.393468:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746616320:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5537us (6170us total) trans 17179873231 rc 0/0 00000100:00100000:2.0:1746144659.393476:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 864 00002000:00100000:2.0:1746144659.393485:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1142783) req@ffff88013644aa00 x1830964746616320/t17179873231(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.393495:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644aa00 with x1830964746616320 ext(1048576->1142783) 00010000:00010000:2.0:1746144659.393502:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.393512:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.393519:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013644aa00 00000100:00100000:0.0:1746144659.395561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.395585:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617600 00000100:00100000:0.0:1746144659.395592:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617600 00010000:00010000:0.0:1746144659.395619:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.395652:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5821 00000100:00100000:0.0:1746144659.395660:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746617600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144659.395675:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144659.395695:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.395706:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.395727:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099929800/0xa7c849b16e019ed3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea4e expref: 18 pid: 22208 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.395740:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.395743:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.395747:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.395755:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.395855:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144659.395909:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395918:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395939:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395947:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395953:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395959:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70b000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144659.395963:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395969:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395979:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.395984:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70b000/0xa7c849b16e019fb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.396042:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746617600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 382us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.396049:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5821 00000100:00100000:2.0:1746144659.396209:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746615424:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 19545us (20531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.396217:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11674 00000100:00100000:3.0:1746144659.398590:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746615808:12345-192.168.204.23@tcp:4:cat.0 Request processed in 10894us (11333us total) trans 21474840479 rc 0/0 00000100:00100000:3.0:1746144659.398601:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 863 00002000:00100000:3.0:1746144659.398612:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1482752->2052095) req@ffff88013092b100 x1830964746615808/t21474840479(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.398622:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092b100 with x1830964746615808 ext(1482752->2052095) 00010000:00010000:3.0:1746144659.398631:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.398648:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.398654:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013092b100 00000100:00100000:2.0:1746144659.402154:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746616704:12345-192.168.204.23@tcp:4:cat.0 Request processed in 13313us (13820us total) trans 21474840480 rc 0/0 00000100:00100000:2.0:1746144659.402168:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 865 00002000:00100000:2.0:1746144659.402179:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1294336->2097151) req@ffff8800920ac700 x1830964746616704/t21474840480(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.402188:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac700 with x1830964746616704 ext(1294336->2097151) 00010000:00010000:2.0:1746144659.402197:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.402208:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 738 lvb_type: 0 00002000:00010000:2.0:1746144659.402214:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920ac700 00000100:00100000:0.0:1746144659.405229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.405310:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617728 00000100:00100000:2.0:1746144659.405319:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617728 00010000:00010000:2.0:1746144659.405356:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.405392:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5822 00000100:00100000:2.0:1746144659.405400:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746617728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.405415:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.405459:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.405470:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.405496:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e019e1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2052095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e9c2 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.405510:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.405512:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.405516:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.405526:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.405690:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144659.406320:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406331:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406359:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406367:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406374:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406380:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70b600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144659.406384:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406391:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406402:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.406407:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70b600/0xa7c849b16e019fa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.407036:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746617728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1634us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.407043:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5822 00000100:00100000:0.0:1746144659.407083:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746615168:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 30794us (31619us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.407092:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11672 00000100:00100000:1.0:1746144659.407284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.407371:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746617856 00000100:00100000:2.0:1746144659.407376:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746617856 00010000:00010000:2.0:1746144659.407397:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.407412:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5823 00000100:00100000:2.0:1746144659.407417:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746617856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.407430:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.407443:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.407458:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.407471:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e46f600/0xa7c849b16e019eb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ea32 expref: 27 pid: 8453 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.407481:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.407483:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.407486:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.407494:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.407521:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.407542:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746617856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.407547:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5823 00010000:00010000:0.0:1746144659.407661:0:4760:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407669:0:4760:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407683:0:4760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407690:0:4760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407695:0:4760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407700:0:4760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5f200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144659.407703:0:4760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407709:0:4760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407717:0:4760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.407723:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e019fac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.407770:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746615296:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 31476us (32285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.407776:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11673 00000100:00100000:0.0:1746144659.410386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.412406:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746618112 00000100:00100000:3.0:1746144659.412417:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746618112 00000100:00100000:3.0:1746144659.412485:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10068 00000100:00100000:3.0:1746144659.412494:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29065:x1830964746618112:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:3.0:1746144659.412552:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746144659.412578:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba400/0xa7c849b16e019f6d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eabe expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412610:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabcc00/0xa7c849b16e0198c8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6c7 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412620:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.412625:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144659.412652:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.412663:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 32 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412670:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 320 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412676:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 32 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412683:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 32 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412689:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 32 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412695:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 320 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412701:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.412729:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 320 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412739:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 320 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.412751:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468416:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.412838:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 32 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412845:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 32 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.412853:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468544:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.412875:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 32 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412883:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 32 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.412890:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468672:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.412908:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 32 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412915:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 32 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.412922:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468800:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.412940:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 320 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412946:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 320 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.412953:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468928:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.412972:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 32 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.412979:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 32 pid: 20319 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.412985:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747469056:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.413002:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.415120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.415617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.416067:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746618752 00000100:00100000:1.0:1746144659.416076:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746618752 00000100:00100000:3.0:1746144659.416120:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468416:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.416121:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 33 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.416131:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468544:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.416151:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468672:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.416157:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468800:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.416198:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746618624 00000100:00100000:2.0:1746144659.416202:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746618624 00000100:00100000:2.0:1746144659.416254:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4059 00000100:00100000:2.0:1746144659.416261:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+34:12354:x1830964746618624:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144659.416306:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5824 00000100:00100000:1.0:1746144659.416311:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+34:1963:x1830964746618752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.416321:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.416327:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 34 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.416336:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 34 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.416356:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a503ea00/0xa7c849b16e0198dd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6dc expref: 34 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.416370:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.416374:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144659.416382:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.416423:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+34:1963:x1830964746618752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 112us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.416428:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5824 00000100:00100000:2.0:1746144659.416446:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:12354:x1830964746618624:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 186us (1346us total) trans 8589943948 rc 0/0 00000100:00100000:2.0:1746144659.416452:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4059 00000100:00100000:2.0:1746144659.416786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.416812:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747468928:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.416821:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747469056:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.416860:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144659.416990:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.417007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.417024:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.417054:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746618240 00000100:00100000:0.0:1746144659.417058:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746618240 00010000:00010000:0.0:1746144659.417071:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 321 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.417090:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746618880 00000100:00100000:0.0:1746144659.417092:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746618880 00010000:00010000:0.0:1746144659.417098:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 322 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.417107:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746618368 00000100:00100000:1.0:1746144659.417123:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746618368 00010000:00010000:1.0:1746144659.417154:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 33 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.417232:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746619008 00000100:00100000:0.0:1746144659.417234:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746619008 00010000:00010000:0.0:1746144659.417242:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 34 pid: 20319 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.417283:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5825 00000100:00100000:3.0:1746144659.417294:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5826 00000100:00100000:1.0:1746144659.417294:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:1961:x1830964746618240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.417302:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144659.417303:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:1961:x1830964746618880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.417306:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 322 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:0.0:1746144659.417308:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5827 00010000:00010000:3.0:1746144659.417311:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144659.417313:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746618368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.417316:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 322 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.417316:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 322 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.417320:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.417324:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 322 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.417325:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 34 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.417336:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019ccd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e905 expref: 322 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.417341:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabd400/0xa7c849b16e0198cf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e6ce expref: 322 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.417342:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 34 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.417344:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5828 00000100:00100000:2.0:1746144659.417350:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746619008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.417353:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.417356:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.417357:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.417361:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 34 pid: 20319 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.417362:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144659.417363:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.417366:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.417372:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144659.417379:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29be00/0xa7c849b16e019c79 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e8e9 expref: 34 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.417380:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 34 pid: 20319 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.417380:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:1961:x1830964746618240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 92us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.417386:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5825 00010000:00010000:2.0:1746144659.417389:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e019897 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e69d expref: 33 pid: 20319 timeout: 738 lvb_type: 0 00010000:00010000:0.0:1746144659.417389:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:3.0:1746144659.417390:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:1961:x1830964746618880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 89us (398us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144659.417392:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:3.0:1746144659.417396:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5826 00010000:00010000:0.0:1746144659.417397:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144659.417398:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.417400:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.417404:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144659.417411:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746618368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.417414:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746619008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 65us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.417416:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5827 00000100:00100000:2.0:1746144659.417419:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5828 00000100:00100000:0.0:1746144659.432246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.432309:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746619136 00000100:00100000:2.0:1746144659.432320:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746619136 00010000:00010000:2.0:1746144659.432370:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 31 pid: 14709 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.432411:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5829 00000100:00100000:2.0:1746144659.432419:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+31:1961:x1830964746619136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.432436:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.432442:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 31 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.432455:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 31 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.432478:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e019be6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152e880 expref: 31 pid: 14709 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.432514:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.432519:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.432529:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.432535:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.432566:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.432605:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746619136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 187us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.432612:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5829 00010000:00010000:0.0:1746144659.432635:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144659.432643:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000040:00080000:0.0:1746144659.433428:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2903, 88 off242408 00000004:00080000:0.0:1746144659.433436:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642300925ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433490:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2824, 88 off235448 00000004:00080000:0.0:1746144659.433496:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642361129ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433520:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2825, 88 off235536 00000004:00080000:0.0:1746144659.433523:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642388608ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433530:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2904, 88 off242496 00000004:00080000:0.0:1746144659.433533:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642398319ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433540:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2905, 88 off242584 00000004:00080000:0.0:1746144659.433542:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642407388ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433550:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2826, 88 off235624 00000004:00080000:0.0:1746144659.433553:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642418449ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433559:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2827, 88 off235712 00000004:00080000:0.0:1746144659.433561:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642426895ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433568:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2828, 88 off235800 00000100:00100000:2.0:1746144659.433569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000004:00080000:0.0:1746144659.433571:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642436168ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433576:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2906, 88 off242672 00000004:00080000:0.0:1746144659.433579:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642444334ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433586:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2829, 88 off235888 00000004:00080000:0.0:1746144659.433589:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642454347ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433595:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2907, 88 off242760 00000004:00080000:0.0:1746144659.433597:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642462528ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433646:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2830, 88 off235976 00000004:00080000:0.0:1746144659.433650:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642515427ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144659.433660:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2908, 88 off242848 00000004:00080000:0.0:1746144659.433662:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642528027ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433669:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2909, 88 off242936 00000004:00080000:0.0:1746144659.433671:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642536659ns, next at 593496143484ns, rc = 0 00000100:00100000:3.0:1746144659.433675:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746619392 00000040:00080000:0.0:1746144659.433678:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2910, 88 off243024 00000100:00100000:3.0:1746144659.433680:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746619392 00000004:00080000:0.0:1746144659.433680:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642545557ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433685:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2911, 88 off243112 00000004:00080000:0.0:1746144659.433688:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638642553088ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144659.433693:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2831, 88 off236064 00000004:00080000:0.0:1746144659.433695:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638642560778ns, next at 593480289301ns, rc = 0 00000100:00100000:3.0:1746144659.433728:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10069 00000100:00100000:3.0:1746144659.433735:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:29071:x1830964746619392:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144659.433769:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.433784:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bac00/0xa7c849b16e019fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eae1 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.433889:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.433899:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.433907:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.433919:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.433924:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.433929:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000001:00080000:0.0:1746144659.459708:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943949 is committed 00000004:00080000:0.0:1746144659.459718:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2017 committed 00000004:00080000:0.0:1746144659.459731:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2093 committed 00000004:00080000:0.0:1746144659.459738:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2092 committed 00000004:00080000:0.0:1746144659.459740:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2091 committed 00000004:00080000:0.0:1746144659.459741:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2090 committed 00000004:00080000:0.0:1746144659.459743:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2016 committed 00000004:00080000:0.0:1746144659.459745:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2089 committed 00000004:00080000:0.0:1746144659.459747:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2015 committed 00000004:00080000:0.0:1746144659.459749:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2088 committed 00000004:00080000:0.0:1746144659.459750:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746144659.459752:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2013 committed 00000004:00080000:0.0:1746144659.459753:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746144659.459755:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746144659.459756:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2086 committed 00000004:00080000:0.0:1746144659.459758:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746144659.459759:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746144659.459760:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2085 committed 00000001:00080000:0.0:1746144659.459770:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943940 is committed 00000001:00080000:0.0:1746144659.459774:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943939 is committed 00000001:00080000:0.0:1746144659.459785:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943941 is committed 00000001:00080000:0.0:1746144659.459811:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943948 is committed 00000001:00080000:0.0:1746144659.459858:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943942 is committed 00000100:00100000:1.0:1746144659.459886:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747469184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.459908:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747469312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144659.460035:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747469440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.460095:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.460162:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747469824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.460179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.460200:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747470336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.460216:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.460227:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747470848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.460239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.460262:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469312 00000100:00100000:0.0:1746144659.460269:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469312 00000100:00100000:0.0:1746144659.460307:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469824 00000100:00100000:0.0:1746144659.460309:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469824 00000100:00100000:0.0:1746144659.460319:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470336 00000100:00100000:0.0:1746144659.460321:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470336 00000100:00100000:0.0:1746144659.460334:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470848 00000100:00100000:0.0:1746144659.460337:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470848 00000100:00100000:0.0:1746144659.460350:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11677 00000100:00100000:0.0:1746144659.460356:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3295:x1830964747469312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.460394:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460409:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747469696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.460423:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460435:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.460445:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460453:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.460464:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460473:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746144659.460476:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747469568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.460486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460491:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.460501:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460505:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.460516:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460521:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747471104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.460531:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.460544:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469184 00000100:00100000:1.0:1746144659.460546:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469184 00000100:00100000:1.0:1746144659.460559:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469696 00000100:00100000:0.0:1746144659.460559:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3295:x1830964747469312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (464us total) trans 21474840481 rc 0/0 00000100:00100000:1.0:1746144659.460560:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469696 00000100:00100000:0.0:1746144659.460565:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11677 00000100:00100000:1.0:1746144659.460573:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470208 00000100:00100000:1.0:1746144659.460574:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470208 00000100:00100000:0.0:1746144659.460578:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470720 00000100:00100000:1.0:1746144659.460580:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469568 00000100:00100000:0.0:1746144659.460580:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470720 00000100:00100000:1.0:1746144659.460582:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469568 00000100:00100000:1.0:1746144659.460588:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470080 00000100:00100000:0.0:1746144659.460588:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470592 00000100:00100000:1.0:1746144659.460589:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470080 00000100:00100000:0.0:1746144659.460591:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470592 00000100:00100000:1.0:1746144659.460594:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747471104 00000100:00100000:1.0:1746144659.460596:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747471104 00000100:00100000:0.0:1746144659.460598:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11678 00000100:00100000:0.0:1746144659.460602:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3295:x1830964747469824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.460603:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11679 00000100:00100000:1.0:1746144659.460608:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3295:x1830964747470336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.460681:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3295:x1830964747469824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (500us total) trans 21474840482 rc 0/0 00000100:00100000:0.0:1746144659.460686:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11678 00000100:00100000:0.0:1746144659.460694:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11680 00000100:00100000:0.0:1746144659.460698:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3295:x1830964747470848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.460730:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3295:x1830964747470336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (512us total) trans 17179873232 rc 0/0 00000100:00100000:1.0:1746144659.460736:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11679 00000100:00100000:1.0:1746144659.460746:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11681 00000100:00100000:1.0:1746144659.460751:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3294:x1830964747469184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.460777:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3295:x1830964747470848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (536us total) trans 17179873233 rc 0/0 00000100:00100000:0.0:1746144659.460782:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11680 00000100:00100000:0.0:1746144659.460790:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11682 00000100:00100000:0.0:1746144659.460795:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3294:x1830964747469696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.460834:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3294:x1830964747469184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (440us total) trans 21474840483 rc 0/0 00000100:00100000:1.0:1746144659.460840:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11681 00000100:00100000:1.0:1746144659.460852:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11683 00000100:00100000:1.0:1746144659.460856:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747470208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.460870:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3294:x1830964747469696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (445us total) trans 21474840484 rc 0/0 00000100:00100000:0.0:1746144659.460876:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11682 00000100:00100000:0.0:1746144659.460885:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11684 00000100:00100000:0.0:1746144659.460889:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747470720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.460940:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3294:x1830964747470208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (492us total) trans 17179873234 rc 0/0 00000100:00100000:1.0:1746144659.460946:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11683 00000100:00100000:1.0:1746144659.460955:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11685 00000100:00100000:1.0:1746144659.460959:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3294:x1830964747469568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.460965:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3294:x1830964747470720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (499us total) trans 17179873235 rc 0/0 00000100:00100000:0.0:1746144659.460970:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11684 00000100:00100000:0.0:1746144659.460979:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11686 00000100:00100000:0.0:1746144659.460983:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3294:x1830964747470080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144659.461018:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144659.461021:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144659.461023:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144659.461025:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144659.461027:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144659.461042:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3294:x1830964747469568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (554us total) trans 21474840485 rc 0/0 00000100:00100000:1.0:1746144659.461047:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11685 00000100:00100000:1.0:1746144659.461054:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11687 00000100:00100000:1.0:1746144659.461058:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747470592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.461059:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3294:x1830964747470080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (556us total) trans 21474840486 rc 0/0 00000100:00100000:0.0:1746144659.461065:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11686 00000100:00100000:0.0:1746144659.461075:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11688 00000100:00100000:0.0:1746144659.461079:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747471104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.461148:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3294:x1830964747470592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (615us total) trans 17179873236 rc 0/0 00000100:00100000:1.0:1746144659.461153:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11687 00000004:00080000:1.0:1746144659.461187:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1ced80/2, rc 0, transno 21474840485 00000100:00100000:0.0:1746144659.461189:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3294:x1830964747471104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (656us total) trans 17179873237 rc 0/0 00000100:00100000:1.0:1746144659.461192:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747469568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.461195:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11688 00000004:00080000:1.0:1746144659.461199:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e32300/2, rc 0, transno 21474840486 00000100:00100000:1.0:1746144659.461202:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.461209:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd92a00/2, rc 0, transno 17179873236 00000100:00100000:1.0:1746144659.461216:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.461222:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16ad80/2, rc 0, transno 17179873237 00000100:00100000:1.0:1746144659.461225:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747471104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.461230:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd90a80/2, rc 0, transno 17179873234 00000100:00100000:1.0:1746144659.461233:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.461238:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd90380/2, rc 0, transno 17179873235 00000100:00100000:1.0:1746144659.461241:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747470720:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.461245:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cce00/2, rc 0, transno 21474840483 00000100:00100000:1.0:1746144659.461247:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747469184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.461252:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cea00/2, rc 0, transno 21474840484 00000100:00100000:1.0:1746144659.461254:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747469696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.461280:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747471232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.461296:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.461315:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747471232 00000100:00100000:1.0:1746144659.461317:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747471232 00000100:00100000:1.0:1746144659.461329:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11689 00000100:00100000:1.0:1746144659.461332:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3294:x1830964747471232:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144659.461381:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd91180/2, rc 0, transno 17179873232 00000100:00100000:0.0:1746144659.461386:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747470336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144659.461392:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd90e00/2, rc 0, transno 17179873233 00000100:00100000:0.0:1746144659.461394:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747470848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144659.461401:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cd500/2, rc 0, transno 21474840481 00000100:00100000:1.0:1746144659.461403:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3294:x1830964747471232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (105us total) trans 17179873238 rc 0/0 00000100:00100000:0.0:1746144659.461404:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747469312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.461408:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11689 00000004:00080000:0.0:1746144659.461410:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cf100/2, rc 0, transno 21474840482 00000100:00100000:0.0:1746144659.461413:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747469824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.461424:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093760a80/2, rc 0, transno 17179873238 00000100:00100000:1.0:1746144659.461426:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747471232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.461483:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144659.461499:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747469952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.461499:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469440 00000100:00100000:1.0:1746144659.461501:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469440 00000100:00100000:1.0:1746144659.461513:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11690 00000100:00100000:3.0:1746144659.461514:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144659.461523:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747470464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.461527:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3296:x1830964747469440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144659.461536:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144659.461544:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747470976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.461555:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144659.461575:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747469952 00000100:00100000:3.0:1746144659.461578:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747469952 00000100:00100000:3.0:1746144659.461604:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470464 00000100:00100000:1.0:1746144659.461604:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747469440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (121us total) trans 21474840487 rc 0/0 00000100:00100000:3.0:1746144659.461606:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470464 00000100:00100000:1.0:1746144659.461610:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11690 00000100:00100000:3.0:1746144659.461613:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747470976 00000100:00100000:3.0:1746144659.461615:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747470976 00000100:00100000:1.0:1746144659.461619:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11691 00000100:00100000:1.0:1746144659.461623:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830964747469952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144659.461625:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11692 00000100:00100000:3.0:1746144659.461629:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830964747470464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.461681:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747469952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (166us total) trans 21474840488 rc 0/0 00000100:00100000:1.0:1746144659.461686:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11691 00000100:00100000:1.0:1746144659.461694:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11693 00000100:00100000:1.0:1746144659.461698:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3296:x1830964747470976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.461721:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3296:x1830964747470464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (183us total) trans 17179873239 rc 0/0 00000100:00100000:3.0:1746144659.461726:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11692 00000100:00080000:3.0:1746144659.461742:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746144659.461745:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144659.461757:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3296:x1830964747470976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (200us total) trans 17179873240 rc 0/0 00000100:00100000:1.0:1746144659.461762:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11693 00000004:00080000:1.0:1746144659.461781:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1cca80/2, rc 0, transno 21474840487 00000100:00100000:1.0:1746144659.461783:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747469440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.461788:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e31500/2, rc 0, transno 21474840488 00000100:00100000:1.0:1746144659.461791:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747469952:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.461797:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd93100/2, rc 0, transno 17179873239 00000100:00100000:1.0:1746144659.461799:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747470464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.461804:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd93800/2, rc 0, transno 17179873240 00000100:00100000:1.0:1746144659.461807:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747470976:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746144659.461897:0:14710:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800920ad180 reply state ffff88009b7c3400 transno 8589943949 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144659.461907:0:14710:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746144659.461994:0:14710:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746144659.462007:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29065:x1830964746618112:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 49513us (51628us total) trans 8589943949 rc 0/0 00000100:00100000:2.0:1746144659.462014:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10068 00010000:00010000:2.0:1746144659.462038:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.462045:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.462051:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.462057:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5ba200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.462061:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.462068:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.462084:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.462087:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144659.462090:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.462096:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e019fc8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.462172:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.462185:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.462191:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.462220:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.462231:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 7 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.462241:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747471360:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.462289:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.464364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.464385:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746619520 00000100:00100000:2.0:1746144659.464393:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746619520 00000100:00100000:2.0:1746144659.464431:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10070 00000100:00100000:2.0:1746144659.464438:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29065:x1830964746619520:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144659.464463:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.464477:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eae8 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.464581:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747471360:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.464603:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.464618:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.464619:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.464637:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.464643:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144659.464646:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3b200, rc 0) 00000100:00100000:2.0:1746144659.464843:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29065:x1830964746619520:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 404us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.464849:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10070 00000100:00100000:0.0:1746144659.465980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.466041:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746619648 00000100:00100000:2.0:1746144659.466046:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746619648 00010000:00010000:2.0:1746144659.466068:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 8 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.466088:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5830 00000100:00100000:2.0:1746144659.466094:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746619648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.466106:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.466119:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 8 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.466129:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 8 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.466173:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e019f90 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eada expref: 8 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:2.0:1746144659.466185:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.466189:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.466197:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.466202:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.466230:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.466265:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746619648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 171us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.466271:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5830 00010000:00010000:3.0:1746144659.466359:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466366:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144659.466383:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.466755:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466762:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466768:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466773:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.466777:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466784:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466793:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.466795:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144659.466798:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466802:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e019fe4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466815:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466820:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466824:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466827:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5baa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.466829:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466833:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466839:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144659.466841:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.466843:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466847:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5baa00/0xa7c849b16e019fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466857:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466862:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466865:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466869:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bb200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.466872:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466877:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466883:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b53c6a00) 00010000:00010000:3.0:1746144659.466885:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.466887:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466892:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb200/0xa7c849b16e019fdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.466936:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bac00/0xa7c849b16e019fcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae1 expref: 298 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.466943:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bac00/0xa7c849b16e019fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae1 expref: 298 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.466949:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bac00, rc 0) 00000100:00100000:3.0:1746144659.466977:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29071:x1830964746619392:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 33243us (33409us total) trans 8589943950 rc 301/301 00000100:00100000:3.0:1746144659.466983:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10069 00000100:00100000:1.0:1746144659.468291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.468437:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746619904 00000100:00100000:0.0:1746144659.468445:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746619904 00000100:00100000:0.0:1746144659.468540:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4060 00000100:00100000:0.0:1746144659.468547:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29065:x1830964746619904:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1746144659.468902:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29065:x1830964746619904:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 354us (613us total) trans 8589943951 rc 0/0 00000100:00100000:0.0:1746144659.468908:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4060 00000100:00100000:2.0:1746144659.470836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.470887:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746620160 00000100:00100000:0.0:1746144659.470895:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746620160 00000100:00100000:0.0:1746144659.470928:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4061 00000100:00100000:0.0:1746144659.470934:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29065:x1830964746620160:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1746144659.473414:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29065:x1830964746620160:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 2470us (2574us total) trans 8589943952 rc 0/0 00000100:00100000:0.0:1746144659.473425:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4061 00000100:00100000:0.0:1746144659.486260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.486529:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746620416 00000100:00100000:3.0:1746144659.486538:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746620416 00000100:00100000:3.0:1746144659.486614:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10071 00000100:00100000:3.0:1746144659.486624:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+6:29075:x1830964746620416:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.486652:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.486671:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e019ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eaef expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.486878:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.486896:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.486908:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.486926:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.486932:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.486938:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487073:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487087:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487094:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144659.487105:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.487500:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487508:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487514:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487520:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7eac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.487524:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487531:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487543:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144659.487547:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.487551:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.487556:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eac00/0xa7c849b16e01a000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488421:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488432:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488437:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488441:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dad4c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.488444:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488449:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488457:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136942000) 00010000:00010000:3.0:1746144659.488459:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.488461:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488466:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad4c00/0xa7c849b16e01a007 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144659.488518:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e019ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.488530:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.488536:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.488538:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144659.488540:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dad5800, rc 0) 00000100:00100000:3.0:1746144659.488610:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29075:x1830964746620416:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1987us (2358us total) trans 8589943953 rc 0/0 00000100:00100000:3.0:1746144659.488619:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10071 00000100:00100000:0.0:1746144659.492561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.494356:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746620544 00000100:00100000:2.0:1746144659.494367:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746620544 00000100:00100000:2.0:1746144659.494416:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11694 00000100:00100000:2.0:1746144659.494422:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746620544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.494441:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.494459:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eaf6 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.494475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:2.0:1746144659.494481:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d92, atime: 0x68140d8e, ctime: 0x68140d92, blocks: 0x809 00010000:00010000:2.0:1746144659.494498:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.494500:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.494507:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.494524:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.494532:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3be00, rc 0) 00000100:00100000:2.0:1746144659.494569:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746620544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 148us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.494574:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11694 00000100:00100000:2.0:1746144659.494906:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746620672 00000100:00100000:2.0:1746144659.494909:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746620672 00000100:00100000:2.0:1746144659.495091:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11695 00000100:00100000:2.0:1746144659.495095:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746620672:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.495102:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.495125:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eafd expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144659.495148:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d94, atime: 0x68140d93, ctime: 0x68140d93, blocks: 0x821 00010000:00010000:2.0:1746144659.495156:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495157:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495159:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 27 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.495166:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 27 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.495175:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3aa00, rc 0) 00000100:00100000:2.0:1746144659.495188:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746620672:12345-192.168.204.23@tcp:101:cat.0 Request processed in 93us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.495197:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11695 00000100:00100000:0.0:1746144659.495519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.495559:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746620928 00000100:00100000:2.0:1746144659.495563:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746620928 00000100:00100000:2.0:1746144659.495580:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11696 00000100:00100000:2.0:1746144659.495584:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746620928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.495591:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.495599:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb0b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.495611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:2.0:1746144659.495616:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d94, atime: 0x68140d8e, ctime: 0x68140d94, blocks: 0x821 00010000:00010000:2.0:1746144659.495625:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495626:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495631:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 19 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.495639:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 19 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144659.495639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144659.495646:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3b000, rc 0) 00000100:00100000:2.0:1746144659.495665:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746620928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.495669:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11696 00000100:00100000:2.0:1746144659.495677:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746621184 00000100:00100000:2.0:1746144659.495680:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746621184 00000100:00100000:2.0:1746144659.495691:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746620800 00000100:00100000:2.0:1746144659.495692:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746620800 00000100:00100000:0.0:1746144659.495692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.495703:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746621056 00000100:00100000:2.0:1746144659.495705:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746621056 00000100:00100000:2.0:1746144659.495717:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11697 00000100:00100000:2.0:1746144659.495721:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746621184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.495726:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.495735:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb19 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144659.495746:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d93, atime: 0x68140d93, ctime: 0x68140d93, blocks: 0x1029 00000100:00100000:0.0:1746144659.495747:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11698 00010000:00010000:2.0:1746144659.495753:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495754:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144659.495755:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746620800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.495758:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 29 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.495765:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.495767:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 29 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.495773:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a800, rc 0) 00010000:00010000:0.0:1746144659.495776:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb04 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.495791:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746621184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 69us (182us total) trans 0 rc 0/0 00002000:00010000:0.0:1746144659.495794:0:8389:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d94, atime: 0x68140d93, ctime: 0x68140d94, blocks: 0x821 00000100:00100000:2.0:1746144659.495795:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11697 00000100:00100000:2.0:1746144659.495805:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11699 00010000:00010000:0.0:1746144659.495806:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144659.495809:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746621056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.495809:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495814:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.495815:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 29 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.495821:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb12 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.495827:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 29 pid: 8389 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746144659.495832:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d93, atime: 0x68140d94, ctime: 0x68140d93, blocks: 0x15eb 00010000:00010000:0.0:1746144659.495835:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864a00, rc 0) 00010000:00010000:2.0:1746144659.495840:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495841:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.495845:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.495853:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144659.495859:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746620800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 105us (220us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144659.495860:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3ba00, rc 0) 00000100:00100000:0.0:1746144659.495865:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11698 00000100:00100000:2.0:1746144659.495874:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746621056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.495879:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11699 00000100:00100000:0.0:1746144659.513373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.513872:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746621312 00000100:00100000:3.0:1746144659.513888:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746621312 00000100:00100000:3.0:1746144659.513966:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10072 00000100:00100000:3.0:1746144659.513977:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29071:x1830964746621312:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144659.514005:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.514025:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5200/0xa7c849b16e01a046 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb20 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.514088:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5200/0xa7c849b16e01a046 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb20 expref: 298 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.514102:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5200/0xa7c849b16e01a046 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb20 expref: 298 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.514132:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.514167:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144659.514170:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dad5200, rc 0) 00000100:00100000:3.0:1746144659.514228:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29071:x1830964746621312:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 253us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.514234:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10072 00000100:00100000:0.0:1746144659.514324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.514356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.514368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.514404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.514435:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746621568 00000100:00100000:2.0:1746144659.514440:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746621568 00002000:00100000:2.0:1746144659.514472:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009b483b80 x1830964746621568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.514482:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483b80 with x1830964746621568 ext(0->1048575) 00002000:00010000:2.0:1746144659.514487:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b483b80 00000100:00100000:2.0:1746144659.514508:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746621952 00000100:00100000:2.0:1746144659.514511:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746621952 00002000:00100000:2.0:1746144659.514526:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009b481f80 x1830964746621952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.514533:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481f80 with x1830964746621952 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.514537:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b481f80 00000100:00100000:2.0:1746144659.514545:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746622080 00000100:00100000:2.0:1746144659.514547:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746622080 00002000:00100000:2.0:1746144659.514555:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b481180 x1830964746622080/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.514561:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481180 with x1830964746622080 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.514563:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b481180 00000100:00100000:2.0:1746144659.514571:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746622336 00000100:00100000:2.0:1746144659.514573:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746622336 00002000:00100000:2.0:1746144659.514580:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b481880 x1830964746622336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.514585:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481880 with x1830964746622336 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.514588:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481880 00000100:00100000:2.0:1746144659.514595:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4434 00000100:00100000:2.0:1746144659.514600:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746621568:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.514836:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4435 00000100:00100000:0.0:1746144659.514842:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+30:1963:x1830964746621952:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.515233:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4436 00000100:00100000:3.0:1746144659.515244:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1963:x1830964746622080:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.519085:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4437 00000100:00100000:2.0:1746144659.519102:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746622336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144659.519497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.521076:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746622592 00000100:00100000:2.0:1746144659.521086:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746622592 00000100:00100000:2.0:1746144659.524729:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10073 00000100:00100000:2.0:1746144659.524750:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29071:x1830964746622592:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144659.524775:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.524779:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144659.524807:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5200/0xa7c849b16e01a046 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb20 expref: 298 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.524840:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.524844:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144659.524856:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ac00/0xa7c849b16e01a04d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb27 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.524908:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.524920:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.524926:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.524932:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144659.524962:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.524973:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 7 pid: 15388 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.524985:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747471488:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.525063:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.525070:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 8 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.525078:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f447800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747471616:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.525095:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.529568:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+31:1963:x1830964746622080:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14313us (15183us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.529581:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4436 00002000:00100000:3.0:1746144659.529595:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b481180 x1830964746622080/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.529605:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481180 with x1830964746622080 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.529610:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b481180 00000100:00100000:3.0:1746144659.530935:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f447800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747471616:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144659.532174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.532210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.532212:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746622848 00000100:00100000:1.0:1746144659.532220:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746622848 00010000:00010000:1.0:1746144659.532263:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 8 pid: 15388 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.532290:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746622720 00000100:00100000:1.0:1746144659.532293:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746622720 00010000:00010000:1.0:1746144659.532305:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 9 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.532319:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5831 00000100:00100000:1.0:1746144659.532326:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746622848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.532340:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144659.532347:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5832 00010000:00010000:1.0:1746144659.532347:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 8 pid: 15388 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.532357:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 8 pid: 15388 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.532368:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746622720:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.532376:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.532380:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.532381:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 9 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.532385:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144659.532392:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144659.532396:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.532432:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746622848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.532438:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5831 00010000:00010000:3.0:1746144659.532649:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 9 pid: 14710 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.532664:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b200/0xa7c849b16e019feb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eae8 expref: 9 pid: 14710 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.532679:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746621568:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18076us (18353us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746144659.532688:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:2.0:1746144659.532688:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4434 00010000:00010000:3.0:1746144659.532692:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00002000:00100000:2.0:1746144659.532699:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009b483b80 x1830964746621568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746144659.532700:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.532706:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00002000:00100000:2.0:1746144659.532708:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483b80 with x1830964746621568 ext(0->1048575) 00002000:00010000:2.0:1746144659.532713:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b483b80 00010000:00010000:3.0:1746144659.532724:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.532743:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746622720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 389us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.532749:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5832 00010000:00010000:3.0:1746144659.532792:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dad5800/0xa7c849b16e01a00e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaef expref: 7 pid: 15388 timeout: 738 lvb_type: 0 00000100:00100000:3.0:1746144659.532803:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747471488:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.532825:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.532833:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.532838:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000040:00080000:3.0:1746144659.533788:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2912, 88 off243200 00000004:00080000:3.0:1746144659.533795:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638742660012ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.533859:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2832, 88 off236152 00000004:00080000:3.0:1746144659.533863:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638742728794ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.533884:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2833, 88 off236240 00000004:00080000:3.0:1746144659.533888:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638742753364ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.533894:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2913, 88 off243288 00000004:00080000:3.0:1746144659.533897:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638742762968ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.533903:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2914, 88 off243376 00000004:00080000:3.0:1746144659.533905:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638742770468ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.533910:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2834, 88 off236328 00000004:00080000:3.0:1746144659.533913:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638742778257ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.534864:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2835, 88 off236416 00000004:00080000:3.0:1746144659.534872:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638743737370ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.534901:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2836, 88 off236504 00000004:00080000:3.0:1746144659.534904:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638743769885ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.534913:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2915, 88 off243464 00000004:00080000:3.0:1746144659.534916:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638743781240ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.535236:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2837, 88 off236592 00000004:00080000:3.0:1746144659.535240:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638744105897ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.535262:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2916, 88 off243552 00000004:00080000:3.0:1746144659.535265:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638744130312ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.535273:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2838, 88 off236680 00000004:00080000:3.0:1746144659.535275:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638744140915ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144659.535284:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2917, 88 off243640 00000004:00080000:3.0:1746144659.535287:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638744152709ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.535294:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2918, 88 off243728 00000004:00080000:3.0:1746144659.535297:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638744162147ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.535303:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2919, 88 off243816 00000004:00080000:3.0:1746144659.535305:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638744170952ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.535424:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2920, 88 off243904 00000004:00080000:3.0:1746144659.535428:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 638744293432ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144659.535436:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2839, 88 off236768 00000004:00080000:3.0:1746144659.535438:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 638744303559ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144659.538832:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746621952:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23977us (24462us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144659.538844:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4435 00002000:00100000:0.0:1746144659.538857:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009b481f80 x1830964746621952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.538866:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481f80 with x1830964746621952 ext(1048576->2097151) 00002000:00010000:0.0:1746144659.538872:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b481f80 00000100:00100000:3.0:1746144659.540174:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746622336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21073us (25763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.540183:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4437 00002000:00100000:3.0:1746144659.540192:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b481880 x1830964746622336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.540208:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481880 with x1830964746622336 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.540212:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481880 00000100:00100000:2.0:1746144659.544533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.545042:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746622976 00000100:00100000:3.0:1746144659.545052:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746622976 00000100:00100000:3.0:1746144659.545148:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10074 00000100:00100000:3.0:1746144659.545158:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:29075:x1830964746622976:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.545184:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.545202:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb2e expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.545255:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.545263:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.545278:0:14709:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144659.545290:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.545301:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.545304:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144659.545307:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.545312:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70b200, rc 0) 00000100:00100000:3.0:1746144659.545354:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29075:x1830964746622976:12345-192.168.204.23@tcp:101:cat.0 Request processed in 198us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.545360:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10074 00000100:00100000:3.0:1746144659.559382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.559413:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746623232 00000100:00100000:2.0:1746144659.559424:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746623232 00000100:00100000:2.0:1746144659.559470:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10075 00000100:00100000:2.0:1746144659.559479:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29077:x1830964746623232:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144659.559499:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.559518:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb35 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.559626:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559639:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559649:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559666:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559672:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559677:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559786:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559794:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559799:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144659.559809:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144659.559926:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559933:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559939:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559950:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bbc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.559953:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559960:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559973:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.559976:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746144659.559980:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559985:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a077 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.559997:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560002:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560007:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560011:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bbe00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.560013:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560017:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560023:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144659.560025:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144659.560028:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560032:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01a069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560042:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560048:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560052:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560056:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5ba200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.560058:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560062:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560068:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8200) 00010000:00010000:2.0:1746144659.560070:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144659.560072:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560076:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a070 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.560125:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a062 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb35 expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.560132:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb35 expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.560161:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ba000, rc 0) 00000100:00100000:2.0:1746144659.560224:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:29077:x1830964746623232:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 745us (847us total) trans 8589943955 rc 301/301 00000100:00100000:2.0:1746144659.560234:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10075 00000100:00100000:3.0:1746144659.564857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.564914:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746623488 00000100:00100000:2.0:1746144659.564922:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746623488 00000100:00100000:2.0:1746144659.565073:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10076 00000100:00100000:2.0:1746144659.565081:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29080:x1830964746623488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.565102:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.565128:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ea800/0xa7c849b16e01a085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb3c expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.565243:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565253:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565267:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565277:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565283:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565288:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565371:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565378:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565383:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144659.565391:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144659.565453:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565459:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565465:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565470:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bb400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.565472:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565478:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565486:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.565489:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746144659.565492:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 2/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565497:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb400/0xa7c849b16e01a09a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565506:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565510:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565517:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565520:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7eb200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.565523:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565528:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565532:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144659.565534:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144659.565536:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565539:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eb200/0xa7c849b16e01a08c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565548:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565552:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565556:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565559:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7eae00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144659.565561:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565564:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565571:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8900) 00010000:00010000:2.0:1746144659.565573:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144659.565575:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565578:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7eae00/0xa7c849b16e01a093 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.565606:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ea800/0xa7c849b16e01a085 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb3c expref: 302 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.565613:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ea800/0xa7c849b16e01a085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb3c expref: 302 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.565619:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7ea800, rc 0) 00000100:00100000:2.0:1746144659.565745:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29080:x1830964746623488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 663us (894us total) trans 8589943956 rc 301/301 00000100:00100000:2.0:1746144659.565750:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10076 00010000:00010000:1.0:1746144659.566356:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.566370:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.566372:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746144659.566376:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.566384:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.566390:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144659.566702:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943952 is committed 00000001:00080000:0.0:1746144659.566715:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943954 is committed 00000004:00080000:0.0:1746144659.566719:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2025 committed 00000004:00080000:0.0:1746144659.566736:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2102 committed 00000004:00080000:0.0:1746144659.566742:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2101 committed 00000004:00080000:0.0:1746144659.566743:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2100 committed 00000004:00080000:0.0:1746144659.566745:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2099 committed 00000004:00080000:0.0:1746144659.566746:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2024 committed 00000004:00080000:0.0:1746144659.566748:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2098 committed 00000004:00080000:0.0:1746144659.566749:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2023 committed 00000004:00080000:0.0:1746144659.566750:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2097 committed 00000004:00080000:0.0:1746144659.566751:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2022 committed 00000004:00080000:0.0:1746144659.566752:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2021 committed 00000004:00080000:0.0:1746144659.566753:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2020 committed 00000004:00080000:0.0:1746144659.566754:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2096 committed 00000004:00080000:0.0:1746144659.566756:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2095 committed 00000004:00080000:0.0:1746144659.566758:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2019 committed 00000004:00080000:0.0:1746144659.566759:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746144659.566761:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2094 committed 00000001:00080000:0.0:1746144659.566766:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943953 is committed 00010000:00010000:1.0:1746144659.567065:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.567077:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747471744:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.567249:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.567318:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747472128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.567341:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747472000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144659.567349:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.567363:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144659.567364:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747472640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.567377:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747472512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144659.567378:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.567393:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747472256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144659.567404:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013129ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747473152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.567407:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144659.567418:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.567419:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747472768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.567432:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144659.567434:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747473664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144659.567447:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.567447:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747473280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.567455:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472128 00000100:00100000:3.0:1746144659.567461:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472128 00000100:00100000:1.0:1746144659.567461:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.567471:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747473792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.567480:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.567558:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472640 00000100:00100000:3.0:1746144659.567559:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472000 00000100:00100000:1.0:1746144659.567562:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472640 00000100:00100000:3.0:1746144659.567565:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472000 00000100:00100000:1.0:1746144659.567577:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472256 00000100:00100000:1.0:1746144659.567579:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472256 00000100:00100000:3.0:1746144659.567583:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473152 00000100:00100000:3.0:1746144659.567586:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473152 00000100:00100000:1.0:1746144659.567588:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472768 00000100:00100000:1.0:1746144659.567590:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472768 00000100:00100000:3.0:1746144659.567595:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473664 00000100:00100000:3.0:1746144659.567597:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473664 00000100:00100000:1.0:1746144659.567597:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473280 00000100:00100000:1.0:1746144659.567599:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473280 00000100:00100000:3.0:1746144659.567605:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473792 00000100:00100000:3.0:1746144659.567606:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473792 00000100:00100000:1.0:1746144659.567608:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11700 00000100:00100000:0.0:1746144659.567612:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747471872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.567613:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3293:x1830964747472128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.567617:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11701 00000100:00100000:3.0:1746144659.567622:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747472640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.567634:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.567643:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747472384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.567654:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.567660:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747472896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.567671:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.567676:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747473408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.567686:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144659.567703:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747471872 00000100:00100000:0.0:1746144659.567706:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747471872 00000100:00100000:0.0:1746144659.567718:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472384 00000100:00100000:0.0:1746144659.567719:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472384 00000100:00100000:0.0:1746144659.567725:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472896 00000100:00100000:0.0:1746144659.567727:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472896 00000100:00100000:0.0:1746144659.567732:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473408 00002000:00010000:3.0:1746144659.567733:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144659.567733:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746144659.567733:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473408 00002000:00010000:3.0:1746144659.567736:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144659.567736:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144658 -> 1746144658 00002000:00010000:3.0:1746144659.567738:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144659.567738:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00002000:00010000:3.0:1746144659.567739:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144659.567739:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144658 -> 1746144658 00000100:00100000:0.0:1746144659.567740:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11702 00002000:00010000:3.0:1746144659.567741:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746144659.567741:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746144659.567744:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747472000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144659.567768:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3293:x1830964747472640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (388us total) trans 21474840489 rc 0/0 00000100:00100000:1.0:1746144659.567768:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3293:x1830964747472128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (418us total) trans 17179873241 rc 0/0 00000100:00100000:3.0:1746144659.567773:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11701 00000100:00100000:1.0:1746144659.567776:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11700 00000100:00100000:3.0:1746144659.567786:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11703 00000100:00100000:1.0:1746144659.567790:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11704 00000100:00100000:3.0:1746144659.567793:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3294:x1830964747472256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.567794:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3293:x1830964747473152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144659.567822:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144659.567825:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144660 -> 1746144660 00002000:00010000:0.0:1746144659.567827:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144659 -> 1746144659 00002000:00010000:0.0:1746144659.567829:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144660 -> 1746144660 00002000:00010000:0.0:1746144659.567830:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144659.567849:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747472000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (485us total) trans 21474840490 rc 0/0 00000100:00100000:0.0:1746144659.567854:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11702 00002000:00010000:3.0:1746144659.567862:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144659.567865:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144660 -> 1746144660 00000100:00100000:0.0:1746144659.567866:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11705 00002000:00010000:3.0:1746144659.567867:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144654 -> 1746144654 00000100:00100000:1.0:1746144659.567867:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3293:x1830964747473152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (447us total) trans 21474840491 rc 0/0 00002000:00010000:3.0:1746144659.567868:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144660 -> 1746144660 00002000:00010000:3.0:1746144659.567870:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144659.567870:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3294:x1830964747472768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.567877:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11704 00000100:00100000:1.0:1746144659.567888:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11706 00000100:00100000:1.0:1746144659.567892:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3293:x1830964747473664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.567893:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3294:x1830964747472256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (484us total) trans 17179873242 rc 0/0 00000100:00100000:3.0:1746144659.567898:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11703 00000100:00100000:3.0:1746144659.567908:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11707 00000100:00100000:3.0:1746144659.567914:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3294:x1830964747473280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.567939:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3294:x1830964747472768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (506us total) trans 21474840492 rc 0/0 00000100:00100000:0.0:1746144659.567943:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11705 00000100:00100000:0.0:1746144659.567954:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11708 00000100:00100000:0.0:1746144659.567957:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:3294:x1830964747473792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.567961:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3293:x1830964747473664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (513us total) trans 17179873243 rc 0/0 00000100:00100000:1.0:1746144659.567966:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11706 00000100:00100000:1.0:1746144659.567976:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11709 00000100:00100000:1.0:1746144659.567980:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3295:x1830964747471872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144659.567991:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3294:x1830964747473280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (528us total) trans 17179873244 rc 0/0 00000100:00100000:3.0:1746144659.567996:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11707 00000100:00100000:3.0:1746144659.568005:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11710 00000100:00100000:3.0:1746144659.568011:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3295:x1830964747472384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144659.568029:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:3294:x1830964747473792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (547us total) trans 17179873245 rc 0/0 00000100:00100000:0.0:1746144659.568034:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11708 00002000:00010000:1.0:1746144659.568040:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144659.568043:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144660 -> 1746144660 00000100:00100000:0.0:1746144659.568044:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11711 00002000:00010000:1.0:1746144659.568045:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144659 -> 1746144659 00002000:00010000:1.0:1746144659.568047:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144659 -> 1746144659 00000100:00100000:0.0:1746144659.568047:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3295:x1830964747472896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144659.568048:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144659.568068:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3295:x1830964747471872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (433us total) trans 21474840493 rc 0/0 00000100:00100000:1.0:1746144659.568073:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11709 00002000:00010000:3.0:1746144659.568079:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746144659.568081:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144659 -> 1746144659 00000100:00100000:1.0:1746144659.568082:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11712 00002000:00010000:3.0:1746144659.568083:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144659 -> 1746144659 00002000:00010000:3.0:1746144659.568084:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144659 -> 1746144659 00002000:00010000:3.0:1746144659.568086:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144659.568087:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3295:x1830964747473408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.568120:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3295:x1830964747472384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (464us total) trans 21474840494 rc 0/0 00000100:00100000:3.0:1746144659.568126:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11710 00000100:00100000:0.0:1746144659.568130:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3295:x1830964747472896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (457us total) trans 21474840495 rc 0/0 00000100:00100000:0.0:1746144659.568153:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11711 00000100:00100000:1.0:1746144659.568196:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3295:x1830964747473408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (507us total) trans 17179873246 rc 0/0 00000100:00100000:1.0:1746144659.568201:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11712 00000100:00100000:1.0:1746144659.568219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.568231:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747473024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.568245:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144659.568255:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747473536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.568266:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746144659.568288:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f446a00/2, rc 0, transno 21474840490 00000100:00100000:1.0:1746144659.568293:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747472000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.568304:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747472512 00000100:00100000:1.0:1746144659.568306:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747472512 00000100:00100000:1.0:1746144659.568319:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11713 00000100:00100000:1.0:1746144659.568323:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3296:x1830964747472512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144659.568387:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144659.568389:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144659 -> 1746144659 00002000:00010000:1.0:1746144659.568391:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144660 -> 1746144660 00002000:00010000:1.0:1746144659.568393:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144659 -> 1746144659 00002000:00010000:1.0:1746144659.568394:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5611 00000100:00100000:1.0:1746144659.568414:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830964747472512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (194us total) trans 17179873247 rc 0/0 00000100:00100000:1.0:1746144659.568419:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11713 00000100:00100000:1.0:1746144659.568427:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473024 00000100:00100000:1.0:1746144659.568429:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473024 00000100:00100000:1.0:1746144659.568438:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473536 00000100:00100000:1.0:1746144659.568440:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473536 00000100:00100000:1.0:1746144659.568459:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11714 00000100:00100000:1.0:1746144659.568462:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747473024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144659.568522:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11715 00000100:00100000:1.0:1746144659.568526:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747473024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (279us total) trans 21474840496 rc 0/0 00000100:00100000:1.0:1746144659.568529:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11714 00000100:00100000:3.0:1746144659.568530:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3296:x1830964747473536:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.568545:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f399f80/2, rc 0, transno 17179873242 00000100:00100000:1.0:1746144659.568549:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747472256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.568554:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f444000/2, rc 0, transno 21474840492 00000100:00100000:1.0:1746144659.568556:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747472768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.568560:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f398e00/2, rc 0, transno 17179873244 00000100:00100000:1.0:1746144659.568561:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747473280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.568564:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4dd4a80/2, rc 0, transno 17179873245 00000100:00100000:1.0:1746144659.568566:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747473792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.568586:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f399180/2, rc 0, transno 17179873247 00000100:00100000:1.0:1746144659.568587:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747472512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144659.568590:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f447800/2, rc 0, transno 21474840496 00000100:00100000:1.0:1746144659.568592:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747473024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144659.568594:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746144659.568597:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747473920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144659.568609:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144659.568612:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3296:x1830964747473536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (344us total) trans 17179873248 rc 0/0 00000100:00100000:3.0:1746144659.568617:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11715 00000004:00080000:1.0:1746144659.568618:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ee300/2, rc 0, transno 17179873248 00000100:00100000:1.0:1746144659.568620:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747473536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.568626:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747473920 00000100:00100000:3.0:1746144659.568628:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747473920 00000100:00100000:3.0:1746144659.568643:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11716 00000100:00100000:3.0:1746144659.568647:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3296:x1830964747473920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144659.568735:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3296:x1830964747473920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (123us total) trans 17179873249 rc 0/0 00000100:00100000:3.0:1746144659.568739:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11716 00000004:00080000:2.0:1746144659.568826:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eed80/2, rc 0, transno 17179873243 00000100:00100000:2.0:1746144659.568831:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747473664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144659.568838:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f39b800/2, rc 0, transno 17179873241 00000100:00100000:2.0:1746144659.568840:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747472128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144659.568846:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f447b80/2, rc 0, transno 21474840489 00000100:00100000:2.0:1746144659.568848:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747472640:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144659.568855:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013129ed80/2, rc 0, transno 21474840491 00000100:00100000:2.0:1746144659.568857:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013129ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747473152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144659.568866:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ebf480/2, rc 0, transno 17179873249 00000100:00100000:1.0:1746144659.568870:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747473920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144659.568935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000004:00080000:0.0:1746144659.569287:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f447100/2, rc 0, transno 21474840493 00000100:00100000:0.0:1746144659.569290:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747471872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144659.569296:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f444a80/2, rc 0, transno 21474840494 00000100:00100000:0.0:1746144659.569299:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747472384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144659.569305:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f446680/2, rc 0, transno 21474840495 00000100:00100000:0.0:1746144659.569307:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747472896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144659.569314:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51edf80/2, rc 0, transno 17179873246 00000100:00100000:0.0:1746144659.569316:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747473408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144659.569362:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746623744 00000100:00100000:2.0:1746144659.569366:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746623744 00000100:00100000:2.0:1746144659.569393:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4062 00000100:00100000:2.0:1746144659.569398:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29080:x1830964746623744:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144659.569521:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29080:x1830964746623744:12345-192.168.204.23@tcp:35:cat.0 Request processed in 121us (586us total) trans 8589943957 rc 0/0 00000100:00100000:2.0:1746144659.569526:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4062 00000100:00100000:3.0:1746144659.573836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.573864:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747471744:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144659.573873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144659.573897:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ac00/0xa7c849b16e01a04d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 300 pid: 14710 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746144659.573915:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.573917:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624000 00000100:00100000:2.0:1746144659.573923:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624000 00010000:00010000:1.0:1746144659.573941:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3b800, rc 0) 00000100:00100000:2.0:1746144659.573966:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10077 00000100:00100000:2.0:1746144659.573974:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29080:x1830964746624000:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144659.573978:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29071:x1830964746622592:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 49237us (54481us total) trans 8589943954 rc 0/0 00000100:00100000:1.0:1746144659.573985:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10073 00010000:00010000:2.0:1746144659.573986:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.573996:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabc200/0xa7c849b16e01a0a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb43 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.574046:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.574060:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.574068:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144659.574089:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144659.574093:0:15388:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144659.574115:0:15388:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144659.574131:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabc200/0xa7c849b16e01a0a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 301 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.574161:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 300 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.574167:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144659.574170:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144659.574172:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabca00, rc 0) 00000100:00100000:2.0:1746144659.574189:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29080:x1830964746624000:12345-192.168.204.23@tcp:101:cat.0 Request processed in 217us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.574194:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10077 00000100:00100000:0.0:1746144659.574628:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746623872 00000100:00100000:0.0:1746144659.574632:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746623872 00000100:00100000:0.0:1746144659.574652:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4063 00000100:00100000:0.0:1746144659.574657:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29075:x1830964746623872:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:0.0:1746144659.574704:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29075:x1830964746623872:12345-192.168.204.23@tcp:49:cat.0 Request processed in 47us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.574709:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4063 00000100:00100000:0.0:1746144659.576927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.577192:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624128 00000100:00100000:2.0:1746144659.577201:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624128 00000100:00100000:2.0:1746144659.577256:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11717 00000100:00100000:2.0:1746144659.577263:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746624128:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.577282:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.577300:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb4a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.577325:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.577327:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.577335:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 33 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.577349:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 33 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.577359:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fabce00, rc 0) 00000100:00100000:2.0:1746144659.577410:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746624128:12345-192.168.204.23@tcp:101:cat.0 Request processed in 147us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.577415:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11717 00000100:00100000:0.0:1746144659.577943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.577962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.577976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.577984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.577992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.578006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.578167:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624256 00000100:00100000:2.0:1746144659.578168:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624384 00000100:00100000:2.0:1746144659.578171:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624384 00000100:00100000:3.0:1746144659.578178:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624256 00000100:00100000:2.0:1746144659.578189:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624512 00000100:00100000:0.0:1746144659.578189:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624640 00000100:00100000:2.0:1746144659.578191:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624512 00000100:00100000:0.0:1746144659.578192:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624640 00000100:00100000:1.0:1746144659.578213:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624768 00000100:00100000:2.0:1746144659.578215:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746624896 00000100:00100000:2.0:1746144659.578217:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624896 00000100:00100000:1.0:1746144659.578217:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746624768 00000100:00100000:0.0:1746144659.578251:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11718 00000100:00100000:0.0:1746144659.578257:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746624384:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.578267:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.578278:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb58 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.578291:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.578292:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.578297:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 35 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.578311:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 35 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144659.578317:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864400, rc 0) 00000100:00100000:3.0:1746144659.578371:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11719 00000100:00100000:3.0:1746144659.578381:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746624512:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.578394:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.578407:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb5f expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.578429:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.578431:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.578438:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 35 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.578454:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 35 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.578464:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70b400, rc 0) 00000100:00100000:2.0:1746144659.578501:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11720 00000100:00100000:2.0:1746144659.578508:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746624640:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.578515:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144659.578521:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11721 00010000:00010000:2.0:1746144659.578523:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb66 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.578526:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746624256:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.578532:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.578534:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.578536:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.578539:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb51 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.578540:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.578548:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.578549:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.578550:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.578553:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 36 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.578557:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5800, rc 0) 00010000:00010000:1.0:1746144659.578562:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 36 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.578567:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428a800, rc 0) 00000100:00100000:2.0:1746144659.578779:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746624640:12345-192.168.204.23@tcp:101:cat.0 Request processed in 270us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.578784:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11720 00000100:00100000:3.0:1746144659.578785:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746624512:12345-192.168.204.23@tcp:101:cat.0 Request processed in 399us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.578791:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11719 00000100:00100000:2.0:1746144659.578798:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11722 00000100:00100000:0.0:1746144659.578798:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746624384:12345-192.168.204.23@tcp:101:cat.0 Request processed in 541us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.578803:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29071:x1830964746624896:12345-192.168.204.23@tcp:101:multiop.0 00000100:00100000:0.0:1746144659.578803:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11718 00010000:00010000:2.0:1746144659.578809:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.578817:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb74 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.578833:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 28 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144659.578835:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746624256:12345-192.168.204.23@tcp:101:cat.0 Request processed in 309us (892us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144659.578839:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.578840:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.578843:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3207168->3760127] (req 3207168->3760127) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 36 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.578870:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 28 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.578882:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 28 pid: 7257 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746144659.578895:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747474048:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.578942:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.578977:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11723 00000100:00100000:3.0:1746144659.578989:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746624768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.578997:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.579006:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a0e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb6d expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.579611:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.579620:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a0e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb6d expref: 37 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.579628:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a0e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb6d expref: 37 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.579637:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a000, rc 0) 00000100:00100000:3.0:1746144659.579659:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746624768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 674us (1665us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.579664:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11723 00000100:00100000:1.0:1746144659.579671:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11721 00000100:00100000:0.0:1746144659.580398:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747474048:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144659.580430:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3207168->3760127] (req 3207168->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 34 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.580440:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5e00, rc 0) 00000100:00100000:0.0:1746144659.580471:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:29071:x1830964746624896:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1667us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.580477:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11722 00000100:00100000:0.0:1746144659.581332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.581549:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746625024 00000100:00100000:2.0:1746144659.581555:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746625024 00010000:00010000:2.0:1746144659.581581:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 29 pid: 7257 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746144659.581616:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5833 00000100:00100000:2.0:1746144659.581623:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746625024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144659.581633:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.581654:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 29 pid: 7257 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.581663:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 29 pid: 7257 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.581679:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a800/0xa7c849b16e01a031 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb19 expref: 29 pid: 7257 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.581689:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.581691:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144659.581696:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.581704:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.581730:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.581740:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747474176:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144659.581812:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.588779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.589309:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746625280 00000100:00100000:3.0:1746144659.589324:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746625280 00002000:00100000:3.0:1746144659.589376:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012cef8000 x1830964746625280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.589384:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8000 with x1830964746625280 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.589389:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8000 00000100:00100000:3.0:1746144659.589416:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4438 00000100:00100000:3.0:1746144659.589425:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746625280:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.592854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.593013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.593054:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746625536 00000100:00100000:2.0:1746144659.593067:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746625536 00000100:00100000:3.0:1746144659.593094:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746625792 00000100:00100000:3.0:1746144659.593102:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746625792 00002000:00100000:2.0:1746144659.593131:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880093763800 x1830964746625536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.593170:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763800 with x1830964746625536 ext(0->1048575) 00002000:00010000:2.0:1746144659.593175:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093763800 00002000:00100000:3.0:1746144659.593177:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880093761880 x1830964746625792/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.593186:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761880 with x1830964746625792 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.593191:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761880 00000100:00100000:2.0:1746144659.593199:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4439 00000100:00100000:2.0:1746144659.593208:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746625536:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.593218:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4440 00000100:00100000:3.0:1746144659.593227:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746625792:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.596599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.596727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.596747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.597374:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747474176:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144659.597396:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144659.597431:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+30:1962:x1830964746625024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 15808us (16099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.597441:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5833 00000100:00100000:3.0:1746144659.597523:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746626048 00000100:00100000:3.0:1746144659.597530:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746626048 00002000:00100000:3.0:1746144659.597583:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cefa680 x1830964746626048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.597593:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefa680 with x1830964746626048 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.597598:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cefa680 00000100:00100000:3.0:1746144659.597614:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746626304 00000100:00100000:3.0:1746144659.597616:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746626304 00000100:00100000:0.0:1746144659.597622:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746626560 00002000:00100000:3.0:1746144659.597634:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092934700 x1830964746626304/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746144659.597639:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746626560 00002000:00100000:3.0:1746144659.597640:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934700 with x1830964746626304 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.597643:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092934700 00000100:00100000:3.0:1746144659.597654:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4441 00000100:00100000:3.0:1746144659.597661:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746626048:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:0.0:1746144659.597677:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3207168->3211263) req@ffff880092935180 x1830964746626560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.597687:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935180 with x1830964746626560 ext(3207168->3211263) 00002000:00010000:0.0:1746144659.597692:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092935180 00000100:00100000:0.0:1746144659.597714:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4442 00000100:00100000:0.0:1746144659.597721:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746626304:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.598124:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4443 00000100:00100000:2.0:1746144659.598131:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746626560:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.598294:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746626560:12345-192.168.204.23@tcp:3:cat.0 Request processed in 160us (1543us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144659.598300:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4443 00002000:00100000:2.0:1746144659.598307:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3207168->3211263) req@ffff880092935180 x1830964746626560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.598314:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935180 with x1830964746626560 ext(3207168->3211263) 00002000:00010000:2.0:1746144659.598317:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092935180 00000100:00100000:3.0:1746144659.601964:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746625280:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12527us (13181us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.601976:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4438 00002000:00100000:3.0:1746144659.601988:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012cef8000 x1830964746625280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.601998:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8000 with x1830964746625280 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.602005:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8000 00000100:00100000:3.0:1746144659.607432:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746625792:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14196us (14408us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.607445:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4440 00002000:00100000:3.0:1746144659.607459:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880093761880 x1830964746625792/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.607469:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761880 with x1830964746625792 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.607475:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761880 00000100:00100000:2.0:1746144659.609782:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746625536:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16564us (16923us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.609797:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4439 00002000:00100000:2.0:1746144659.609807:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880093763800 x1830964746625536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.609816:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763800 with x1830964746625536 ext(0->1048575) 00002000:00010000:2.0:1746144659.609820:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093763800 00000100:00100000:0.0:1746144659.614883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.614982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.615082:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746626816 00000100:00100000:2.0:1746144659.615093:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746626816 00000100:00100000:3.0:1746144659.615229:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746627072 00000100:00100000:3.0:1746144659.615234:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746627072 00002000:00100000:3.0:1746144659.615277:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880093761f80 x1830964746627072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.615285:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761f80 with x1830964746627072 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.615291:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761f80 00000100:00100000:3.0:1746144659.615314:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4444 00000100:00100000:3.0:1746144659.615323:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746627072:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144659.615615:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746626304:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17893us (18888us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144659.615624:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4442 00002000:00100000:1.0:1746144659.615632:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092934700 x1830964746626304/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.615644:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934700 with x1830964746626304 ext(1048576->2097151) 00002000:00010000:1.0:1746144659.615648:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092934700 00002000:00100000:2.0:1746144659.615709:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3756032->3760127) req@ffff880093762d80 x1830964746626816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.615715:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762d80 with x1830964746626816 ext(3756032->3760127) 00002000:00010000:2.0:1746144659.615718:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093762d80 00000100:00100000:2.0:1746144659.615730:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4445 00000100:00100000:2.0:1746144659.615735:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746626816:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.615849:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746626816:12345-192.168.204.23@tcp:3:cat.0 Request processed in 114us (978us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144659.615856:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4445 00002000:00100000:2.0:1746144659.615860:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3756032->3760127) req@ffff880093762d80 x1830964746626816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.615866:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762d80 with x1830964746626816 ext(3756032->3760127) 00002000:00010000:2.0:1746144659.615869:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093762d80 00000100:00100000:3.0:1746144659.619871:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746626048:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22197us (23274us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.619885:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4441 00002000:00100000:3.0:1746144659.619898:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cefa680 x1830964746626048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.619907:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefa680 with x1830964746626048 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.619913:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cefa680 00000100:00100000:0.0:1746144659.623375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.624017:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746627328 00000100:00100000:2.0:1746144659.624028:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746627328 00000100:00100000:2.0:1746144659.626216:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4064 00000100:00100000:2.0:1746144659.626238:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29071:x1830964746627328:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144659.626587:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29071:x1830964746627328:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 355us (3219us total) trans 8589943958 rc 0/0 00000100:00100000:2.0:1746144659.626595:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4064 00000100:00100000:0.0:1746144659.628127:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746627072:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12800us (13138us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144659.628175:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4444 00002000:00100000:0.0:1746144659.628186:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880093761f80 x1830964746627072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.628197:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761f80 with x1830964746627072 ext(1048576->2097151) 00002000:00010000:0.0:1746144659.628204:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093761f80 00000100:00100000:0.0:1746144659.639089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.639190:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746627584 00000100:00100000:2.0:1746144659.639205:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746627584 00002000:00100000:2.0:1746144659.639266:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130928e00 x1830964746627584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.639276:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928e00 with x1830964746627584 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.639283:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928e00 00000100:00100000:2.0:1746144659.639331:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4446 00000100:00100000:2.0:1746144659.639341:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746627584:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.642285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.642321:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.642351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.642378:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746628480 00000100:00100000:0.0:1746144659.642378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.642387:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746628480 00000100:00100000:0.0:1746144659.642401:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746627840 00000100:00100000:0.0:1746144659.642404:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746627840 00002000:00100000:1.0:1746144659.642430:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880130929880 x1830964746628480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 504/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.642430:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f16a300 x1830964746627840/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.642439:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929880 with x1830964746628480 ext(3145728->4194303) 00002000:00100000:0.0:1746144659.642439:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a300 with x1830964746627840 ext(2097152->3145727) 00002000:00010000:1.0:1746144659.642444:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130929880 00002000:00010000:0.0:1746144659.642444:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16a300 00000100:00100000:0.0:1746144659.642457:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746627968 00000100:00100000:0.0:1746144659.642459:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746627968 00002000:00100000:0.0:1746144659.642468:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f168a80 x1830964746627968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.642474:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168a80 with x1830964746627968 ext(3145728->4194303) 00002000:00010000:0.0:1746144659.642477:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f168a80 00000100:00100000:1.0:1746144659.642515:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746628352 00000100:00100000:1.0:1746144659.642517:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746628352 00002000:00100000:1.0:1746144659.642531:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f168000 x1830964746628352/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.642538:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168000 with x1830964746628352 ext(2097152->3145727) 00002000:00010000:1.0:1746144659.642541:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168000 00000100:00100000:1.0:1746144659.642562:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4447 00000100:00100000:1.0:1746144659.642568:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746627840:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.643885:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4448 00000100:00100000:2.0:1746144659.643897:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746628480:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144659.644199:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4449 00000100:00100000:1.0:1746144659.644207:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746627968:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.644566:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4450 00000100:00100000:2.0:1746144659.644574:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746628352:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.652403:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746627584:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13050us (15663us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.652417:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4446 00002000:00100000:2.0:1746144659.652431:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130928e00 x1830964746627584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.652442:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928e00 with x1830964746627584 ext(1048576->2097151) 00002000:00010000:2.0:1746144659.652448:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928e00 00000100:00100000:1.0:1746144659.654463:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746627840:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11884us (12129us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144659.654476:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4447 00002000:00100000:1.0:1746144659.654488:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f16a300 x1830964746627840/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.654502:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a300 with x1830964746627840 ext(2097152->3145727) 00002000:00010000:1.0:1746144659.654508:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16a300 00000100:00100000:2.0:1746144659.659524:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746628480:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15617us (17234us total) trans 0 rc 495616/495616 00000100:00100000:2.0:1746144659.659537:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4448 00002000:00100000:2.0:1746144659.659550:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880130929880 x1830964746628480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 504/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 495616/495616 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.659560:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929880 with x1830964746628480 ext(3145728->4194303) 00002000:00010000:2.0:1746144659.659566:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130929880 00000100:00100000:2.0:1746144659.661460:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746628352:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16876us (19071us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144659.661472:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4450 00002000:00100000:2.0:1746144659.661481:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f168000 x1830964746628352/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.661490:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168000 with x1830964746628352 ext(2097152->3145727) 00002000:00010000:2.0:1746144659.661495:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168000 00000100:00100000:1.0:1746144659.662361:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746627968:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18153us (20006us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144659.662368:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4449 00002000:00100000:1.0:1746144659.662373:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f168a80 x1830964746627968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.662381:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168a80 with x1830964746627968 ext(3145728->4194303) 00002000:00010000:1.0:1746144659.662384:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f168a80 00000100:00100000:0.0:1746144659.663445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.663650:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746628736 00000100:00100000:2.0:1746144659.663660:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746628736 00000100:00100000:2.0:1746144659.663716:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11724 00000100:00100000:2.0:1746144659.663724:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746628736:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.663744:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144659.663778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.663810:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746628864 00000100:00100000:3.0:1746144659.663814:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746628864 00000100:00100000:3.0:1746144659.663862:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11725 00000100:00100000:3.0:1746144659.663870:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+29:29077:x1830964746628864:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144659.663876:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.663888:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb82 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.663921:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.663922:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a0ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb7b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.663930:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.663937:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.663938:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.663941:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.663959:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144659.663965:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747474432:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.663975:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 33 pid: 8451 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.663982:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747474304:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.664053:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 31 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.664061:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 31 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.664069:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747474560:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.664194:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.664239:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.667437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.667446:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747474304:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144659.667487:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746628992 00000100:00100000:3.0:1746144659.667492:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746628992 00002000:00010000:2.0:1746144659.667528:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144659 -> 1746144660 00002000:00010000:2.0:1746144659.667531:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144659 -> 1746144660 00002000:00010000:2.0:1746144659.667533:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144659 -> 1746144660 00010000:00010000:3.0:1746144659.667537:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 34 pid: 8451 timeout: 738 lvb_type: 1 00000100:00100000:2.0:1746144659.667553:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747474432:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.667563:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5834 00000100:00100000:3.0:1746144659.667570:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746628992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.667582:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144659.667582:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a0ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb7b expref: 31 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.667591:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a0ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb7b expref: 31 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.667592:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 34 pid: 8451 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.667605:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 34 pid: 8451 timeout: 738 lvb_type: 1 00010000:00010000:2.0:1746144659.667606:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4e00, rc 0) 00010000:00010000:3.0:1746144659.667621:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e864400/0xa7c849b16e01a0bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb58 expref: 34 pid: 8451 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.667650:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.667918:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746628992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 347us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.667918:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+30:1962:x1830964746628736:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4194us (4476us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.667925:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5834 00000100:00100000:2.0:1746144659.667925:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11724 00000100:00100000:3.0:1746144659.667982:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747474560:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144659.668003:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 29 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.668011:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70aa00, rc 0) 00000100:00100000:3.0:1746144659.668026:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+29:29077:x1830964746628864:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4159us (4248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.668031:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11725 00000100:00100000:0.0:1746144659.668066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.668079:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746629120 00000100:00100000:3.0:1746144659.668082:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746629120 00000100:00100000:3.0:1746144659.668119:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11726 00000100:00100000:3.0:1746144659.668126:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746629120:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144659.668171:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.668182:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a0f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb89 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.668195:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.668203:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a0f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb89 expref: 34 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.668210:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a0f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb89 expref: 34 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.668217:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70be00, rc 0) 00000100:00100000:3.0:1746144659.668237:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746629120:12345-192.168.204.23@tcp:101:cat.0 Request processed in 113us (171us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.668242:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11726 00000100:00100000:0.0:1746144659.669801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.669852:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746629248 00000100:00100000:3.0:1746144659.669859:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746629248 00010000:00010000:3.0:1746144659.669891:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 29 pid: 8389 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.669924:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5835 00000100:00100000:3.0:1746144659.669932:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746629248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.669944:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.669963:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 29 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.669973:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 29 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.669994:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e864a00/0xa7c849b16e01a038 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb04 expref: 29 pid: 8389 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.670004:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.670006:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.670012:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 28 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.670021:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 28 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.670054:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 28 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.670066:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747474688:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144659.670387:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.672674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.672729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.672824:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746629632 00000100:00100000:1.0:1746144659.672833:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746629632 00002000:00100000:1.0:1746144659.672883:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800920ad500 x1830964746629632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.672892:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad500 with x1830964746629632 ext(4194304->4935679) 00002000:00010000:1.0:1746144659.672897:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ad500 00000100:00100000:1.0:1746144659.672928:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746629760 00000100:00100000:1.0:1746144659.672931:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746629760 00002000:00100000:1.0:1746144659.672943:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800920ace00 x1830964746629760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.672950:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ace00 with x1830964746629760 ext(2097152->3145727) 00002000:00010000:1.0:1746144659.672953:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ace00 00000100:00100000:3.0:1746144659.672961:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4451 00000100:00100000:1.0:1746144659.672965:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4452 00000100:00100000:1.0:1746144659.672970:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746629760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.672979:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746629632:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144659.677735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.677958:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747474688:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144659.677995:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.678120:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630016 00000100:00100000:1.0:1746144659.678128:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630016 00002000:00100000:1.0:1746144659.678188:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1654784->1658879) req@ffff88009f0c2d80 x1830964746630016/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.678198:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c2d80 with x1830964746630016 ext(1654784->1658879) 00002000:00010000:1.0:1746144659.678203:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c2d80 00000100:00100000:1.0:1746144659.678233:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4453 00000100:00100000:1.0:1746144659.678240:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746630016:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.679633:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746629248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9695us (9828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.679633:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746630016:12345-192.168.204.23@tcp:3:cat.0 Request processed in 1392us (1909us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144659.679642:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5835 00000100:00100000:1.0:1746144659.679642:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4453 00002000:00100000:1.0:1746144659.679649:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1654784->1658879) req@ffff88009f0c2d80 x1830964746630016/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.679656:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c2d80 with x1830964746630016 ext(1654784->1658879) 00002000:00010000:1.0:1746144659.679659:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c2d80 00000100:00100000:1.0:1746144659.682428:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746629760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9444us (9686us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144659.682441:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4452 00002000:00100000:1.0:1746144659.682454:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800920ace00 x1830964746629760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144659.682462:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ace00 with x1830964746629760 ext(2097152->3145727) 00002000:00010000:1.0:1746144659.682468:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ace00 00000100:00100000:0.0:1746144659.688690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.688755:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630144 00000100:00100000:2.0:1746144659.688767:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630144 00000100:00100000:2.0:1746144659.688827:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11727 00000100:00100000:2.0:1746144659.688837:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+28:29075:x1830964746630144:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144659.690445:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746629632:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17472us (17776us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144659.690458:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4451 00002000:00100000:3.0:1746144659.690470:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800920ad500 x1830964746629632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.690478:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad500 with x1830964746629632 ext(4194304->4935679) 00002000:00010000:3.0:1746144659.690483:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ad500 00010000:00010000:2.0:1746144659.690563:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.690584:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb90 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.690617:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 32 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.690624:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.690626:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.690629:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.690658:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 32 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.690668:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 32 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:2.0:1746144659.690679:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747474816:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.690761:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.690927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.691150:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630272 00000100:00100000:1.0:1746144659.691160:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630272 00000100:00100000:1.0:1746144659.691201:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11728 00000100:00100000:1.0:1746144659.691208:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:29077:x1830964746630272:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144659.691217:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.691228:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb97 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.691246:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.691254:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 34 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.691259:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.691260:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.691262:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.691276:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 34 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.691282:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 34 pid: 22208 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746144659.691289:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747474944:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.691340:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.691352:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 738 lvb_type: 1 00000100:00100000:1.0:1746144659.691360:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747475072:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.691380:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.693093:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747474816:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.693130:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.693168:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a000, rc 0) 00000100:00100000:1.0:1746144659.694376:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747474944:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.694566:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:29075:x1830964746630144:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5729us (5884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.694576:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11727 00000100:00100000:0.0:1746144659.695768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.695806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.695830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.695980:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630528 00000100:00100000:1.0:1746144659.695988:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630528 00000100:00100000:1.0:1746144659.696019:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630656 00000100:00100000:1.0:1746144659.696021:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630656 00000100:00100000:2.0:1746144659.696025:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11729 00000100:00100000:2.0:1746144659.696043:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746630528:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144659.696044:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11730 00000100:00100000:1.0:1746144659.696050:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746630656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.696062:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.696062:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.696079:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a600/0xa7c849b16e01a111 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eb9e expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.696079:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eecee00/0xa7c849b16e01a10a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eba5 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144659.696160:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747475200:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.696175:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747475328:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144659.696234:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630400 00000100:00100000:3.0:1746144659.696238:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630400 00002000:00100000:3.0:1746144659.696283:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3207168->3760127) req@ffff88009f0c3800 x1830964746630400/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.696292:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c3800 with x1830964746630400 ext(3207168->3760127) 00010000:00010000:3.0:1746144659.696298:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 37 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.696314:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 37 pid: 7257 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.696321:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f0c3800 00000100:00100000:3.0:1746144659.696337:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 866 00000100:00100000:3.0:1746144659.696343:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746630400:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144659.696553:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.696553:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.696586:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747475072:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.696610:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.696622:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecf600, rc 0) 00000100:00100000:1.0:1746144659.696642:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:29077:x1830964746630272:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5434us (5716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.696649:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11728 00000100:00100000:0.0:1746144659.697802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.697869:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630784 00000100:00100000:3.0:1746144659.697875:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630784 00010000:00010000:3.0:1746144659.697902:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 35 pid: 22208 timeout: 738 lvb_type: 1 00000100:00100000:3.0:1746144659.697923:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5836 00000100:00100000:3.0:1746144659.697931:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746630784:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.697943:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.697964:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 35 pid: 22208 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.697976:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 35 pid: 22208 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.697996:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70b400/0xa7c849b16e01a0c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb5f expref: 35 pid: 22208 timeout: 738 lvb_type: 1 00010000:00010000:3.0:1746144659.698024:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.698047:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746630784:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 117us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.698053:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5836 00000100:00100000:0.0:1746144659.698222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.698238:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746630912 00000100:00100000:0.0:1746144659.698242:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746630912 00010000:00010000:0.0:1746144659.698256:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 738 lvb_type: 1 00000100:00100000:0.0:1746144659.698270:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5837 00000100:00100000:0.0:1746144659.698275:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746630912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144659.698282:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144659.698809:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.698820:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.698833:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3b000/0xa7c849b16e01a02a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb0b expref: 21 pid: 7257 timeout: 738 lvb_type: 1 00010000:00010000:0.0:1746144659.698857:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.698859:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144659.698867:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.698875:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.699057:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.699068:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747475456:192.168.204.23@tcp:105: 00002000:00010000:3.0:1746144659.699249:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144659 -> 1746144660 00000100:00100000:3.0:1746144659.699265:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747475200:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144659.699289:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a600/0xa7c849b16e01a111 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb9e expref: 38 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.699299:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a600/0xa7c849b16e01a111 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb9e expref: 38 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144659.699307:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a600, rc 0) 00000100:00100000:3.0:1746144659.699329:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746630528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3296us (3564us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144659.699340:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11729 00000100:00100000:0.0:1746144659.699704:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.699897:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747475328:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.699916:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eecee00/0xa7c849b16e01a10a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eba5 expref: 36 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.699925:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eecee00/0xa7c849b16e01a10a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eba5 expref: 36 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.699937:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecee00, rc 0) 00000100:00100000:1.0:1746144659.700132:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746630656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3908us (4126us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.700161:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11730 00000100:00100000:0.0:1746144659.702902:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747475456:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144659.702925:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144659.702961:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746630912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4685us (4738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144659.702971:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5837 00000100:00100000:0.0:1746144659.704359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.704393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.704420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.704469:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746631040 00000100:00100000:1.0:1746144659.704478:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746631040 00000100:00100000:1.0:1746144659.704511:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746631168 00000100:00100000:1.0:1746144659.704513:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746631168 00000100:00100000:1.0:1746144659.704524:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746631296 00000100:00100000:1.0:1746144659.704526:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746631296 00000100:00100000:0.0:1746144659.704535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.704539:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11731 00000100:00100000:1.0:1746144659.704545:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746631040:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.704564:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.704581:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eecfe00/0xa7c849b16e01a118 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebac expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.704631:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747475584:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.704679:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11732 00000100:00100000:1.0:1746144659.704683:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.704685:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746631168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144659.704693:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144659.704699:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11733 00010000:00010000:0.0:1746144659.704703:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4000/0xa7c849b16e01a11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebb3 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.704704:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746631296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.704709:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.704715:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eecfc00/0xa7c849b16e01a126 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebba expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.704727:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747475712:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144659.704731:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747475840:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144659.704747:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.705212:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.705440:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746630400:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9095us (9630us total) trans 21474840497 rc 0/0 00000100:00100000:3.0:1746144659.705450:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 866 00002000:00100000:3.0:1746144659.705460:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3207168->3760127) req@ffff88009f0c3800 x1830964746630400/t21474840497(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.705470:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c3800 with x1830964746630400 ext(3207168->3760127) 00010000:00010000:3.0:1746144659.705476:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 39 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:3.0:1746144659.705488:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 39 pid: 7257 timeout: 738 lvb_type: 0 00002000:00010000:3.0:1746144659.705494:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f0c3800 00000100:00100000:3.0:1746144659.705508:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746631552 00000100:00100000:3.0:1746144659.705511:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746631552 00002000:00100000:3.0:1746144659.705532:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1261568->1265663) req@ffff88009f0c2680 x1830964746631552/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.705538:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c2680 with x1830964746631552 ext(1261568->1265663) 00002000:00010000:3.0:1746144659.705541:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0c2680 00000100:00100000:3.0:1746144659.705565:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4454 00000100:00100000:3.0:1746144659.705572:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746631552:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.706028:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746631552:12345-192.168.204.23@tcp:3:cat.0 Request processed in 113us (1148us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144659.706040:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4454 00002000:00100000:3.0:1746144659.706045:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1261568->1265663) req@ffff88009f0c2680 x1830964746631552/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.706053:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c2680 with x1830964746631552 ext(1261568->1265663) 00002000:00010000:3.0:1746144659.706056:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0c2680 00000100:00100000:1.0:1746144659.706525:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747475584:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.706549:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eecfe00/0xa7c849b16e01a118 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebac expref: 38 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.706559:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eecfe00/0xa7c849b16e01a118 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebac expref: 38 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.706581:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecfe00, rc 0) 00000100:00100000:1.0:1746144659.706608:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746631040:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2062us (2253us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.706614:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11731 00000100:00100000:1.0:1746144659.706645:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747475840:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.706659:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eecfc00/0xa7c849b16e01a126 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebba expref: 36 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.706667:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eecfc00/0xa7c849b16e01a126 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebba expref: 36 pid: 29370 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746144659.706709:0:10724:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746144654 -> 1746144660 00000100:00100000:2.0:1746144659.706719:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747475712:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.706734:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4000/0xa7c849b16e01a11f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebb3 expref: 35 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.706741:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4000/0xa7c849b16e01a11f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebb3 expref: 35 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.706751:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4000, rc 0) 00000100:00100000:2.0:1746144659.706772:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746631168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2087us (2379us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.706777:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11732 00010000:00010000:1.0:1746144659.706864:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eecfc00, rc 0) 00000100:00100000:1.0:1746144659.706881:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746631296:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2176us (2460us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144659.706886:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11733 00010000:00010000:0.0:1746144659.707597:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144659.709804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.709862:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746631808 00000100:00100000:2.0:1746144659.709872:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746631808 00000100:00100000:0.0:1746144659.709890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.711044:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4065 00000100:00100000:0.0:1746144659.711055:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29077:x1830964746631808:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144659.711083:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746631936 00000100:00100000:1.0:1746144659.711089:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746631936 00010000:00010000:1.0:1746144659.711124:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 35 pid: 7257 timeout: 738 lvb_type: 0 00000100:00100000:1.0:1746144659.711176:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5838 00000100:00100000:1.0:1746144659.711182:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746631936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.711193:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.711213:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 35 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.711226:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 35 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.711248:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a0d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3760127) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb74 expref: 35 pid: 7257 timeout: 738 lvb_type: 0 00010000:00010000:1.0:1746144659.711260:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.711262:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.711270:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.711282:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144659.711309:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:29077:x1830964746631808:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 257us (1511us total) trans 8589943959 rc 0/0 00010000:00010000:1.0:1746144659.711314:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.711332:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747475968:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.711387:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144659.711745:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4065 00000100:00100000:1.0:1746144659.714186:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747475968:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.714207:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.714257:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746631936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3074us (4365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.714267:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5838 00000100:00100000:0.0:1746144659.724277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.727204:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746632192 00000100:00100000:3.0:1746144659.727220:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746632192 00002000:00100000:3.0:1746144659.727296:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f0c3b80 x1830964746632192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.727307:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c3b80 with x1830964746632192 ext(2097152->3145727) 00002000:00010000:3.0:1746144659.727313:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c3b80 00000100:00100000:3.0:1746144659.727353:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4455 00000100:00100000:3.0:1746144659.727364:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746632192:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.728899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.729975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.730014:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746632448 00000100:00100000:2.0:1746144659.730021:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746632448 00002000:00100000:2.0:1746144659.730060:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092937800 x1830964746632448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.730070:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092937800 with x1830964746632448 ext(3145728->4194303) 00002000:00010000:2.0:1746144659.730075:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092937800 00000100:00100000:2.0:1746144659.730091:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746632704 00000100:00100000:2.0:1746144659.730093:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746632704 00002000:00100000:2.0:1746144659.730120:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092935500 x1830964746632704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.730128:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935500 with x1830964746632704 ext(3145728->4194303) 00002000:00010000:2.0:1746144659.730131:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935500 00000100:00100000:2.0:1746144659.730164:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4456 00000100:00100000:2.0:1746144659.730174:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746632448:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.731507:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4457 00000100:00100000:2.0:1746144659.731515:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746632704:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.746270:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746632192:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18897us (21993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.746282:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4455 00002000:00100000:3.0:1746144659.746296:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f0c3b80 x1830964746632192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.746307:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0c3b80 with x1830964746632192 ext(2097152->3145727) 00002000:00010000:3.0:1746144659.746313:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0c3b80 00000100:00100000:3.0:1746144659.750698:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746632448:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20514us (21795us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.750710:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4456 00002000:00100000:3.0:1746144659.750723:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092937800 x1830964746632448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.750733:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092937800 with x1830964746632448 ext(3145728->4194303) 00002000:00010000:3.0:1746144659.750739:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092937800 00000100:00100000:3.0:1746144659.753168:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746632704:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21647us (23188us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144659.753178:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4457 00002000:00100000:3.0:1746144659.753186:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092935500 x1830964746632704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.753195:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935500 with x1830964746632704 ext(3145728->4194303) 00002000:00010000:3.0:1746144659.753200:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935500 00000100:00100000:0.0:1746144659.754925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.755101:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746632960 00000100:00100000:3.0:1746144659.755119:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746632960 00000100:00100000:3.0:1746144659.755285:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10078 00000100:00100000:3.0:1746144659.755296:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29085:x1830964746632960:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144659.755321:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.755340:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a800/0xa7c849b16e01a12d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebc1 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.755452:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755464:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755475:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755493:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755498:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755503:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755608:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a142 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755616:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.755622:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144659.755632:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.756999:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757010:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757016:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757021:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70a200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.757025:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757031:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757044:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144659.757047:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.757051:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757056:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757261:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757265:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757270:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757274:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70ba00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.757276:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757281:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757287:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136942600) 00010000:00010000:3.0:1746144659.757289:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.757291:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757295:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ba00/0xa7c849b16e01a13b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.757347:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a800/0xa7c849b16e01a12d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc1 expref: 304 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.757360:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a142 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc1 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.757367:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.757369:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144659.757371:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70b400, rc 0) 00000100:00100000:3.0:1746144659.757883:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29085:x1830964746632960:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2587us (2962us total) trans 8589943960 rc 0/0 00000100:00100000:3.0:1746144659.757892:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10078 00000100:00100000:0.0:1746144659.762235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.762457:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746633088 00000100:00100000:1.0:1746144659.762467:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746633088 00000100:00100000:1.0:1746144659.762536:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 631 00000100:00100000:1.0:1746144659.762544:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1960:x1830964746633088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.762557:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.762583:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a142 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc1 expref: 303 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.762616:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144659.762620:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.762670:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1960:x1830964746633088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 125us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.762678:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 631 00000100:00100000:0.0:1746144659.762753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.762800:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746633344 00000100:00100000:2.0:1746144659.762804:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746633344 00002000:00100000:2.0:1746144659.762839:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f4700 x1830964746633344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.762849:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4700 with x1830964746633344 ext(4194304->4935679) 00002000:00010000:2.0:1746144659.762853:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f4700 00000100:00100000:2.0:1746144659.762883:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4458 00000100:00100000:2.0:1746144659.762889:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746633344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144659.771591:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746633344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8686us (8822us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144659.771606:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4458 00002000:00100000:2.0:1746144659.771621:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f4700 x1830964746633344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.771632:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4700 with x1830964746633344 ext(4194304->4935679) 00002000:00010000:2.0:1746144659.771638:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f4700 00000100:00100000:0.0:1746144659.777349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.777734:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746633600 00000100:00100000:2.0:1746144659.777745:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746633600 00000100:00100000:2.0:1746144659.777795:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4066 00000100:00100000:2.0:1746144659.777803:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:29075:x1830964746633600:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144659.778051:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+10:29075:x1830964746633600:12345-192.168.204.23@tcp:35:cat.0 Request processed in 248us (712us total) trans 8589943961 rc 0/0 00000100:00100000:2.0:1746144659.778058:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4066 00000100:00100000:0.0:1746144659.865673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.865812:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746633728 00000100:00100000:1.0:1746144659.865823:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746633728 00000100:00100000:1.0:1746144659.865884:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11734 00000100:00100000:1.0:1746144659.865892:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:29085:x1830964746633728:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144659.865914:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.865934:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebc8 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.865967:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.865975:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144659.865977:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144659.865980:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1671168->2097151] (req 1671168->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.866011:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.866023:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 19 pid: 8388 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746144659.866035:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747476096:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.866187:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.869014:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747476096:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.869049:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1671168->2097151] (req 1671168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.869067:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864a00, rc 0) 00000100:00100000:1.0:1746144659.869122:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29085:x1830964746633728:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3230us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.869130:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11734 00000100:00100000:0.0:1746144659.870195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.870254:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746633856 00000100:00100000:2.0:1746144659.870261:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746633856 00002000:00100000:2.0:1746144659.870303:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1265663) req@ffff88012b5f4e00 x1830964746633856/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.870312:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4e00 with x1830964746633856 ext(1048576->1265663) 00010000:00010000:2.0:1746144659.870331:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 20 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144659.870345:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 20 pid: 8388 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746144659.870355:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f4e00 00000100:00100000:2.0:1746144659.870383:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 867 00000100:00100000:2.0:1746144659.870390:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746633856:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144659.874950:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746633856:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4548us (4744us total) trans 17179873250 rc 0/0 00000100:00100000:2.0:1746144659.874963:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 867 00002000:00100000:2.0:1746144659.874975:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1265663) req@ffff88012b5f4e00 x1830964746633856/t17179873250(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.874985:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4e00 with x1830964746633856 ext(1048576->1265663) 00010000:00010000:2.0:1746144659.874995:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 22 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144659.875009:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 22 pid: 8388 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746144659.875016:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f4e00 00000100:00100000:0.0:1746144659.877755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.877856:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746633984 00000100:00100000:3.0:1746144659.877866:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746633984 00010000:00010000:3.0:1746144659.877918:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 22 pid: 8388 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144659.877959:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5839 00000100:00100000:3.0:1746144659.877967:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746633984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144659.877981:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144659.878006:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 22 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144659.878018:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 22 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144659.878043:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eecf600/0xa7c849b16e01a103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb97 expref: 22 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144659.878071:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.878074:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144659.878081:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.878090:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.878132:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144659.878179:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747476224:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144659.878272:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144659.880234:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747476224:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144659.880265:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144659.880299:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746633984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2333us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144659.880308:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5839 00000100:00100000:2.0:1746144659.880634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.880891:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746634240 00000100:00100000:0.0:1746144659.880897:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746634240 00002000:00100000:0.0:1746144659.880941:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1671168->1675263) req@ffff880092935880 x1830964746634240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.880950:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935880 with x1830964746634240 ext(1671168->1675263) 00002000:00010000:0.0:1746144659.880955:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935880 00000100:00100000:0.0:1746144659.880980:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4459 00000100:00100000:0.0:1746144659.880987:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746634240:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144659.882271:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746634240:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1280us (1635us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144659.882278:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4459 00002000:00100000:0.0:1746144659.882285:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1671168->1675263) req@ffff880092935880 x1830964746634240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144659.882293:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935880 with x1830964746634240 ext(1671168->1675263) 00002000:00010000:0.0:1746144659.882297:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935880 00000100:00100000:0.0:1746144659.887656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.888787:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746634368 00000100:00100000:1.0:1746144659.888799:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746634368 00000100:00100000:1.0:1746144659.888855:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11735 00000100:00100000:1.0:1746144659.888863:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29085:x1830964746634368:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144659.888888:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.888957:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebcf expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.888990:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.888999:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.889005:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.889007:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.889010:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2580479] (req 2097152->2580479) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 36 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.889042:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.889054:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746144659.889065:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747476352:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.889578:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.889587:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 20 pid: 7257 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746144659.889594:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747476480:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.889614:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.893977:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747476352:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144659.893991:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747476480:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144659.894022:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->2580479] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 36 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.894821:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864e00, rc 0) 00000100:00100000:1.0:1746144659.894883:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29085:x1830964746634368:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6018us (7235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.894892:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11735 00000100:00100000:0.0:1746144659.897224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.897273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.897324:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746634496 00000100:00100000:1.0:1746144659.897333:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746634496 00010000:00010000:1.0:1746144659.897371:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 21 pid: 7257 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746144659.897401:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746634624 00000100:00100000:1.0:1746144659.897404:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746634624 00010000:00010000:1.0:1746144659.897413:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144659.897422:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5840 00000100:00100000:0.0:1746144659.897430:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746634496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144659.897444:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144659.897467:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 21 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144659.897479:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 21 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144659.897499:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a03f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb12 expref: 21 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144659.897525:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144659.897554:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746634496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.897819:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5841 00000100:00100000:1.0:1746144659.897827:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746634624:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.897835:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144659.897836:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5840 00010000:00010000:1.0:1746144659.897845:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746144659.897854:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746144659.897866:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5800/0xa7c849b16e01a0cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb66 expref: 36 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:1.0:1746144659.897914:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.897916:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.897923:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.897931:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.897968:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.897981:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747476608:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.898049:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.899256:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747476608:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.899271:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.899389:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746634624:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1559us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.899397:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5841 00000100:00100000:0.0:1746144659.902865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.902973:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746634880 00000100:00100000:2.0:1746144659.902984:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746634880 00002000:00100000:2.0:1746144659.903033:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2576384->2580479) req@ffff8800a4b62680 x1830964746634880/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.903043:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62680 with x1830964746634880 ext(2576384->2580479) 00002000:00010000:2.0:1746144659.903048:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62680 00000100:00100000:2.0:1746144659.903070:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4460 00000100:00100000:2.0:1746144659.903077:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746634880:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144659.903341:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746634880:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 263us (681us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144659.903347:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4460 00002000:00100000:2.0:1746144659.903353:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2576384->2580479) req@ffff8800a4b62680 x1830964746634880/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/4536 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.903360:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62680 with x1830964746634880 ext(2576384->2580479) 00002000:00010000:2.0:1746144659.903363:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62680 00000100:00100000:0.0:1746144659.905527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.906332:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746635136 00000100:00100000:2.0:1746144659.906345:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746635136 00000100:00100000:2.0:1746144659.906922:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4067 00000100:00100000:2.0:1746144659.906931:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29085:x1830964746635136:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144659.907787:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29085:x1830964746635136:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 855us (2269us total) trans 8589943962 rc 0/0 00000100:00100000:2.0:1746144659.907795:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4067 00000100:00100000:0.0:1746144659.937130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.938969:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746635392 00000100:00100000:3.0:1746144659.938981:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746635392 00000100:00100000:3.0:1746144659.939065:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10079 00000100:00100000:3.0:1746144659.939076:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:29091:x1830964746635392:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144659.939113:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144659.939132:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b600/0xa7c849b16e01a15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebd6 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.939954:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.939968:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.939981:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.939994:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.939999:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940004:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940115:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940123:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940128:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144659.940158:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144659.940251:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940258:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940267:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940273:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70be00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.940276:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940282:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940293:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144659.940296:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.940301:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.940305:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70be00/0xa7c849b16e01a165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941291:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941299:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941305:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941310:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70ac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144659.941312:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941317:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941329:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136942000) 00010000:00010000:3.0:1746144659.941332:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144659.941334:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941338:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70ac00/0xa7c849b16e01a16c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144659.941393:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b600/0xa7c849b16e01a15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 13 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.941405:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 12 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144659.941411:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144659.941413:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144659.941415:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a400, rc 0) 00000100:00100000:3.0:1746144659.941977:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:29091:x1830964746635392:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2901us (4855us total) trans 8589943963 rc 0/0 00000100:00100000:3.0:1746144659.941986:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10079 00000100:00100000:0.0:1746144659.944131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.944634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.945329:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746635520 00000100:00100000:1.0:1746144659.945339:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746635520 00000100:00100000:2.0:1746144659.945348:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746635648 00000100:00100000:2.0:1746144659.945352:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746635648 00000100:00100000:1.0:1746144659.945400:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11736 00000100:00100000:0.0:1746144659.945405:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11737 00000100:00100000:1.0:1746144659.945407:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746635648:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144659.945409:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746635520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144659.945437:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144659.945437:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144659.945453:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebe4 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144659.945453:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a188 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebdd expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.945476:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.945478:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.945485:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 37 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144659.945501:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 37 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144659.945506:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747476736:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144659.945515:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e865000, rc 0) 00000100:00100000:1.0:1746144659.945555:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746635648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 149us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.945560:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11736 00000100:00100000:0.0:1746144659.945583:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.947926:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747476736:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144659.947959:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a188 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebdd expref: 36 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.947973:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a188 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebdd expref: 36 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144659.948033:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4c00, rc 0) 00000100:00100000:2.0:1746144659.948617:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746635520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3204us (4491us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144659.948625:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11737 00000100:00100000:0.0:1746144659.955581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.956027:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746635776 00000100:00100000:2.0:1746144659.956038:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746635776 00000100:00100000:2.0:1746144659.956108:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11738 00000100:00100000:2.0:1746144659.956118:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29092:x1830964746635776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144659.956170:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144659.956190:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebeb expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.956225:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 28 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.956232:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.956234:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144659.956237:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.956266:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 28 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.956277:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 28 pid: 8388 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144659.956293:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747476864:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144659.957043:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144659.963294:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747476864:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144659.963324:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144659.963340:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a600, rc 0) 00000100:00100000:2.0:1746144659.963394:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29092:x1830964746635776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7276us (7823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144659.963402:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11738 00000100:00100000:0.0:1746144659.964507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144659.964613:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746635904 00000100:00100000:2.0:1746144659.964619:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746635904 00002000:00100000:2.0:1746144659.964646:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1654784->2097151) req@ffff8800a4b61500 x1830964746635904/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144659.964653:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b61500 with x1830964746635904 ext(1654784->2097151) 00010000:00010000:2.0:1746144659.964657:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 29 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144659.964666:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 29 pid: 8388 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746144659.964669:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4b61500 00000100:00100000:2.0:1746144659.964689:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 868 00000100:00100000:2.0:1746144659.964695:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746635904:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144659.972554:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746635904:12345-192.168.204.23@tcp:4:cat.0 Request processed in 7849us (8039us total) trans 21474840498 rc 0/0 00000100:00100000:3.0:1746144659.972565:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 868 00002000:00100000:3.0:1746144659.972575:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1654784->2097151) req@ffff8800a4b61500 x1830964746635904/t21474840498(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:300/0 lens 488/448 e 0 to 0 dl 1746144670 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.972583:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b61500 with x1830964746635904 ext(1654784->2097151) 00010000:00010000:3.0:1746144659.972592:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144659.972605:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144659.972611:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4b61500 00000100:00100000:0.0:1746144659.976374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144659.977230:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746636032 00000100:00100000:1.0:1746144659.977242:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746636032 00010000:00010000:1.0:1746144659.977291:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746144659.977337:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5842 00000100:00100000:1.0:1746144659.977344:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746636032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144659.977357:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144659.977376:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144659.977388:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144659.977407:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a0e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb82 expref: 31 pid: 8388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144659.977435:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.977437:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144659.977447:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.977460:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144659.977495:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144659.977506:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747476992:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144659.977590:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144659.990107:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747476992:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144659.990132:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144659.990209:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746636032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 12864us (13842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144659.990219:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5842 00000100:00100000:0.0:1746144659.993888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144659.993952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144659.994179:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746636288 00000100:00100000:3.0:1746144659.994190:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746636288 00002000:00100000:3.0:1746144659.994245:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a4b62a00 x1830964746636288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144659.994255:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62a00 with x1830964746636288 ext(1048576->2097151) 00002000:00010000:3.0:1746144659.994260:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4b62a00 00000100:00100000:3.0:1746144659.994286:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746636544 00000100:00100000:3.0:1746144659.994288:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746636544 00002000:00100000:3.0:1746144659.994304:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1671167) req@ffff8800a4b62d80 x1830964746636544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/0 e 0 to 0 dl 1746144670 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746144659.994307:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4461 00002000:00100000:3.0:1746144659.994310:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62d80 with x1830964746636544 ext(1048576->1671167) 00002000:00010000:3.0:1746144659.994313:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62d80 00000100:00100000:2.0:1746144659.994317:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746636288:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144659.994322:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4462 00000100:00100000:3.0:1746144659.994327:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746636544:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.011399:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746636288:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17077us (17512us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144660.011409:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4461 00002000:00100000:2.0:1746144660.011419:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff8800a4b62a00 x1830964746636288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.011428:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62a00 with x1830964746636288 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.011434:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4b62a00 00000100:00100000:3.0:1746144660.012563:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746636544:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18232us (18606us total) trans 0 rc 622592/622592 00000100:00100000:3.0:1746144660.012572:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4462 00002000:00100000:3.0:1746144660.012578:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1671167) req@ffff8800a4b62d80 x1830964746636544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:300/0 lens 488/440 e 0 to 0 dl 1746144670 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.012591:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62d80 with x1830964746636544 ext(1048576->1671167) 00002000:00010000:3.0:1746144660.012595:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62d80 00000100:00100000:0.0:1746144660.013888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.014108:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746636800 00000100:00100000:3.0:1746144660.014116:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746636800 00000100:00100000:3.0:1746144660.015404:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10080 00000100:00100000:3.0:1746144660.015424:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:29095:x1830964746636800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.015442:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.015459:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebf2 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.015534:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.015546:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.015556:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144660.015564:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144660.015650:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.015669:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.015676:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.015678:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746144660.015682:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bbc00, rc 0) 00000100:00080000:0.0:1746144660.015788:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144660.016669:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:29095:x1830964746636800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1256us (2783us total) trans 8589943964 rc 0/0 00000100:00100000:3.0:1746144660.016676:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10080 00000100:00100000:0.0:1746144660.020945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.020969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.020989:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746636928 00000100:00100000:0.0:1746144660.020995:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746636928 00000100:00100000:0.0:1746144660.021031:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746637056 00000100:00100000:0.0:1746144660.021033:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746637056 00000100:00100000:0.0:1746144660.021046:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11739 00000100:00100000:0.0:1746144660.021053:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746636928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144660.021068:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.021083:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ebf9 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.021113:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.021115:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.021123:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 31 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.021154:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 31 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.021163:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5c00, rc 0) 00000100:00100000:0.0:1746144660.021199:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746636928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 146us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.021205:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11739 00000100:00100000:0.0:1746144660.021220:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11740 00000100:00100000:0.0:1746144660.021224:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746637056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144660.021230:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.021238:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5600/0xa7c849b16e01a1b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec00 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.021283:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f300000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747477120:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144660.021344:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34180 going to sleep for 11 seconds 00000100:00080000:0.0:1746144660.021358:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746144660.021360:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144660.021382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.021613:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746637184 00000100:00100000:1.0:1746144660.021616:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746637184 00000100:00100000:1.0:1746144660.021635:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11741 00000100:00100000:1.0:1746144660.021640:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746637184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.021645:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.021651:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e865400/0xa7c849b16e01a1b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec07 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.021671:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747477248:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144660.021689:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.036517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.036555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.036808:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.036837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.036852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.036904:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746637568 00000100:00100000:3.0:1746144660.036912:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746637568 00002000:00100000:3.0:1746144660.036976:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2580480->3629055) req@ffff88009f300700 x1830964746637568/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.036986:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300700 with x1830964746637568 ext(2580480->3629055) 00002000:00010000:3.0:1746144660.036991:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f300700 00000100:00100000:3.0:1746144660.037006:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746637696 00000100:00100000:3.0:1746144660.037009:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746637696 00002000:00100000:3.0:1746144660.037021:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3629056->4194303) req@ffff88009f300a80 x1830964746637696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.037027:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300a80 with x1830964746637696 ext(3629056->4194303) 00002000:00010000:3.0:1746144660.037030:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f300a80 00000100:00100000:3.0:1746144660.037049:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746638080 00000100:00100000:3.0:1746144660.037051:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746638080 00002000:00100000:3.0:1746144660.037068:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f300e00 x1830964746638080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.037074:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300e00 with x1830964746638080 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.037077:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f300e00 00000100:00100000:3.0:1746144660.037086:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746637952 00000100:00100000:3.0:1746144660.037088:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746637952 00002000:00100000:3.0:1746144660.037108:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f301180 x1830964746637952/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.037114:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301180 with x1830964746637952 ext(2097152->3145727) 00002000:00010000:3.0:1746144660.037117:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f301180 00000100:00100000:3.0:1746144660.037130:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4463 00000100:00100000:3.0:1746144660.037167:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746637568:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144660.038355:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4464 00000100:00100000:3.0:1746144660.038366:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746637696:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144660.038964:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4465 00000100:00100000:3.0:1746144660.038978:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746638080:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144660.039199:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4466 00000100:00100000:1.0:1746144660.039207:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746637952:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.041018:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746638336 00000100:00080000:0.0:1746144660.041022:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746144660.041028:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144660.041029:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746638336 00000100:00100000:2.0:1746144660.041077:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11742 00000100:00100000:2.0:1746144660.041084:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:29091:x1830964746638336:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144660.041095:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.041120:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec0e expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.041150:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f300000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747477120:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.041158:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 38 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.041166:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.041168:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.041171:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1064960->1695743] (req 1064960->1695743) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 25 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.042669:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5600/0xa7c849b16e01a1b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec00 expref: 25 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.042683:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5600/0xa7c849b16e01a1b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec00 expref: 25 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.042698:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5600, rc 0) 00000100:00100000:0.0:1746144660.042727:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746637056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 21502us (21756us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144660.042734:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11740 00002000:00010000:0.0:1746144660.043331:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144659 -> 1746144660 00002000:00010000:0.0:1746144660.043334:0:8388:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144659 -> 1746144660 00000100:00100000:0.0:1746144660.043348:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747477248:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144660.043365:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e865400/0xa7c849b16e01a1b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec07 expref: 23 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.043374:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e865400/0xa7c849b16e01a1b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec07 expref: 23 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.043381:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e865400, rc 0) 00000100:00100000:0.0:1746144660.043401:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746637184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 21761us (22018us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144660.043406:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11741 00010000:00010000:2.0:1746144660.044162:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 38 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.044177:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.044188:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747477376:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.044254:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.048346:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747477376:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.048371:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1064960->1695743] (req 1064960->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.048386:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a800, rc 0) 00000100:00100000:2.0:1746144660.048441:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:29091:x1830964746638336:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7358us (11588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.048449:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11742 00000100:00100000:3.0:1746144660.049816:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746637568:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12647us (13301us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.049826:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4463 00002000:00100000:3.0:1746144660.049834:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2580480->3629055) req@ffff88009f300700 x1830964746637568/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.049842:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300700 with x1830964746637568 ext(2580480->3629055) 00002000:00010000:3.0:1746144660.049847:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f300700 00000100:00100000:0.0:1746144660.049952:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746637696:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11589us (13395us total) trans 0 rc 565248/565248 00000100:00100000:0.0:1746144660.049959:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4464 00002000:00100000:0.0:1746144660.049965:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3629056->4194303) req@ffff88009f300a80 x1830964746637696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144660.049971:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300a80 with x1830964746637696 ext(3629056->4194303) 00002000:00010000:0.0:1746144660.049974:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f300a80 00000100:00100000:0.0:1746144660.056910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.056945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.057067:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746638464 00000100:00100000:3.0:1746144660.057075:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746638464 00000100:00100000:0.0:1746144660.057088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:3.0:1746144660.057165:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1671168->2097151) req@ffff88009f300000 x1830964746638464/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.057175:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300000 with x1830964746638464 ext(1671168->2097151) 00010000:00010000:3.0:1746144660.057189:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 35 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.057202:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 35 pid: 29370 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.057210:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f300000 00000100:00100000:3.0:1746144660.057226:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746638976 00000100:00100000:3.0:1746144660.057228:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746638976 00002000:00100000:3.0:1746144660.057244:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f301880 x1830964746638976/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746144660.057291:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746638848 00000100:00100000:2.0:1746144660.057295:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746638848 00002000:00100000:2.0:1746144660.057313:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f301c00 x1830964746638848/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.057320:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301c00 with x1830964746638848 ext(0->1048575) 00002000:00010000:2.0:1746144660.057323:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f301c00 00000100:00100000:2.0:1746144660.057338:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 869 00000100:00100000:2.0:1746144660.057344:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746638464:12345-192.168.204.23@tcp:4:cat.0 00002000:00100000:3.0:1746144660.057611:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301880 with x1830964746638976 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.057615:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f301880 00000100:00100000:3.0:1746144660.057629:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4467 00000100:00100000:3.0:1746144660.057637:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746638848:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.057721:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4468 00000100:00100000:2.0:1746144660.057727:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+31:1961:x1830964746638976:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144660.061471:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746638080:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22492us (24654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.061483:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4465 00002000:00100000:3.0:1746144660.061493:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f300e00 x1830964746638080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.061501:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300e00 with x1830964746638080 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.061506:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f300e00 00000100:00100000:1.0:1746144660.065947:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746637952:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26731us (29099us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144660.065958:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4466 00002000:00100000:1.0:1746144660.065972:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f301180 x1830964746637952/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.065980:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301180 with x1830964746637952 ext(2097152->3145727) 00002000:00010000:1.0:1746144660.065984:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f301180 00000100:00100000:3.0:1746144660.068190:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746638464:12345-192.168.204.23@tcp:4:cat.0 Request processed in 10840us (11282us total) trans 17179873251 rc 0/0 00000100:00100000:3.0:1746144660.068198:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 869 00002000:00100000:3.0:1746144660.068207:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1671168->2097151) req@ffff88009f300000 x1830964746638464/t17179873251(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.068215:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300000 with x1830964746638464 ext(1671168->2097151) 00010000:00010000:3.0:1746144660.068224:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 37 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.068264:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 37 pid: 29370 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.068270:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f300000 00000100:00100000:2.0:1746144660.075963:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+31:1961:x1830964746638976:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18227us (19008us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144660.075975:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4468 00002000:00100000:2.0:1746144660.075986:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f301880 x1830964746638976/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.075995:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301880 with x1830964746638976 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.076000:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f301880 00000100:00100000:3.0:1746144660.078227:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746638848:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20584us (21130us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.078237:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4467 00002000:00100000:3.0:1746144660.078246:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f301c00 x1830964746638848/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.078254:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301c00 with x1830964746638848 ext(0->1048575) 00002000:00010000:3.0:1746144660.078258:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f301c00 00000100:00100000:0.0:1746144660.085947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.086054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.086276:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746639232 00000100:00100000:2.0:1746144660.086287:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746639232 00000100:00100000:1.0:1746144660.086302:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746639104 00000100:00100000:1.0:1746144660.086310:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746639104 00010000:00010000:1.0:1746144660.086344:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.086346:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11743 00000100:00100000:2.0:1746144660.086353:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1962:x1830964746639232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.086373:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144660.086379:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5843 00000100:00100000:1.0:1746144660.086385:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746639104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.086393:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70a600/0xa7c849b16e01a1c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec15 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.086398:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144660.086424:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 39 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.086436:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 39 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.086447:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747477504:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144660.086461:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.086463:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.086471:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.086483:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.086511:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.086522:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747477632:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.086539:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.086563:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.090857:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747477632:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144660.090882:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144660.090925:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746639104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4539us (4988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.090935:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5843 00010000:00010000:2.0:1746144660.091049:0:4758:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff880092936300 x1830964747477504) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.091084:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e864a00/0xa7c849b16e01a150 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebc8 expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.091113:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747477504:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.091165:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f70a600/0xa7c849b16e01a1c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec15 expref: 37 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.091178:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a600/0xa7c849b16e01a1c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec15 expref: 37 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.091186:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a600, rc 0) 00000100:00100000:2.0:1746144660.091208:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746639232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4855us (5154us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.091621:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11743 00000100:00100000:0.0:1746144660.091751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.091882:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746639488 00000100:00100000:2.0:1746144660.091889:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746639488 00002000:00100000:2.0:1746144660.091921:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1064960->1069055) req@ffff88009f302680 x1830964746639488/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.091931:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302680 with x1830964746639488 ext(1064960->1069055) 00002000:00010000:2.0:1746144660.091935:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f302680 00000100:00100000:2.0:1746144660.091950:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4469 00000100:00100000:2.0:1746144660.091957:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746639488:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.092261:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746639488:12345-192.168.204.23@tcp:3:cat.0 Request processed in 303us (510us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144660.092267:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4469 00002000:00100000:2.0:1746144660.092273:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1064960->1069055) req@ffff88009f302680 x1830964746639488/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.092281:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302680 with x1830964746639488 ext(1064960->1069055) 00002000:00010000:2.0:1746144660.092284:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f302680 00000100:00100000:0.0:1746144660.094358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.094409:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746639616 00000100:00100000:3.0:1746144660.094418:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746639616 00000100:00100000:3.0:1746144660.094488:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10081 00000100:00100000:3.0:1746144660.094497:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29097:x1830964746639616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.094519:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.094538:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76800/0xa7c849b16e01a1ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec1c expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.094600:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.094615:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144660.094628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144660.094629:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.094643:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.094649:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.094654:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144660.094655:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746639872 00000100:00100000:0.0:1746144660.094659:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746639872 00002000:00100000:0.0:1746144660.094684:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f302d80 x1830964746639872/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 504/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144660.094693:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302d80 with x1830964746639872 ext(1048576->2097151) 00002000:00010000:0.0:1746144660.094697:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f302d80 00000100:00100000:0.0:1746144660.094726:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4470 00000100:00100000:0.0:1746144660.094733:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746639872:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:3.0:1746144660.094768:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.094777:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.094783:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144660.094999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.095016:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640128 00000100:00100000:1.0:1746144660.095020:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640128 00002000:00100000:1.0:1746144660.095038:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a4ebe680 x1830964746640128/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.095046:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebe680 with x1830964746640128 ext(4194304->4935679) 00002000:00010000:1.0:1746144660.095049:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebe680 00000100:00100000:1.0:1746144660.095062:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4471 00000100:00100000:1.0:1746144660.095067:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746640128:12345-192.168.204.23@tcp:3:cat.0 00000004:00200000:3.0:1746144660.096407:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144660.096416:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144660.096439:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096451:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096460:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096465:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096475:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096481:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008be76a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.096485:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096491:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096504:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144660.096507:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.096511:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096516:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76a00/0xa7c849b16e01a1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096535:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096540:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096544:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096548:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008be76c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.096550:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096555:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096564:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136942000) 00010000:00010000:3.0:1746144660.096566:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.096568:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096572:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76c00/0xa7c849b16e01a1dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.096611:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76800/0xa7c849b16e01a1ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.096623:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.096630:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.096631:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144660.096634:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be76e00, rc 0) 00000100:00100000:3.0:1746144660.096659:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29097:x1830964746639616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2164us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.096668:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10081 00000100:00100000:2.0:1746144660.103684:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746639872:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8938us (9042us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746144660.103696:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4470 00002000:00100000:2.0:1746144660.103707:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f302d80 x1830964746639872/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 504/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.103717:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302d80 with x1830964746639872 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.103723:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f302d80 00000100:00100000:2.0:1746144660.107030:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746640128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11952us (12021us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144660.107042:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4471 00002000:00100000:2.0:1746144660.107053:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a4ebe680 x1830964746640128/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.107063:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebe680 with x1830964746640128 ext(4194304->4935679) 00002000:00010000:2.0:1746144660.107068:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebe680 00000100:00100000:0.0:1746144660.110978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.111020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.111050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.111074:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640384 00000100:00100000:0.0:1746144660.111074:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640256 00000100:00100000:1.0:1746144660.111083:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640384 00000100:00100000:0.0:1746144660.111083:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640256 00000100:00100000:0.0:1746144660.111168:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640512 00000100:00100000:0.0:1746144660.111171:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640512 00000100:00100000:3.0:1746144660.111223:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11744 00000100:00100000:3.0:1746144660.111247:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1960:x1830964746640256:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:2.0:1746144660.111259:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11745 00010000:00010000:3.0:1746144660.111269:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144660.111269:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746640384:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.111275:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.111288:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec23 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.111288:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec2a expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.111311:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.111311:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.111313:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.111313:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.111322:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 6 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.111322:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.111337:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 6 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.111337:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.111347:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be76600, rc 0) 00010000:00010000:2.0:1746144660.111347:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a200, rc 0) 00000100:00100000:3.0:1746144660.111388:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746640256:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 157us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.111388:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746640384:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 122us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.111490:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11746 00000100:00100000:1.0:1746144660.111496:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746640512:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144660.111502:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.111509:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec31 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.111518:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.111519:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.111524:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.111532:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.111538:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5a00, rc 0) 00000100:00100000:1.0:1746144660.111552:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746640512:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 57us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.111557:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11746 00000100:00100000:0.0:1746144660.111730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.111789:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11745 00000100:00100000:3.0:1746144660.111793:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11744 00000100:00100000:2.0:1746144660.111801:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640640 00000100:00100000:2.0:1746144660.111803:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640640 00000100:00100000:2.0:1746144660.111824:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11747 00000100:00100000:2.0:1746144660.111828:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746640640:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.111834:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.111840:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f70b600/0xa7c849b16e01a1ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec38 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.111842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.111853:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640768 00000100:00100000:3.0:1746144660.111856:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640768 00000100:00100000:2.0:1746144660.111875:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747477760:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144660.111879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.111900:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11748 00000100:00100000:3.0:1746144660.111905:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746640768:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.111910:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.111915:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008be77200/0xa7c849b16e01a206 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec3f expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.111919:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.111937:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747477888:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.111956:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.112041:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746640896 00000100:00100000:2.0:1746144660.112044:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746640896 00000100:00100000:2.0:1746144660.112062:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11749 00000100:00100000:2.0:1746144660.112067:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746640896:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.112072:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.112078:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec46 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.112089:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.112091:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.112104:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.112114:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.112121:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a000, rc 0) 00000100:00100000:2.0:1746144660.112167:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746640896:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 99us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.112172:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11749 00000100:00100000:0.0:1746144660.114909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.115418:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746641152 00000100:00100000:2.0:1746144660.115428:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746641152 00000100:00100000:2.0:1746144660.115486:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4068 00000100:00100000:2.0:1746144660.115494:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:29091:x1830964746641152:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144660.115742:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:29091:x1830964746641152:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 247us (841us total) trans 8589943965 rc 0/0 00000100:00100000:2.0:1746144660.115754:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4068 00000100:00100000:0.0:1746144660.118405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.118460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.118523:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746641280 00000100:00100000:1.0:1746144660.118534:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746641280 00000100:00100000:1.0:1746144660.118571:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746641408 00000100:00100000:1.0:1746144660.118573:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746641408 00000100:00100000:1.0:1746144660.118594:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11750 00000100:00100000:1.0:1746144660.118600:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746641280:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.118620:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.118637:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5c00/0xa7c849b16e01a214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec4d expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.118703:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747478016:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144660.118779:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.120268:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11751 00000100:00100000:1.0:1746144660.120282:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:29095:x1830964746641408:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.120296:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.120311:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec54 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.120334:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.120341:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144660.120343:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144660.120346:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.120369:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.120381:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 37 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746144660.120391:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747478144:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.120465:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.121319:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747477888:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.121360:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008be77200/0xa7c849b16e01a206 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec3f expref: 9 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.121371:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008be77200/0xa7c849b16e01a206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec3f expref: 9 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.121393:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be77200, rc 0) 00000100:00100000:2.0:1746144660.121420:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746640768:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9515us (9577us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.121428:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11748 00000100:00100000:3.0:1746144660.121579:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747477760:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.121597:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f70b600/0xa7c849b16e01a1ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec38 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.121606:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70b600/0xa7c849b16e01a1ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec38 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144660.121818:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747478016:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.121837:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5c00/0xa7c849b16e01a214 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec4d expref: 37 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.121846:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5c00/0xa7c849b16e01a214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec4d expref: 37 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.121853:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5c00, rc 0) 00000100:00100000:2.0:1746144660.121869:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746641280:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3270us (3474us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.121875:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11750 00010000:00010000:3.0:1746144660.121954:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70b600, rc 0) 00000100:00100000:3.0:1746144660.121975:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746640640:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 10147us (10245us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.121981:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11747 00000100:00100000:1.0:1746144660.123154:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747478144:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.123175:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.123188:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418ec00, rc 0) 00000100:00100000:1.0:1746144660.123209:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:29095:x1830964746641408:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2933us (4749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.123215:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11751 00000100:00100000:0.0:1746144660.123625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.123685:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746641536 00000100:00100000:1.0:1746144660.123691:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746641536 00000100:00100000:1.0:1746144660.123732:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11752 00000100:00100000:1.0:1746144660.123738:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746641536:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.123752:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.123764:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e01a222 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec5b expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.123804:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747478272:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144660.123865:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.126025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.126116:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746641920 00000100:00100000:3.0:1746144660.126124:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746641920 00000100:00100000:3.0:1746144660.126221:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10082 00000100:00100000:3.0:1746144660.126230:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29097:x1830964746641920:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.126248:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.126265:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77a00/0xa7c849b16e01a229 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec62 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126366:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.126381:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 302 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126388:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126394:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126399:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.126426:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126436:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 8 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.126446:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747478400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.126530:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126537:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 14 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.126545:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747478528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.126570:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 302 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.126578:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 302 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.126585:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747478656:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.126601:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.127887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.129202:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747478272:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144660.129235:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e01a222 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec5b expref: 37 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.129250:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e01a222 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec5b expref: 37 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.129265:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b400, rc 0) 00000100:00100000:0.0:1746144660.129301:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746641536:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5563us (5677us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144660.129308:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11752 00000100:00100000:2.0:1746144660.129727:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746641664 00000100:00100000:1.0:1746144660.129864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.129897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.129905:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746641664 00000100:00100000:1.0:1746144660.129919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:2.0:1746144660.129947:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2580479) req@ffff88008c7d3480 x1830964746641664/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.129956:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3480 with x1830964746641664 ext(2097152->2580479) 00010000:00010000:2.0:1746144660.129964:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 36 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.129968:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642048 00000100:00100000:0.0:1746144660.129971:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642048 00010000:00010000:2.0:1746144660.129975:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 36 pid: 29370 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746144660.129982:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c7d3480 00010000:00010000:0.0:1746144660.129989:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 9 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.129997:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 870 00000100:00100000:2.0:1746144660.130004:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746641664:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144660.130004:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642304 00000100:00100000:0.0:1746144660.130006:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642304 00010000:00010000:0.0:1746144660.130025:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 303 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.130036:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642176 00000100:00100000:0.0:1746144660.130038:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642176 00010000:00010000:0.0:1746144660.130046:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 15 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.130057:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5844 00000100:00100000:0.0:1746144660.130062:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746642048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.130072:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.130077:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 9 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746144660.130087:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 9 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746144660.130116:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:3.0:1746144660.130117:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5845 00010000:00010000:0.0:1746144660.130120:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.130129:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144660.130150:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1961:x1830964746642304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.130151:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144660.130158:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.130162:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 303 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.130169:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746642048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 107us (306us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144660.130174:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 303 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.130174:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5844 00010000:00010000:3.0:1746144660.130185:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.130187:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.130192:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.130196:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.130208:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1961:x1830964746642304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.130210:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5846 00000100:00100000:0.0:1746144660.130215:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746642176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.130220:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.130224:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 15 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746144660.130231:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 15 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746144660.130240:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144660.130244:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.130250:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.130256:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.130270:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.130282:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746642176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.130311:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5845 00010000:00010000:3.0:1746144660.130341:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be76e00/0xa7c849b16e01a1e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec1c expref: 8 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.130357:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747478400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.130372:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a173 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebd6 expref: 15 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.130384:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747478528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.130392:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a0af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb43 expref: 302 pid: 15388 timeout: 739 lvb_type: 0 00000100:00080000:1.0:1746144660.130398:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144660.130400:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747478656:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.130423:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.130430:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.130436:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144660.130455:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:0.0:1746144660.130491:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5846 00010000:00010000:3.0:1746144660.131289:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77a00/0xa7c849b16e01a229 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.131301:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.131306:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.131308:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144660.131310:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be77c00, rc 0) 00000100:00100000:3.0:1746144660.132069:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29097:x1830964746641920:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5839us (6051us total) trans 8589943966 rc 0/0 00000100:00100000:3.0:1746144660.132076:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10082 00000100:00100000:1.0:1746144660.144318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.145639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.147176:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642560 00000100:00100000:2.0:1746144660.147187:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642560 00000100:00100000:2.0:1746144660.147227:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642688 00000100:00100000:2.0:1746144660.147229:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642688 00000100:00100000:2.0:1746144660.147248:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10083 00000100:00100000:2.0:1746144660.147256:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29100:x1830964746642560:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144660.147280:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.147297:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a23e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec69 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.147398:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147411:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147420:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147434:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147438:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147442:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147541:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147548:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147554:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144660.147561:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144660.147628:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147634:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147640:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147644:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f70aa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.147647:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147653:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147662:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144660.147664:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144660.147668:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147672:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70aa00/0xa7c849b16e01a245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147686:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147691:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147696:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147699:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fabca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.147701:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147706:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147711:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8800) 00010000:00010000:2.0:1746144660.147712:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144660.147714:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147718:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fabca00/0xa7c849b16e01a24c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147745:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b400/0xa7c849b16e01a23e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 305 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.147758:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 304 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.147763:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.147766:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144660.147768:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf5e400, rc 0) 00000100:00100000:2.0:1746144660.147810:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29100:x1830964746642560:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 555us (3499us total) trans 8589943967 rc 0/0 00000100:00100000:2.0:1746144660.147816:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10083 00000100:00100000:2.0:1746144660.147830:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10084 00000100:00100000:2.0:1746144660.147835:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29097:x1830964746642688:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.147842:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.147848:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a261 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec70 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.147875:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147883:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.147889:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.147913:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.147922:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 9 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.147931:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747478784:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.147972:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.154575:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746641664:12345-192.168.204.23@tcp:4:cat.0 Request processed in 24560us (26679us total) trans 17179873252 rc 0/0 00000100:00100000:3.0:1746144660.154590:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 870 00002000:00100000:3.0:1746144660.154603:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2580479) req@ffff88008c7d3480 x1830964746641664/t17179873252(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.154612:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3480 with x1830964746641664 ext(2097152->2580479) 00010000:00010000:3.0:1746144660.154625:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.154638:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.154645:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c7d3480 00000100:00100000:2.0:1746144660.154912:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747478784:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.154936:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144660.155354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.155379:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642816 00000100:00100000:2.0:1746144660.155386:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642816 00010000:00010000:2.0:1746144660.155410:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 10 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.155435:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5847 00000100:00100000:2.0:1746144660.155441:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746642816:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.155454:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.155459:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 10 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.155468:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 10 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.155489:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008be77c00/0xa7c849b16e01a230 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec62 expref: 10 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.155502:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.155506:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.155516:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.155522:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.155538:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.155572:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746642816:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 132us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.155578:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5847 00010000:00010000:2.0:1746144660.155596:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.155601:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144660.155642:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144660.155646:0:15388:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144660.155661:0:15388:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.155689:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70a400/0xa7c849b16e01a261 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.155702:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.155708:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.155711:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144660.155713:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4272200, rc 0) 00000100:00100000:2.0:1746144660.155734:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29097:x1830964746642688:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7899us (10105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.155740:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10084 00000100:00100000:0.0:1746144660.166114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.166162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.166184:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746642944 00000100:00100000:0.0:1746144660.166192:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746642944 00000100:00100000:0.0:1746144660.166226:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746643072 00000100:00100000:0.0:1746144660.166227:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746643072 00000100:00100000:0.0:1746144660.166240:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11753 00000100:00100000:0.0:1746144660.166248:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746642944:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144660.166265:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.166282:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01a26f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec77 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.166329:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747478912:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144660.166395:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.166411:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11754 00000100:00100000:0.0:1746144660.166415:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:29100:x1830964746643072:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144660.166422:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.166427:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec7e expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.166441:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.166448:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144660.166449:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144660.166452:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1736704->2052095] (req 1736704->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 39 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.166469:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.166478:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 21 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.166485:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747479040:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.166500:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.169293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.169321:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746643200 00000100:00100000:2.0:1746144660.169327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.169330:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746643200 00000100:00100000:3.0:1746144660.169372:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11755 00000100:00100000:2.0:1746144660.169378:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746643328 00000100:00100000:3.0:1746144660.169380:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746643200:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:2.0:1746144660.169382:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746643328 00010000:00010000:3.0:1746144660.169397:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.169404:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 40 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.169411:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e01a27d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec85 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.169425:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5848 00000100:00100000:2.0:1746144660.169430:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746643328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144660.169433:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747479040:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.169440:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.169455:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1736704->2052095] (req 1736704->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 40 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.169458:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479168:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.169462:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 40 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746144660.169466:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4800, rc 0) 00010000:00010000:2.0:1746144660.169472:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 40 pid: 29370 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.169490:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.169493:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.169499:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.169508:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.169529:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.169537:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747479296:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144660.170149:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747478912:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144660.170164:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01a26f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec77 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.170174:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01a26f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec77 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.170181:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5200, rc 0) 00000100:00100000:0.0:1746144660.170197:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746642944:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3949us (4103us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144660.170202:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11753 00000100:00100000:0.0:1746144660.170221:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29100:x1830964746643072:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3806us (4060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.170226:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11754 00000100:00100000:3.0:1746144660.170522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.170628:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.170642:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746643456 00000100:00100000:3.0:1746144660.170645:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746643456 00002000:00100000:3.0:1746144660.170674:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1064960->1695743) req@ffff88009398a300 x1830964746643456/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.170682:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398a300 with x1830964746643456 ext(1064960->1695743) 00010000:00010000:3.0:1746144660.170688:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 22 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.170729:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2480 going to sleep for 11 seconds 00010000:00010000:3.0:1746144660.171199:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 22 pid: 4758 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.171207:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398a300 00000100:00100000:3.0:1746144660.171228:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 871 00000100:00100000:3.0:1746144660.171234:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746643456:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144660.192120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.192185:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747479296:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144660.192205:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.192251:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746643328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 22819us (22921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.192261:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5848 00000100:00100000:2.0:1746144660.192321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.192517:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746643712 00000100:00100000:3.0:1746144660.192524:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746643712 00002000:00100000:3.0:1746144660.192564:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c944700 x1830964746643712/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.192573:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944700 with x1830964746643712 ext(2097152->3145727) 00002000:00010000:3.0:1746144660.192578:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944700 00000100:00100000:3.0:1746144660.192592:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746643840 00000100:00100000:3.0:1746144660.192595:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746643840 00002000:00100000:3.0:1746144660.192605:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c944a80 x1830964746643840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.192612:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944a80 with x1830964746643840 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.192614:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944a80 00000100:00100000:3.0:1746144660.192625:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4472 00000100:00100000:3.0:1746144660.192632:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746643712:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144660.192658:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4473 00000100:00100000:0.0:1746144660.192666:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746643840:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:3.0:1746144660.196340:0:4758:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff880093988700 x1830964747479168) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.196367:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5611 -> 5615 00010000:00010000:3.0:1746144660.196378:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e864e00/0xa7c849b16e01a157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2580479) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebcf expref: 38 pid: 29370 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.196405:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479168:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.196442:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e01a27d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec85 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.196455:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d8be400/0xa7c849b16e01a27d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec85 expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.196463:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d8be400, rc 0) 00000100:00100000:3.0:1746144660.196497:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746643200:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 27116us (27212us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.196506:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11755 00000100:00100000:3.0:1746144660.205711:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746643456:12345-192.168.204.23@tcp:4:cat.0 Request processed in 34464us (35177us total) trans 17179873253 rc 0/0 00000100:00100000:3.0:1746144660.205724:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 871 00002000:00100000:3.0:1746144660.205736:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1064960->1695743) req@ffff88009398a300 x1830964746643456/t17179873253(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.205745:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398a300 with x1830964746643456 ext(1064960->1695743) 00010000:00010000:3.0:1746144660.205754:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 28 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.205768:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 28 pid: 4758 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.205775:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398a300 00000100:00100000:3.0:1746144660.208428:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746643840:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15754us (16097us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.208440:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4473 00002000:00100000:3.0:1746144660.208451:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c944a80 x1830964746643840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.208460:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944a80 with x1830964746643840 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.208465:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944a80 00000100:00100000:3.0:1746144660.209247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.209424:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746644224 00000100:00100000:2.0:1746144660.209434:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746644224 00000100:00100000:2.0:1746144660.209469:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10085 00000100:00100000:2.0:1746144660.209476:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29097:x1830964746644224:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.209496:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.209515:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a284 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec8c expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.209620:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209635:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209646:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209658:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209664:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209669:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209675:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5ba000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.209679:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209686:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209696:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.209699:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144660.209702:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209707:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba000/0xa7c849b16e01a28b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.209734:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a284 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec8c expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.209741:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5ba200/0xa7c849b16e01a284 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec8c expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.209748:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ba200, rc 0) 00000100:00100000:2.0:1746144660.209779:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29097:x1830964746644224:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 303us (532us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.209784:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10085 00000100:00100000:3.0:1746144660.210439:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746643712:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17805us (18330us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.210447:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4472 00002000:00100000:3.0:1746144660.210454:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c944700 x1830964746643712/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.210462:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944700 with x1830964746643712 ext(2097152->3145727) 00002000:00010000:3.0:1746144660.210714:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944700 00000100:00100000:3.0:1746144660.210803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.210862:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746644352 00000100:00100000:3.0:1746144660.210866:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746644352 00010000:00010000:3.0:1746144660.210888:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 24 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.210908:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5849 00000100:00100000:3.0:1746144660.210914:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746644352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.210924:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.210941:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 24 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.210952:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 24 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.210969:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f70a800/0xa7c849b16e01a1c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1695743) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec0e expref: 24 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.210985:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.210987:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.210993:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.211002:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.211030:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.211043:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747479424:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144660.211105:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.215426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.215457:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746644736 00000100:00100000:0.0:1746144660.215466:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746644736 00000100:00100000:0.0:1746144660.215511:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4069 00000100:00100000:0.0:1746144660.215520:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29097:x1830964746644736:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1746144660.215767:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29097:x1830964746644736:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 246us (349us total) trans 8589943968 rc 0/0 00000100:00100000:0.0:1746144660.215773:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4069 00000100:00100000:3.0:1746144660.215944:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747479424:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144660.215965:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.215988:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746644352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5073us (5184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.215998:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5849 00000100:00100000:3.0:1746144660.216681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.216710:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746644864 00000100:00100000:3.0:1746144660.216713:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746644864 00002000:00100000:3.0:1746144660.216738:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1736704->1740799) req@ffff880093989c00 x1830964746644864/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.216748:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989c00 with x1830964746644864 ext(1736704->1740799) 00002000:00010000:3.0:1746144660.216753:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093989c00 00000100:00100000:3.0:1746144660.216765:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4474 00000100:00100000:3.0:1746144660.216769:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746644864:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.216893:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746644864:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 123us (213us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.216899:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4474 00002000:00100000:3.0:1746144660.216903:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1736704->1740799) req@ffff880093989c00 x1830964746644864/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.216910:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989c00 with x1830964746644864 ext(1736704->1740799) 00002000:00010000:3.0:1746144660.216912:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093989c00 00000100:00100000:1.0:1746144660.221679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.221856:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746644992 00000100:00100000:3.0:1746144660.221866:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746644992 00000100:00100000:3.0:1746144660.221910:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11756 00000100:00100000:3.0:1746144660.221918:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746644992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.221935:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.221952:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944c9400/0xa7c849b16e01a292 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec93 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.222010:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479552:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.222817:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090ff7900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.225418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.225446:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746645248 00000100:00100000:3.0:1746144660.225454:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746645248 00002000:00100000:3.0:1746144660.225495:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (2048000->2052095) req@ffff88009398b800 x1830964746645248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.225505:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398b800 with x1830964746645248 ext(2048000->2052095) 00002000:00010000:3.0:1746144660.225510:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398b800 00000100:00100000:3.0:1746144660.225526:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4475 00000100:00100000:3.0:1746144660.225531:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746645248:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.225693:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746645248:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 160us (281us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.225699:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4475 00002000:00100000:3.0:1746144660.225705:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (2048000->2052095) req@ffff88009398b800 x1830964746645248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.225712:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398b800 with x1830964746645248 ext(2048000->2052095) 00002000:00010000:3.0:1746144660.225714:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398b800 00000100:00100000:3.0:1746144660.226245:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479552:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.226279:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944c9400/0xa7c849b16e01a292 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec93 expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.226292:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944c9400/0xa7c849b16e01a292 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec93 expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.226302:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944c9400, rc 0) 00000100:00100000:3.0:1746144660.226324:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746644992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4407us (4653us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.226331:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11756 00000100:00100000:2.0:1746144660.228608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.228785:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746645504 00000100:00100000:1.0:1746144660.228793:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746645504 00000100:00100000:1.0:1746144660.228897:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4070 00000100:00100000:1.0:1746144660.228904:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29100:x1830964746645504:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144660.229812:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29100:x1830964746645504:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 906us (1209us total) trans 8589943969 rc 0/0 00000100:00100000:1.0:1746144660.229819:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4070 00000100:00100000:3.0:1746144660.234332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.234565:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746645760 00000100:00100000:2.0:1746144660.234575:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746645760 00002000:00100000:2.0:1746144660.234619:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093989f80 x1830964746645760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.234657:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989f80 with x1830964746645760 ext(4194304->4935679) 00002000:00010000:2.0:1746144660.234663:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093989f80 00000100:00100000:2.0:1746144660.234875:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4476 00000100:00100000:2.0:1746144660.234888:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746645760:12345-192.168.204.23@tcp:3:cat.0 00000001:00080000:3.0:1746144660.246375:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873245 is committed 00000001:00080000:3.0:1746144660.246405:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873229 is committed 00000001:00080000:3.0:1746144660.246441:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873247 is committed 00000001:00080000:3.0:1746144660.246514:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873250 is committed 00000001:00080000:3.0:1746144660.246571:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873251 is committed 00000001:00080000:3.0:1746144660.246579:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873249 is committed 00000100:00100000:2.0:1746144660.247322:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746645760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12428us (12990us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144660.247333:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4476 00002000:00100000:2.0:1746144660.247347:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093989f80 x1830964746645760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.247356:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989f80 with x1830964746645760 ext(4194304->4935679) 00002000:00010000:2.0:1746144660.247363:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093989f80 00000100:00100000:0.0:1746144660.252860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.252934:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746646016 00000100:00100000:3.0:1746144660.252944:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746646016 00000100:00100000:3.0:1746144660.253008:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10086 00000100:00100000:3.0:1746144660.253016:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:29106:x1830964746646016:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144660.253039:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.253062:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e600/0xa7c849b16e01a299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ec9a expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.253236:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253249:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253260:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253274:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253279:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253288:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253399:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253407:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253413:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144660.253421:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144660.253508:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253514:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253520:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253526:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf5f000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.253529:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253536:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253546:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144660.253549:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.253553:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253561:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f000/0xa7c849b16e01a2a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253576:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253581:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253585:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253589:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf5f200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.253590:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253594:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253599:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639700) 00010000:00010000:3.0:1746144660.253601:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.253603:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253607:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.253640:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e600/0xa7c849b16e01a299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 17 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.253653:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.253663:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.253665:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144660.253667:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf5e000, rc 0) 00000100:00100000:3.0:1746144660.253715:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:29106:x1830964746646016:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 700us (866us total) trans 8589943970 rc 0/0 00000100:00100000:3.0:1746144660.253721:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10086 00000100:00100000:0.0:1746144660.256452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.256505:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746646144 00000100:00100000:3.0:1746144660.256515:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746646144 00000100:00100000:3.0:1746144660.256572:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11757 00000100:00100000:3.0:1746144660.256580:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746646144:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.256597:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.256615:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fe00/0xa7c849b16e01a2bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eca1 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.256669:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479680:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.256963:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.258044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.261654:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746646400 00000100:00100000:2.0:1746144660.261672:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746646400 00000100:00100000:3.0:1746144660.261852:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479680:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.261891:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fe00/0xa7c849b16e01a2bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca1 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.261907:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf5fe00/0xa7c849b16e01a2bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca1 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.261919:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf5fe00, rc 0) 00000100:00100000:2.0:1746144660.262124:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10087 00000100:00100000:2.0:1746144660.262157:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29109:x1830964746646400:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.262182:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.262201:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47a00/0xa7c849b16e01a2c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eca8 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.262722:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746646144:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6141us (6279us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.262729:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11757 00010000:00010000:2.0:1746144660.263314:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263329:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263339:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263352:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263358:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263363:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263461:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263467:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263472:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144660.263480:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144660.263558:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263564:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263571:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263576:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136933400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.263580:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263585:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263596:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144660.263599:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144660.263603:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263608:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136933400/0xa7c849b16e01a2ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263630:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263634:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263638:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263643:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136932000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.263645:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263649:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263654:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8200) 00010000:00010000:2.0:1746144660.263656:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144660.263658:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263662:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136932000/0xa7c849b16e01a2d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.263695:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4b47a00/0xa7c849b16e01a2c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 308 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.263706:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 307 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.263712:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.263715:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144660.263717:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136933600, rc 0) 00000100:00100000:2.0:1746144660.263747:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29109:x1830964746646400:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1615us (5707us total) trans 8589943971 rc 0/0 00000100:00100000:2.0:1746144660.264671:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10087 00000100:00100000:0.0:1746144660.269570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.270167:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746646528 00000100:00100000:3.0:1746144660.270177:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746646528 00000100:00100000:3.0:1746144660.270223:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11758 00000100:00100000:3.0:1746144660.270231:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746646528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.270251:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.270270:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecaf expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.270328:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479808:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.270420:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.270899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.271392:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746646784 00000100:00100000:1.0:1746144660.271396:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746646784 00000100:00100000:1.0:1746144660.271433:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4071 00000100:00100000:1.0:1746144660.271440:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29109:x1830964746646784:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144660.271769:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29109:x1830964746646784:12345-192.168.204.23@tcp:35:cat.0 Request processed in 328us (870us total) trans 8589943972 rc 0/0 00000100:00100000:1.0:1746144660.271776:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4071 00000100:00100000:0.0:1746144660.271951:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479808:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144660.271981:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2e6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecaf expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.271992:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cf5f200/0xa7c849b16e01a2e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecaf expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.272004:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf5f200, rc 0) 00000100:00100000:0.0:1746144660.272022:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746646528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1793us (2465us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144660.272028:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11758 00000100:00100000:0.0:1746144660.277375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.277521:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746646912 00000100:00100000:2.0:1746144660.277533:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746646912 00000100:00100000:2.0:1746144660.277723:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11759 00000100:00100000:2.0:1746144660.277732:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746646912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.277752:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.277772:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecb6 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.277799:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.277800:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.277809:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.277824:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.277834:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136933400, rc 0) 00000100:00100000:2.0:1746144660.277895:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746646912:12345-192.168.204.23@tcp:101:cat.0 Request processed in 164us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.277901:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11759 00000100:00100000:0.0:1746144660.299029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.299269:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746647168 00000100:00100000:2.0:1746144660.299279:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746647168 00002000:00100000:2.0:1746144660.299326:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee03800 x1830964746647168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 504/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.299336:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03800 with x1830964746647168 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.299342:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee03800 00000100:00100000:2.0:1746144660.299373:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4477 00000100:00100000:2.0:1746144660.299380:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746647168:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.311266:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746647168:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11875us (12237us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746144660.311279:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4477 00002000:00100000:2.0:1746144660.311291:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee03800 x1830964746647168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 504/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.311300:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03800 with x1830964746647168 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.311306:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee03800 00000100:00100000:0.0:1746144660.331378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.331433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.331505:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746647424 00000100:00100000:3.0:1746144660.331517:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746647424 00002000:00100000:3.0:1746144660.331570:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4b63800 x1830964746647424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.331581:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63800 with x1830964746647424 ext(2097152->3145727) 00002000:00010000:3.0:1746144660.331588:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b63800 00000100:00100000:3.0:1746144660.331619:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746647552 00000100:00100000:3.0:1746144660.331622:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746647552 00002000:00100000:3.0:1746144660.331634:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a4b61c00 x1830964746647552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.331641:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b61c00 with x1830964746647552 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.331644:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b61c00 00000100:00100000:3.0:1746144660.331654:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4478 00000100:00100000:3.0:1746144660.331664:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746647424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144660.331664:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4479 00000100:00100000:0.0:1746144660.331672:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746647552:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.343595:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746647552:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11912us (12150us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144660.343608:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4479 00002000:00100000:2.0:1746144660.343621:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a4b61c00 x1830964746647552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.343630:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b61c00 with x1830964746647552 ext(3145728->4194303) 00002000:00010000:2.0:1746144660.343638:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b61c00 00000100:00100000:3.0:1746144660.343835:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746647424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12171us (12467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.343843:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4478 00002000:00100000:3.0:1746144660.343964:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4b63800 x1830964746647424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.343973:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63800 with x1830964746647424 ext(2097152->3145727) 00002000:00010000:3.0:1746144660.343976:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b63800 00000100:00100000:0.0:1746144660.354871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.354990:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746647936 00000100:00100000:3.0:1746144660.355001:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746647936 00002000:00100000:3.0:1746144660.355051:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a4b61180 x1830964746647936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.355061:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b61180 with x1830964746647936 ext(4194304->4935679) 00002000:00010000:3.0:1746144660.355067:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b61180 00000100:00100000:3.0:1746144660.355109:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4480 00000100:00100000:3.0:1746144660.355116:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746647936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144660.372491:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746647936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17361us (17618us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144660.372504:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4480 00002000:00100000:3.0:1746144660.372518:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800a4b61180 x1830964746647936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.372527:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b61180 with x1830964746647936 ext(4194304->4935679) 00002000:00010000:3.0:1746144660.372533:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b61180 00000100:00100000:0.0:1746144660.397677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.397772:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648064 00000100:00100000:2.0:1746144660.397783:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648064 00000100:00100000:2.0:1746144660.397842:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11760 00000100:00100000:2.0:1746144660.397851:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746648064:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.397873:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.397892:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e01a2f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecbd expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.397947:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479936:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144660.398045:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6b40 going to sleep for 11 seconds 00002000:00010000:2.0:1746144660.399450:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746144660 -> 1746144661 00000100:00100000:2.0:1746144660.399478:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747479936:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.399504:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e01a2f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecbd expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.399517:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136933c00/0xa7c849b16e01a2f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecbd expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.399543:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136933c00, rc 0) 00000100:00100000:2.0:1746144660.399589:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746648064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1738us (1923us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.399596:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11760 00000100:00100000:0.0:1746144660.409236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.409344:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648192 00000100:00100000:2.0:1746144660.409355:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648192 00000100:00100000:2.0:1746144660.409410:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11761 00000100:00100000:2.0:1746144660.409419:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:29114:x1830964746648192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.409440:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.409461:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecc4 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.409495:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 22 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.409503:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.409505:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.409508:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.409541:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 22 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.409555:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 22 pid: 10724 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.409568:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480064:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.409663:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.426251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.426334:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648320 00000100:00100000:3.0:1746144660.426346:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648320 00002000:00100000:3.0:1746144660.426398:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1736704->2052095) req@ffff8800a4b63100 x1830964746648320/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.426409:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63100 with x1830964746648320 ext(1736704->2052095) 00010000:00010000:3.0:1746144660.426420:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 23 pid: 10724 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.426436:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 23 pid: 10724 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.426443:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4b63100 00000100:00100000:3.0:1746144660.426478:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 872 00000100:00100000:3.0:1746144660.426486:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746648320:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144660.426509:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480064:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.426536:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.426552:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136932c00, rc 0) 00000100:00100000:2.0:1746144660.426610:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:29114:x1830964746648192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 17192us (17385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.426618:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11761 00000100:00100000:3.0:1746144660.449707:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746648320:12345-192.168.204.23@tcp:4:cat.0 Request processed in 23205us (23452us total) trans 17179873254 rc 0/0 00000100:00100000:3.0:1746144660.449720:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 872 00002000:00100000:3.0:1746144660.449733:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1736704->2052095) req@ffff8800a4b63100 x1830964746648320/t17179873254(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.449742:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63100 with x1830964746648320 ext(1736704->2052095) 00010000:00010000:3.0:1746144660.449752:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 25 pid: 10724 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.449771:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 25 pid: 10724 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.449782:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4b63100 00000100:00100000:0.0:1746144660.451591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.451677:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648448 00000100:00100000:2.0:1746144660.451688:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648448 00000100:00100000:2.0:1746144660.451736:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11762 00000100:00100000:2.0:1746144660.451743:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:29106:x1830964746648448:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144660.451762:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.451778:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eccb expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.451807:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.451816:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 5 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.451823:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.451828:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.451830:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.451833:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [491520->1048575] (req 491520->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.451863:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 24 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.451874:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 24 pid: 4758 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.451885:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480192:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.451983:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 5 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.451997:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 5 pid: 7257 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.452012:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480320:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.452047:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.452053:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.452066:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480448:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.452083:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.453344:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480192:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.453356:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480320:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.453785:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747480448:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.453820:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [491520->1048575] (req 491520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.453842:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136933000, rc 0) 00000100:00100000:2.0:1746144660.453876:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:29106:x1830964746648448:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2132us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.453884:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11762 00000100:00100000:0.0:1746144660.455363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.455428:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648704 00000100:00100000:3.0:1746144660.455437:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648704 00000100:00100000:0.0:1746144660.455438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144660.455471:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 6 pid: 7257 timeout: 739 lvb_type: 1 00000100:00100000:3.0:1746144660.455494:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648576 00000100:00100000:3.0:1746144660.455496:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648576 00010000:00010000:3.0:1746144660.455505:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 25 pid: 4758 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.455514:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5850 00000100:00100000:2.0:1746144660.455523:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746648704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144660.455540:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5851 00000100:00100000:3.0:1746144660.455545:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746648576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.455554:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.455580:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 25 pid: 4758 timeout: 739 lvb_type: 1 00010000:00010000:3.0:1746144660.455590:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 25 pid: 4758 timeout: 739 lvb_type: 1 00010000:00010000:3.0:1746144660.455612:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fabce00/0xa7c849b16e01a0b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb4a expref: 25 pid: 4758 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.455618:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.455629:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 6 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:3.0:1746144660.455640:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.455680:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746648576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 134us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.455689:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5851 00010000:00010000:2.0:1746144660.455948:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 6 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.455960:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008be76600/0xa7c849b16e01a1f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec23 expref: 6 pid: 7257 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.456172:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.457589:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1960:x1830964746648704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2061us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.457599:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5850 00000100:00100000:0.0:1746144660.458316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.458875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.459037:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746649216 00000100:00100000:2.0:1746144660.459045:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746649216 00000100:00100000:2.0:1746144660.459102:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10088 00000100:00100000:2.0:1746144660.459108:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29116:x1830964746649216:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144660.459153:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.459171:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800936d9e00/0xa7c849b16e01a309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecd2 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.460400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.460433:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648832 00000100:00100000:0.0:1746144660.460437:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648832 00010000:00010000:0.0:1746144660.460460:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144660.460486:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746648960 00000100:00100000:0.0:1746144660.460487:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746648960 00010000:00010000:0.0:1746144660.460496:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 24 pid: 10724 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.460508:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5852 00000100:00100000:0.0:1746144660.460513:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746648832:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.460523:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.460542:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.460552:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 739 lvb_type: 1 00000100:00100000:1.0:1746144660.460590:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5853 00000100:00100000:1.0:1746144660.460596:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746648960:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144660.460602:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144660.460611:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 24 pid: 10724 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.460620:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 24 pid: 10724 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.460638:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4800/0xa7c849b16e01a276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1736704->2052095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec7e expref: 24 pid: 10724 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.460657:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.460659:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.460665:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.460672:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.460702:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 11 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.460712:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747480576:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144660.460772:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013640cb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746144660.460965:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.460980:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.460987:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.460993:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.460999:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.461019:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.461030:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 309 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.461039:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747480704:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.461074:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.461086:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 15 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:0.0:1746144660.461471:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a01c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eaf6 expref: 11 pid: 4760 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.461493:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.461494:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.461499:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.461567:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.461593:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 10 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.461601:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747480960:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144660.461635:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.461749:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747480832:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.461781:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.461787:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 8 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.461793:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747481088:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.461805:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.461944:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747480576:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144660.461959:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144660.461977:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746648960:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1380us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.461983:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5853 00000100:00100000:2.0:1746144660.463335:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013092aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747480704:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.464043:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747480960:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144660.464058:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144660.464101:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746648832:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3575us (5775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.464110:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5852 00000100:00100000:0.0:1746144660.464268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.465225:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746649344 00000100:00100000:1.0:1746144660.465233:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746649344 00010000:00010000:1.0:1746144660.465266:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 310 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746144660.465315:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5854 00000100:00100000:1.0:1746144660.465323:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1960:x1830964746649344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144660.465334:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144660.465340:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 310 pid: 15388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.465349:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 310 pid: 15388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.465370:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136933600/0xa7c849b16e01a2d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eca8 expref: 310 pid: 15388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.465385:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144660.465391:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144660.465399:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144660.465403:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144660.465436:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1960:x1830964746649344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 111us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.465442:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5854 00000100:00100000:0.0:1746144660.465865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.465880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.465896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.465917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.465937:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747480832:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.465938:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746649856 00000100:00100000:0.0:1746144660.465942:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746649856 00000100:00100000:2.0:1746144660.465951:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747481088:192.168.204.23@tcp:104: 00002000:00100000:0.0:1746144660.465972:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092879880 x1830964746649856/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746144660.465979:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00002000:00100000:0.0:1746144660.465980:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879880 with x1830964746649856 ext(1048576->2097151) 00002000:00010000:0.0:1746144660.465984:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879880 00000100:00100000:0.0:1746144660.465995:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746650112 00000100:00100000:0.0:1746144660.465996:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746650112 00002000:00100000:0.0:1746144660.466003:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (491520->495615) req@ffff880092879c00 x1830964746650112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144660.466008:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879c00 with x1830964746650112 ext(491520->495615) 00002000:00010000:0.0:1746144660.466010:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879c00 00000100:00100000:2.0:1746144660.466012:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4481 00000100:00100000:2.0:1746144660.466018:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746649856:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.466052:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746649472 00000100:00100000:3.0:1746144660.466057:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746649472 00010000:00010000:3.0:1746144660.466072:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 16 pid: 14709 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.466087:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746649728 00000100:00100000:3.0:1746144660.466099:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746649728 00010000:00010000:3.0:1746144660.466110:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 9 pid: 15388 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.466123:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5855 00000100:00100000:0.0:1746144660.466125:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4482 00000100:00100000:3.0:1746144660.466128:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746649472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144660.466131:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746650112:12345-192.168.204.23@tcp:3:multiop.0 00010000:00010000:3.0:1746144660.466157:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.466161:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 16 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.466169:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 16 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.466180:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e000/0xa7c849b16e01a2ae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec9a expref: 16 pid: 14709 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.466194:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.466197:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.466203:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.466208:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144660.466450:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5856 00000100:00100000:1.0:1746144660.466457:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746649728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144660.466464:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144660.466469:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 9 pid: 15388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.466478:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 9 pid: 15388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.466489:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272200/0xa7c849b16e01a268 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec70 expref: 9 pid: 15388 timeout: 739 lvb_type: 0 00010000:00010000:1.0:1746144660.466501:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144660.466504:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144660.466510:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144660.466516:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144660.466532:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.467224:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746649472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1094us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.467230:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746650112:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1098us (1310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.467231:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5855 00000100:00100000:0.0:1746144660.467237:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4482 00002000:00100000:0.0:1746144660.467243:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (491520->495615) req@ffff880092879c00 x1830964746650112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144660.467250:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879c00 with x1830964746650112 ext(491520->495615) 00002000:00010000:0.0:1746144660.467253:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879c00 00010000:00010000:3.0:1746144660.467270:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.467276:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144660.467294:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144660.467417:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800936d9e00/0xa7c849b16e01a309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.467431:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.467437:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.467440:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144660.467442:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eb00a00, rc 0) 00000100:00100000:3.0:1746144660.467476:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29116:x1830964746649216:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8368us (8602us total) trans 8589943973 rc 0/0 00000100:00100000:3.0:1746144660.467482:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10088 00000100:00100000:1.0:1746144660.467977:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746649728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1519us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.467983:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5856 00000100:00100000:0.0:1746144660.473727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.473957:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746650240 00000100:00100000:2.0:1746144660.473967:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746650240 00000100:00100000:2.0:1746144660.474028:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11763 00000100:00100000:2.0:1746144660.474036:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+31:29106:x1830964746650240:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144660.474059:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.474078:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecd9 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.474118:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.474128:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.474163:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.474169:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.474171:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.474175:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1351679] (req 1048576->1351679) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.474208:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.474220:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 35 pid: 8453 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.474233:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481216:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.474337:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 7 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.474351:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 7 pid: 4758 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.474359:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481344:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.474383:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.474390:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.474397:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481472:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.474412:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.480345:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746649856:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14316us (14436us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.480360:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4481 00002000:00100000:3.0:1746144660.480373:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092879880 x1830964746649856/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.480384:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879880 with x1830964746649856 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.480390:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879880 00000100:00100000:3.0:1746144660.480463:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481216:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.480475:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481344:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.480485:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481472:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.480518:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1351679] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.480535:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993ea00, rc 0) 00000100:00100000:3.0:1746144660.480553:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:29106:x1830964746650240:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6519us (6839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.480560:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11763 00000100:00100000:0.0:1746144660.480761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.480807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.480809:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746650368 00000100:00100000:2.0:1746144660.480817:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746650368 00010000:00010000:2.0:1746144660.480843:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 36 pid: 8453 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144660.480861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.480883:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746650496 00000100:00100000:0.0:1746144660.480887:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746650496 00010000:00010000:0.0:1746144660.480901:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 8 pid: 4758 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144660.480920:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746650624 00000100:00100000:0.0:1746144660.480922:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746650624 00010000:00010000:0.0:1746144660.480930:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144660.480944:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5857 00000100:00100000:0.0:1746144660.480951:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746650496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.480964:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.480985:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 8 pid: 4758 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.480995:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 8 pid: 4758 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.481017:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a1ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec2a expref: 8 pid: 4758 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.481033:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.481050:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746650496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.481057:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5857 00000100:00100000:0.0:1746144660.481067:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5858 00000100:00100000:0.0:1746144660.481072:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746650624:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.481079:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.481086:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.481107:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.481118:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a023 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eafd expref: 32 pid: 4760 timeout: 739 lvb_type: 1 00010000:00010000:0.0:1746144660.481127:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.481163:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746650624:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.481170:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5858 00000100:00100000:2.0:1746144660.481304:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5859 00000100:00100000:2.0:1746144660.481310:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746650368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.481318:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.481327:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 36 pid: 8453 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.481337:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 36 pid: 8453 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.481350:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b428a800/0xa7c849b16e01a0d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb51 expref: 36 pid: 8453 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.481363:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.481366:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.481372:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.481381:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.481411:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 30 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.481422:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747481600:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.481470:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.485468:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747481600:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144660.485495:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.485566:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746650368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4255us (4805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.485578:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5859 00000100:00100000:0.0:1746144660.489502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.489578:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746650880 00000100:00100000:3.0:1746144660.489589:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746650880 00002000:00100000:3.0:1746144660.489640:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1347584->1351679) req@ffff88009287aa00 x1830964746650880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.489650:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287aa00 with x1830964746650880 ext(1347584->1351679) 00002000:00010000:3.0:1746144660.489656:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287aa00 00000100:00100000:3.0:1746144660.489687:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4483 00000100:00100000:3.0:1746144660.489696:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+31:1962:x1830964746650880:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.489894:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+31:1962:x1830964746650880:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 198us (403us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.489905:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4483 00002000:00100000:3.0:1746144660.489910:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1347584->1351679) req@ffff88009287aa00 x1830964746650880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.489918:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287aa00 with x1830964746650880 ext(1347584->1351679) 00002000:00010000:3.0:1746144660.489921:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287aa00 00000100:00100000:0.0:1746144660.494199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.494293:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651136 00000100:00100000:1.0:1746144660.494303:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651136 00000100:00100000:1.0:1746144660.494347:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4072 00000100:00100000:1.0:1746144660.494355:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:29106:x1830964746651136:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144660.495826:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:29106:x1830964746651136:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1465us (1634us total) trans 8589943974 rc 0/0 00000100:00100000:1.0:1746144660.495834:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4072 00000100:00100000:0.0:1746144660.508458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.509267:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.509689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.509736:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651264 00000100:00100000:3.0:1746144660.509747:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651264 00000100:00100000:3.0:1746144660.509795:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651392 00000100:00100000:3.0:1746144660.509798:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651392 00000100:00100000:1.0:1746144660.510030:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651520 00000100:00100000:1.0:1746144660.510033:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651520 00000100:00100000:1.0:1746144660.510056:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11764 00000100:00100000:1.0:1746144660.510064:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746651264:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.510087:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144660.510118:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11765 00000100:00100000:3.0:1746144660.510123:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746651392:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.510130:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.510159:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4cec200/0xa7c849b16e01a325 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ece7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.510214:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481728:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.510280:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9480 going to sleep for 11 seconds 00010000:00010000:1.0:1746144660.510625:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e01a32c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ece0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.510656:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747481856:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144660.510678:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013640cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.510732:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11766 00000100:00100000:0.0:1746144660.510740:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746651520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144660.510747:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.510755:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecee expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.510767:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.510769:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.510778:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.510794:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.510804:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5e00, rc 0) 00000100:00100000:0.0:1746144660.510828:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746651520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 89us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.510834:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11766 00002000:00010000:3.0:1746144660.512493:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144660 -> 1746144661 00002000:00010000:3.0:1746144660.512502:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144659 -> 1746144661 00002000:00010000:3.0:1746144660.512504:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144659 -> 1746144661 00000100:00100000:3.0:1746144660.512528:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747481728:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.512555:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4cec200/0xa7c849b16e01a325 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ece7 expref: 36 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.512567:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4cec200/0xa7c849b16e01a325 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ece7 expref: 36 pid: 4758 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746144660.512808:0:10724:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144658 -> 1746144661 00002000:00010000:1.0:1746144660.512812:0:10724:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144654 -> 1746144661 00002000:00010000:1.0:1746144660.512814:0:10724:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144658 -> 1746144661 00000100:00100000:1.0:1746144660.512828:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747481856:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144660.512849:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e01a32c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ece0 expref: 25 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.512859:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f125800/0xa7c849b16e01a32c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ece0 expref: 25 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.512934:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cec200, rc 0) 00000100:00100000:3.0:1746144660.512985:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746651392:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2859us (3717us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.512992:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11765 00010000:00010000:1.0:1746144660.513197:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f125800, rc 0) 00000100:00100000:1.0:1746144660.513219:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746651264:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3155us (4773us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144660.513225:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11764 00000100:00100000:0.0:1746144660.524789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.524976:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651648 00000100:00100000:1.0:1746144660.524987:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651648 00000100:00100000:1.0:1746144660.525048:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11767 00000100:00100000:1.0:1746144660.525058:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29121:x1830964746651648:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.525078:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.525105:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecf5 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.525168:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.525176:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144660.525177:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144660.525181:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 25 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.525209:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 9 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.525220:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 9 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746144660.525231:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747481984:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.525714:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013640cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.531745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.531831:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651776 00000100:00100000:2.0:1746144660.531840:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651776 00002000:00100000:2.0:1746144660.531886:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (491520->1048575) req@ffff880092878700 x1830964746651776/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.531903:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878700 with x1830964746651776 ext(491520->1048575) 00010000:00010000:2.0:1746144660.531912:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 10 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.531926:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 10 pid: 4758 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746144660.531933:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092878700 00000100:00100000:2.0:1746144660.531963:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 873 00000100:00100000:2.0:1746144660.531969:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746651776:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144660.532592:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747481984:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.532623:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 25 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.532637:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f124000, rc 0) 00000100:00100000:1.0:1746144660.532661:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29121:x1830964746651648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7605us (7884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.532669:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11767 00000100:00100000:2.0:1746144660.550417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.550498:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746651904 00000100:00100000:0.0:1746144660.550509:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746651904 00000100:00100000:0.0:1746144660.551525:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11768 00000100:00100000:0.0:1746144660.551535:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29116:x1830964746651904:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144660.551556:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.551573:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ecfc expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.551603:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.551611:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 6 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.551617:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 30 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.551623:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.551625:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.551629:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1302528->1982463] (req 1302528->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.551662:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 30 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.551673:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 30 pid: 10724 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144660.551690:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482112:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144660.551787:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 6 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.551796:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 6 pid: 8388 timeout: 739 lvb_type: 1 00000100:00100000:0.0:1746144660.551804:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482240:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144660.551828:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.551836:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:0.0:1746144660.551843:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482368:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.551858:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.554567:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746651776:12345-192.168.204.23@tcp:4:cat.0 Request processed in 22589us (22824us total) trans 17179873255 rc 0/0 00000100:00100000:2.0:1746144660.554579:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 873 00002000:00100000:2.0:1746144660.554590:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (491520->1048575) req@ffff880092878700 x1830964746651776/t17179873255(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.554600:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878700 with x1830964746651776 ext(491520->1048575) 00010000:00010000:2.0:1746144660.554610:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 12 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.554622:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 12 pid: 4758 timeout: 739 lvb_type: 0 00002000:00010000:2.0:1746144660.554629:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092878700 00000100:00100000:2.0:1746144660.559215:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482112:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.561735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.561802:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746652032 00000100:00100000:2.0:1746144660.561813:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746652032 00010000:00010000:2.0:1746144660.561858:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 31 pid: 10724 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.561905:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5860 00000100:00100000:2.0:1746144660.561914:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746652032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.561929:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.561954:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 31 pid: 10724 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.561967:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 31 pid: 10724 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.561995:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5c00/0xa7c849b16e01a1ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf9 expref: 31 pid: 10724 timeout: 739 lvb_type: 1 00010000:00010000:2.0:1746144660.562038:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.562103:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746652032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 189us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.562111:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5860 00000100:00100000:0.0:1746144660.564535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.565010:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482240:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.565022:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482368:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.565066:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1302528->1982463] (req 1302528->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.565103:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5800, rc 0) 00000100:00100000:2.0:1746144660.565190:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29116:x1830964746651904:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 13656us (14781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.565198:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11768 00000100:00100000:0.0:1746144660.566227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.566401:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746652288 00000100:00100000:1.0:1746144660.566409:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746652288 00010000:00010000:1.0:1746144660.566441:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 12 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:1.0:1746144660.566735:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746652160 00000100:00100000:1.0:1746144660.566739:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746652160 00010000:00010000:1.0:1746144660.566754:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 7 pid: 8388 timeout: 739 lvb_type: 1 00000100:00100000:2.0:1746144660.566791:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5861 00000100:00100000:2.0:1746144660.566799:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746652288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.566812:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.566835:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 12 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.566846:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 12 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.566868:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136933000/0xa7c849b16e01a302 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eccb expref: 12 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.566881:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.566883:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.566892:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.566901:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.566930:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.566943:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747482496:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.567014:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.567920:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5862 00000100:00100000:3.0:1746144660.567930:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746652160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.567940:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.567959:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 7 pid: 8388 timeout: 739 lvb_type: 1 00010000:00010000:3.0:1746144660.567969:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 7 pid: 8388 timeout: 739 lvb_type: 1 00010000:00010000:3.0:1746144660.567988:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5a00/0xa7c849b16e01a1f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec31 expref: 7 pid: 8388 timeout: 739 lvb_type: 1 00010000:00010000:3.0:1746144660.568005:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.568026:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746652160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 100us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.568032:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5862 00000100:00100000:0.0:1746144660.569293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.569737:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746652416 00000100:00100000:2.0:1746144660.569745:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746652416 00010000:00010000:2.0:1746144660.569771:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.569805:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5863 00000100:00100000:2.0:1746144660.569811:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746652416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.569822:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.569841:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.569853:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.569870:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29a600/0xa7c849b16e01a18f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebeb expref: 36 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:2.0:1746144660.569883:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.569885:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.569890:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.569899:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.569929:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.569940:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747482624:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.570013:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.572344:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747482496:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144660.572366:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.572403:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746652288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5604us (7876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.572417:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5861 00000100:00100000:0.0:1746144660.574942:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.576684:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746652672 00000100:00100000:2.0:1746144660.576696:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746652672 00002000:00100000:2.0:1746144660.576745:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880092879180 x1830964746652672/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.576755:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879180 with x1830964746652672 ext(0->1048575) 00002000:00010000:2.0:1746144660.576761:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879180 00000100:00100000:2.0:1746144660.576900:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4484 00000100:00100000:2.0:1746144660.576908:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746652672:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.578720:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747482624:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144660.578743:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.578785:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746652416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 8973us (9496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.578795:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5863 00000100:00100000:0.0:1746144660.578938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.579160:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746652928 00000100:00100000:3.0:1746144660.579165:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746652928 00002000:00100000:3.0:1746144660.579194:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1302528->1306623) req@ffff880092878e00 x1830964746652928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.579203:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878e00 with x1830964746652928 ext(1302528->1306623) 00002000:00010000:3.0:1746144660.579206:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092878e00 00000100:00100000:3.0:1746144660.579220:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4485 00000100:00100000:3.0:1746144660.579225:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746652928:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.579365:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746652928:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 138us (426us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.579371:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4485 00002000:00100000:3.0:1746144660.579376:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1302528->1306623) req@ffff880092878e00 x1830964746652928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.579383:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878e00 with x1830964746652928 ext(1302528->1306623) 00002000:00010000:3.0:1746144660.579386:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092878e00 00000100:00100000:2.0:1746144660.588757:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746652672:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 11837us (13814us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144660.588770:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4484 00002000:00100000:2.0:1746144660.588783:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880092879180 x1830964746652672/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.588792:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879180 with x1830964746652672 ext(0->1048575) 00002000:00010000:2.0:1746144660.588798:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879180 00000100:00100000:1.0:1746144660.589582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.590213:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746653184 00000100:00100000:3.0:1746144660.590223:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746653184 00002000:00100000:3.0:1746144660.590262:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1978368->1982463) req@ffff8800a4ebdf80 x1830964746653184/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.590272:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebdf80 with x1830964746653184 ext(1978368->1982463) 00002000:00010000:3.0:1746144660.590277:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ebdf80 00000100:00100000:3.0:1746144660.590305:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4486 00000100:00100000:3.0:1746144660.590312:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746653184:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144660.590488:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746653184:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 176us (908us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.590495:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4486 00002000:00100000:3.0:1746144660.590500:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1978368->1982463) req@ffff8800a4ebdf80 x1830964746653184/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.590507:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebdf80 with x1830964746653184 ext(1978368->1982463) 00002000:00010000:3.0:1746144660.590510:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ebdf80 00000100:00100000:0.0:1746144660.600080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.600569:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746653312 00000100:00100000:2.0:1746144660.600580:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746653312 00000100:00100000:2.0:1746144660.600641:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11769 00000100:00100000:2.0:1746144660.600652:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29121:x1830964746653312:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.600675:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.600761:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed03 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.600794:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.600801:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.600803:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.600806:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.600834:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 29 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.600845:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 29 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:2.0:1746144660.600857:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482752:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.602250:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.606835:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747482752:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.606873:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.606893:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7ea400, rc 0) 00000100:00100000:2.0:1746144660.606993:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29121:x1830964746653312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6341us (6924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.607001:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11769 00000100:00100000:0.0:1746144660.607476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.607661:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746653440 00000100:00100000:3.0:1746144660.607668:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746653440 00002000:00100000:3.0:1746144660.607711:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1351679) req@ffff88009ea0c000 x1830964746653440/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.607721:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c000 with x1830964746653440 ext(1048576->1351679) 00010000:00010000:3.0:1746144660.607729:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 30 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.607742:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 30 pid: 4758 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.607748:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea0c000 00000100:00100000:3.0:1746144660.607765:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 874 00000100:00100000:3.0:1746144660.607772:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746653440:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144660.613273:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746653440:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5489us (5786us total) trans 21474840499 rc 0/0 00000100:00100000:3.0:1746144660.613286:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 874 00002000:00100000:3.0:1746144660.613299:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1351679) req@ffff88009ea0c000 x1830964746653440/t21474840499(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.613309:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c000 with x1830964746653440 ext(1048576->1351679) 00010000:00010000:3.0:1746144660.613320:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.613338:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 739 lvb_type: 0 00002000:00010000:3.0:1746144660.613345:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea0c000 00000100:00100000:0.0:1746144660.617520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.617593:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746653568 00000100:00100000:3.0:1746144660.617603:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746653568 00010000:00010000:3.0:1746144660.617650:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 739 lvb_type: 0 00000100:00100000:3.0:1746144660.617696:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5864 00000100:00100000:3.0:1746144660.617704:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746653568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.617721:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.617745:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.617762:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.617785:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a31e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1351679) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd9 expref: 32 pid: 4758 timeout: 739 lvb_type: 0 00010000:00010000:3.0:1746144660.617818:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.617820:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.617828:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.617836:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.618945:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.619289:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747482880:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144660.619728:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.624761:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747482880:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144660.624787:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.624835:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+31:1961:x1830964746653568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7131us (7325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.624846:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5864 00000100:00100000:0.0:1746144660.629241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.629499:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746653824 00000100:00100000:3.0:1746144660.629511:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746653824 00002000:00100000:3.0:1746144660.629563:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0c700 x1830964746653824/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.629574:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c700 with x1830964746653824 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.629580:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0c700 00000100:00100000:3.0:1746144660.629612:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4487 00000100:00100000:3.0:1746144660.629619:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746653824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144660.630547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.630632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.631386:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746654208 00000100:00100000:1.0:1746144660.631392:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746654208 00002000:00100000:1.0:1746144660.631421:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0ca80 x1830964746654208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.631429:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ca80 with x1830964746654208 ext(1048576->2097151) 00002000:00010000:1.0:1746144660.631433:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0ca80 00000100:00100000:1.0:1746144660.631499:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746654336 00000100:00100000:1.0:1746144660.631502:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746654336 00002000:00100000:1.0:1746144660.631517:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0ce00 x1830964746654336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 504/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.631524:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ce00 with x1830964746654336 ext(1048576->2097151) 00002000:00010000:1.0:1746144660.631527:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0ce00 00000100:00100000:2.0:1746144660.631560:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4488 00000100:00100000:2.0:1746144660.631580:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4489 00000100:00100000:2.0:1746144660.631587:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746654336:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144660.632165:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746654208:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144660.652448:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746654336:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 20849us (21802us total) trans 0 rc 368640/368640 00000100:00100000:2.0:1746144660.652461:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4489 00002000:00100000:2.0:1746144660.652474:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0ce00 x1830964746654336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 504/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 368640/368640 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.652483:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ce00 with x1830964746654336 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.652490:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0ce00 00000100:00100000:1.0:1746144660.652545:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746653824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 22925us (23314us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144660.652556:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4487 00002000:00100000:1.0:1746144660.652562:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0c700 x1830964746653824/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.652568:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c700 with x1830964746653824 ext(1048576->2097151) 00002000:00010000:1.0:1746144660.652572:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0c700 00000100:00100000:3.0:1746144660.653379:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746654208:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 21806us (22828us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.653386:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4488 00002000:00100000:3.0:1746144660.653393:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0ca80 x1830964746654208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.653402:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ca80 with x1830964746654208 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.653405:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0ca80 00010000:00010000:1.0:1746144660.710483:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144660.724606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.724714:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746654592 00000100:00100000:3.0:1746144660.724724:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746654592 00000100:00100000:3.0:1746144660.724782:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10089 00000100:00100000:3.0:1746144660.724789:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:29126:x1830964746654592:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144660.724814:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.724834:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed0a expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.724961:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.724974:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.724986:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.724999:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.725004:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.725009:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.725114:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.725124:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.725129:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144660.730175:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144660.730319:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730329:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730336:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730342:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e7c000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.730347:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730355:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730372:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144660.730374:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.730379:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730384:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e7c000/0xa7c849b16e01a356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730429:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730439:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730444:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730448:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e46f600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.730450:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730455:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730462:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639700) 00010000:00010000:3.0:1746144660.730464:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.730466:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730471:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a35d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.730526:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 19 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.730540:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 18 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.730546:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.730548:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144660.730550:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46ec00, rc 0) 00000100:00100000:3.0:1746144660.730628:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:29126:x1830964746654592:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5837us (6032us total) trans 8589943975 rc 0/0 00000100:00100000:3.0:1746144660.730638:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10089 00000100:00100000:0.0:1746144660.738823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.740454:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746654848 00000100:00100000:3.0:1746144660.740465:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746654848 00000100:00100000:3.0:1746144660.740525:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10090 00000100:00100000:3.0:1746144660.740533:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:29128:x1830964746654848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.740559:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.740577:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46e400/0xa7c849b16e01a372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed11 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.740689:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740701:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740712:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740728:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740744:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740750:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740847:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c18600/0xa7c849b16e01a387 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740854:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c18600/0xa7c849b16e01a387 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740860:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c18600/0xa7c849b16e01a387 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144660.740869:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144660.740948:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740955:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740961:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740966:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e46fe00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.740970:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740975:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740986:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144660.740989:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.740993:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.740998:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741028:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741032:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741036:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741041:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e46f600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144660.741043:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741047:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741052:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639900) 00010000:00010000:3.0:1746144660.741054:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144660.741056:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741060:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46f600/0xa7c849b16e01a380 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.741101:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46e400/0xa7c849b16e01a372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed11 expref: 21 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.741113:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c18600/0xa7c849b16e01a387 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed11 expref: 20 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.741119:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.741122:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144660.741124:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c18600, rc 0) 00000100:00100000:3.0:1746144660.741196:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:29128:x1830964746654848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 662us (2379us total) trans 8589943976 rc 0/0 00000100:00100000:3.0:1746144660.741202:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10090 00000100:00100000:0.0:1746144660.745455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.745510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.745611:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746655232 00000100:00100000:3.0:1746144660.745621:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746655232 00000100:00100000:3.0:1746144660.745670:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 632 00000100:00100000:3.0:1746144660.745676:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746655232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.745692:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.745716:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c18600/0xa7c849b16e01a387 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed11 expref: 20 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.745731:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.745734:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.745775:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746655232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.745781:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 632 00000100:00100000:1.0:1746144660.745959:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746655104 00000100:00100000:1.0:1746144660.745963:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746655104 00000100:00100000:1.0:1746144660.746009:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4073 00000100:00100000:1.0:1746144660.746017:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:29128:x1830964746655104:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144660.746303:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:29128:x1830964746655104:12345-192.168.204.23@tcp:35:cat.0 Request processed in 284us (857us total) trans 8589943977 rc 0/0 00000100:00100000:1.0:1746144660.746310:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4073 00000100:00100000:0.0:1746144660.751365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.751853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.752275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.752477:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746655360 00000100:00100000:2.0:1746144660.752488:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746655360 00000100:00100000:2.0:1746144660.752539:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746655488 00000100:00100000:2.0:1746144660.752541:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746655488 00000100:00100000:2.0:1746144660.752556:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746655616 00000100:00100000:2.0:1746144660.752558:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746655616 00000100:00100000:1.0:1746144660.752569:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11770 00000100:00100000:2.0:1746144660.752577:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11771 00000100:00100000:1.0:1746144660.752580:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746655360:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144660.752582:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746655488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.752600:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.752600:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.752617:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed1f expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.752617:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed18 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.752640:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.752640:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.752641:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.752642:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.752650:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 33 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.752650:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.752665:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 33 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.752665:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.752676:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993ea00, rc 0) 00010000:00010000:1.0:1746144660.752676:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e865a00, rc 0) 00000100:00100000:1.0:1746144660.752723:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746655360:12345-192.168.204.23@tcp:101:cat.0 Request processed in 145us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.752728:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11770 00000100:00100000:0.0:1746144660.752738:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11772 00000100:00100000:0.0:1746144660.752746:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746655616:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144660.752752:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.752760:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a3a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed26 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.752803:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747483008:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144660.753187:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746655488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 604us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.753193:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11771 00000100:00100000:0.0:1746144660.753290:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34240 going to sleep for 11 seconds 00002000:00010000:2.0:1746144660.755389:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144660 -> 1746144661 00002000:00010000:2.0:1746144660.755396:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144660 -> 1746144661 00002000:00010000:2.0:1746144660.755398:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144660 -> 1746144661 00000100:00100000:2.0:1746144660.755419:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747483008:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.755457:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a3a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed26 expref: 33 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.755468:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70a200/0xa7c849b16e01a3a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed26 expref: 33 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.756063:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f70a200, rc 0) 00000100:00100000:2.0:1746144660.756126:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746655616:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3377us (3847us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.756163:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11772 00000100:00100000:0.0:1746144660.770053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.770252:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746655872 00000100:00100000:0.0:1746144660.770258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.770264:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746655872 00002000:00100000:3.0:1746144660.770313:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0e680 x1830964746655872/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.770335:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e680 with x1830964746655872 ext(0->1048575) 00002000:00010000:3.0:1746144660.770342:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0e680 00000100:00100000:3.0:1746144660.770377:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656128 00000100:00100000:3.0:1746144660.770380:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656128 00000100:00100000:1.0:1746144660.770391:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4490 00002000:00100000:3.0:1746144660.770395:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0ea00 x1830964746656128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.770401:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ea00 with x1830964746656128 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.770405:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0ea00 00000100:00100000:1.0:1746144660.770407:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746655872:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144660.770420:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4491 00000100:00100000:3.0:1746144660.770425:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746656128:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144660.783707:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746655872:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13298us (13657us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144660.783716:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4490 00002000:00100000:1.0:1746144660.783725:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0e680 x1830964746655872/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.783733:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e680 with x1830964746655872 ext(0->1048575) 00002000:00010000:1.0:1746144660.783738:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0e680 00000100:00100000:3.0:1746144660.784881:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746656128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14446us (14622us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.784892:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4491 00002000:00100000:3.0:1746144660.784902:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0ea00 x1830964746656128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.784912:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ea00 with x1830964746656128 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.784917:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0ea00 00000100:00100000:0.0:1746144660.800743:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.802458:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656256 00000100:00100000:2.0:1746144660.802471:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656256 00000100:00100000:2.0:1746144660.802620:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11773 00000100:00100000:2.0:1746144660.802630:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+32:29128:x1830964746656256:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.802651:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.802672:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed2d expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.803252:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.803260:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.803262:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.803265:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.803296:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 35 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.803308:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 35 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.803320:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747483136:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.803515:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.805538:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747483136:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.805563:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.805577:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ced600, rc 0) 00000100:00100000:2.0:1746144660.805617:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+33:29128:x1830964746656256:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2990us (4889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.805624:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11773 00000100:00100000:0.0:1746144660.806360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.806647:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656384 00000100:00100000:3.0:1746144660.806654:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656384 00002000:00100000:3.0:1746144660.806706:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1302528->1982463) req@ffff88009ea0f100 x1830964746656384/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.806719:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f100 with x1830964746656384 ext(1302528->1982463) 00010000:00010000:3.0:1746144660.806727:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 36 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.806741:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 36 pid: 10724 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144660.806746:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea0f100 00000100:00100000:3.0:1746144660.807601:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 875 00000100:00100000:3.0:1746144660.807608:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746656384:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144660.821546:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746656384:12345-192.168.204.23@tcp:4:cat.0 Request processed in 13924us (15174us total) trans 21474840500 rc 0/0 00000100:00100000:3.0:1746144660.821559:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 875 00002000:00100000:3.0:1746144660.821572:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1302528->1982463) req@ffff88009ea0f100 x1830964746656384/t21474840500(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.821582:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f100 with x1830964746656384 ext(1302528->1982463) 00010000:00010000:3.0:1746144660.821593:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 38 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.821610:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 38 pid: 10724 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144660.821617:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea0f100 00000100:00100000:0.0:1746144660.827813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.827879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.827955:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656640 00000100:00100000:3.0:1746144660.827965:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656640 00000100:00100000:3.0:1746144660.828015:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11774 00000100:00100000:3.0:1746144660.828023:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29130:x1830964746656640:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144660.828047:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.828067:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed34 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.828110:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 11 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.828120:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.828125:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.828127:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.828130:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3178496->3383295] (req 3178496->3383295) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.828191:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.828202:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144660.828213:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747483264:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.828215:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656512 00000100:00100000:2.0:1746144660.828221:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656512 00010000:00010000:2.0:1746144660.828243:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 38 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.828265:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5865 00000100:00100000:2.0:1746144660.828270:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746656512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.828280:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.828302:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 38 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.828307:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 11 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.828318:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 11 pid: 8388 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.828332:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747483392:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.828347:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 38 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.828350:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746144660.828372:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a341 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecfc expref: 38 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.828387:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.828389:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.828396:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 32 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.828403:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 32 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.828427:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 32 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.828436:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747483520:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.828463:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.835355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.835531:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747483264:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.835544:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747483392:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.835577:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3178496->3383295] (req 3178496->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.835599:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46fe00, rc 0) 00000100:00100000:3.0:1746144660.835652:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29130:x1830964746656640:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7629us (7772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.835661:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11774 00000100:00100000:1.0:1746144660.836367:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656768 00000100:00100000:1.0:1746144660.836375:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656768 00000100:00100000:0.0:1746144660.836390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.836419:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10091 00000100:00100000:1.0:1746144660.836426:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29131:x1830964746656768:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144660.836446:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.836463:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044000/0xa7c849b16e01a3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed3b expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.836523:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836540:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836552:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836565:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836569:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836574:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836689:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144660.836699:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 308 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.836705:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144660.836712:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746656896 00000100:00100000:2.0:1746144660.836717:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746656896 00010000:00010000:1.0:1746144660.836734:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 308 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.836736:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144660.836745:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 308 pid: 15388 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144660.836757:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ebc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747483648:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.836824:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5866 00000100:00100000:2.0:1746144660.836832:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746656896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.836844:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.836866:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144660.836876:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144660.836892:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136933400/0xa7c849b16e01a2ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecb6 expref: 26 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144660.837129:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.837452:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746656896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 619us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.837458:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5866 00000100:00100000:1.0:1746144660.837466:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.838658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.839078:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746657024 00000100:00100000:2.0:1746144660.839093:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746657024 00010000:00010000:2.0:1746144660.839124:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 12 pid: 8388 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.839177:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5867 00000100:00100000:2.0:1746144660.839183:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746657024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.839199:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.839219:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 12 pid: 8388 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.839230:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 12 pid: 8388 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.839250:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a21b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec54 expref: 12 pid: 8388 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.839263:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.839265:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.839271:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.839284:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.839316:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.839327:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747483776:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.840453:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.842181:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747483520:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144660.842204:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.842245:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746656512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 13974us (14445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.842254:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5865 00000100:00100000:0.0:1746144660.843637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.843689:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746657280 00000100:00100000:3.0:1746144660.843697:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746657280 00002000:00100000:3.0:1746144660.843742:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012e12c000 x1830964746657280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.843751:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12c000 with x1830964746657280 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.843756:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12c000 00000100:00100000:3.0:1746144660.843812:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4492 00000100:00100000:3.0:1746144660.843820:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+33:1962:x1830964746657280:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144660.844910:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ebc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747483648:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.844936:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144660.845049:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747483776:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144660.845063:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.845121:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:1961:x1830964746657024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5937us (6466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.845130:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5867 00000100:00100000:0.0:1746144660.846883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.846942:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746657664 00000100:00100000:1.0:1746144660.846950:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746657664 00002000:00100000:1.0:1746144660.846993:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3178496->3182591) req@ffff88012e12c380 x1830964746657664/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.847002:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12c380 with x1830964746657664 ext(3178496->3182591) 00002000:00010000:1.0:1746144660.847007:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12c380 00000100:00100000:0.0:1746144660.848002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.848218:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746657408 00000100:00100000:3.0:1746144660.848224:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746657408 00010000:00010000:3.0:1746144660.848255:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 309 pid: 15388 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.848379:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5868 00000100:00100000:3.0:1746144660.848388:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1960:x1830964746657408:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.848402:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.848408:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 309 pid: 15388 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.848420:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 309 pid: 15388 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.848441:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb00a00/0xa7c849b16e01a310 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecd2 expref: 309 pid: 15388 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.848548:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.848554:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.848564:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.848571:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.848596:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.848636:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:1960:x1830964746657408:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 249us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.848642:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5868 00000100:00100000:1.0:1746144660.848738:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4493 00000100:00100000:1.0:1746144660.848747:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746657664:12345-192.168.204.23@tcp:3:multiop.0 00010000:00010000:2.0:1746144660.848791:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848800:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144660.848847:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144660.848852:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144660.848869:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848880:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848889:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848895:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848901:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848906:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5044600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.848910:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848916:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848925:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144660.848927:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144660.848931:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848935:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044600/0xa7c849b16e01a3bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848948:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848953:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848959:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848962:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5044400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.848964:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848969:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848975:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9600) 00010000:00010000:2.0:1746144660.848977:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144660.848979:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.848983:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044400/0xa7c849b16e01a3c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.849017:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044000/0xa7c849b16e01a3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.849028:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.849035:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.849036:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144660.849038:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044800, rc 0) 00000100:00100000:2.0:1746144660.849061:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29131:x1830964746656768:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 12636us (13719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.849068:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10091 00000100:00100000:1.0:1746144660.849108:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746657664:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 361us (2227us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144660.849115:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4493 00002000:00100000:1.0:1746144660.849123:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3178496->3182591) req@ffff88012e12c380 x1830964746657664/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.849151:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12c380 with x1830964746657664 ext(3178496->3182591) 00002000:00010000:1.0:1746144660.849156:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12c380 00000100:00100000:0.0:1746144660.855304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.855332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.855592:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746657920 00000100:00100000:1.0:1746144660.855602:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746657920 00002000:00100000:1.0:1746144660.855642:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3379200->3383295) req@ffff88012e12ca80 x1830964746657920/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.855651:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ca80 with x1830964746657920 ext(3379200->3383295) 00002000:00010000:1.0:1746144660.855656:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12ca80 00000100:00100000:1.0:1746144660.855684:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4494 00000100:00100000:1.0:1746144660.855691:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746657920:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144660.855865:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658048 00000100:00100000:2.0:1746144660.855870:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658048 00000100:00100000:2.0:1746144660.855901:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11775 00000100:00100000:2.0:1746144660.855907:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1962:x1830964746658048:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.855917:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.855934:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed42 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.855955:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.855957:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.855966:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 6 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.855983:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 6 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.855993:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1000, rc 0) 00000100:00100000:3.0:1746144660.856003:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+33:1962:x1830964746657280:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12182us (12372us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.856014:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4492 00002000:00100000:3.0:1746144660.856020:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012e12c000 x1830964746657280/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.856027:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12c000 with x1830964746657280 ext(1048576->2097151) 00002000:00010000:3.0:1746144660.856030:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12c000 00000100:00100000:0.0:1746144660.856101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.856114:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658176 00000100:00100000:0.0:1746144660.856117:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658176 00000100:00100000:0.0:1746144660.856163:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11776 00000100:00100000:0.0:1746144660.856170:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746658176:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144660.856177:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.856191:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed49 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.856204:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.856205:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.856211:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144660.856221:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144660.856356:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746657920:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 665us (1063us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144660.856362:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4494 00002000:00100000:1.0:1746144660.856367:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3379200->3383295) req@ffff88012e12ca80 x1830964746657920/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.856375:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ca80 with x1830964746657920 ext(3379200->3383295) 00002000:00010000:1.0:1746144660.856377:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12ca80 00000100:00100000:1.0:1746144660.856405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.856443:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658304 00000100:00100000:3.0:1746144660.856446:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658304 00000100:00100000:3.0:1746144660.856470:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11777 00000100:00100000:3.0:1746144660.856475:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746658304:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:1.0:1746144660.856475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144660.856481:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.856488:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed50 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.856488:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658432 00000100:00100000:1.0:1746144660.856490:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658432 00010000:00010000:3.0:1746144660.856498:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.856500:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144660.856504:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11778 00010000:00010000:3.0:1746144660.856505:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144660.856508:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746658432:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.856514:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.856514:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.856520:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed57 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.856521:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdac000, rc 0) 00010000:00010000:1.0:1746144660.856529:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.856531:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144660.856536:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746658304:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 61us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144660.856536:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144660.856541:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11777 00010000:00010000:1.0:1746144660.856545:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 8 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.856556:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5045200, rc 0) 00010000:00010000:0.0:1746144660.856585:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4e00, rc 0) 00000100:00100000:0.0:1746144660.856707:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746658176:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 429us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.856714:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11776 00000100:00100000:0.0:1746144660.856759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.856771:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658560 00000100:00100000:0.0:1746144660.856774:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658560 00000100:00100000:0.0:1746144660.856787:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11779 00000100:00100000:0.0:1746144660.856791:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746658560:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144660.856797:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144660.856803:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a3f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed5e expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.856838:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747483904:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144660.856897:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.857404:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746658048:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1495us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.857410:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11775 00000100:00100000:1.0:1746144660.857630:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746658432:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 60us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.857635:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11778 00000100:00100000:0.0:1746144660.858054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.858360:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658688 00000100:00100000:1.0:1746144660.858365:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658688 00000100:00100000:1.0:1746144660.859105:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11780 00000100:00100000:1.0:1746144660.859115:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:29126:x1830964746658688:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144660.859148:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.859163:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed65 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.859191:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.859200:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.859207:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.859213:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.859214:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.859218:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [1011712->1048575] (req 1011712->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.859250:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.859262:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 12 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144660.859272:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747484032:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.859363:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.859371:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 8 pid: 7257 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144660.859378:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747484160:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.859403:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 24 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.859410:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 24 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144660.859418:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747484288:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.859434:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a12b7540 going to sleep for 11 seconds 00002000:00010000:1.0:1746144660.860684:0:8453:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144660 -> 1746144661 00002000:00010000:1.0:1746144660.860689:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144660 -> 1746144661 00002000:00010000:1.0:1746144660.860692:0:8453:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144660 -> 1746144661 00000100:00100000:1.0:1746144660.860717:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747483904:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144660.860745:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a3f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed5e expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.860757:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a3f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed5e expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.860783:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4c00, rc 0) 00000100:00100000:1.0:1746144660.860815:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746658560:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4021us (4054us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144660.860822:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11779 00000100:00100000:0.0:1746144660.866074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.866124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.866201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.866269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.866328:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747484032:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.866339:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747484160:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.866368:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659328 00000100:00100000:0.0:1746144660.866374:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659328 00010000:00010000:0.0:1746144660.866408:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 7 pid: 7257 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746144660.866432:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659200 00000100:00100000:0.0:1746144660.866434:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659200 00010000:00010000:0.0:1746144660.866444:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 13 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746144660.866464:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5869 00000100:00100000:0.0:1746144660.866471:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746659328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.866484:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.866508:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 7 pid: 7257 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.866518:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 7 pid: 7257 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.866540:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1000/0xa7c849b16e01a3d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed42 expref: 7 pid: 7257 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.866558:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.866595:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746659328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 124us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.866601:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5869 00000100:00100000:0.0:1746144660.866615:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5870 00000100:00100000:0.0:1746144660.866620:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746659200:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.866627:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.866634:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 13 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.866642:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 13 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.866657:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e865a00/0xa7c849b16e01a395 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed18 expref: 13 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.866665:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.866677:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746659200:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.866682:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5870 00000100:00100000:2.0:1746144660.866806:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746658944 00000100:00100000:2.0:1746144660.866810:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746658944 00000100:00100000:2.0:1746144660.866838:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4074 00000100:00100000:2.0:1746144660.866843:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29130:x1830964746658944:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144660.867189:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29130:x1830964746658944:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 345us (1127us total) trans 8589943978 rc 0/0 00000100:00100000:2.0:1746144660.867195:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4074 00000100:00100000:1.0:1746144660.867494:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659072 00000100:00100000:1.0:1746144660.867499:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659072 00000100:00100000:1.0:1746144660.867707:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11781 00000100:00100000:1.0:1746144660.867714:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:29128:x1830964746659072:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.867725:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.867738:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed6c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.867758:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.867766:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144660.867768:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144660.867771:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 13 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.867805:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.867816:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144660.867828:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747484416:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.867894:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.868603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.868639:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659456 00000100:00100000:3.0:1746144660.868644:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659456 00010000:00010000:3.0:1746144660.868663:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 25 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.868696:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5871 00000100:00100000:3.0:1746144660.868702:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746659456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.868711:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.868728:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 25 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.868738:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 25 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.868752:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.868754:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.868759:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.868768:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.868791:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.868799:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747484544:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144660.868812:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f124000/0xa7c849b16e01a33a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecf5 expref: 25 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746144660.868823:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747484288:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.868845:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746144660.868849:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.868857:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044a00, rc 0) 00000100:00100000:0.0:1746144660.868879:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:29126:x1830964746658688:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 9766us (10826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.868884:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11780 00000100:00100000:0.0:1746144660.870092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.870230:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659712 00000100:00100000:2.0:1746144660.870236:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659712 00000100:00100000:2.0:1746144660.870278:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10092 00000100:00100000:2.0:1746144660.870284:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29131:x1830964746659712:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.870299:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.870316:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3be00/0xa7c849b16e01a405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed73 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.870404:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.870417:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.870423:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.870444:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.870453:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 10 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.870461:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747484672:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.870513:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.871089:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747484544:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144660.871094:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747484416:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.871103:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144660.871111:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 12 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.871122:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5045000, rc 0) 00000100:00100000:3.0:1746144660.871125:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746659456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2424us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.871152:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5871 00000100:00100000:1.0:1746144660.871159:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:29128:x1830964746659072:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3446us (5035us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.871165:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11781 00000100:00100000:0.0:1746144660.872029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.872057:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747484672:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144660.872058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144660.872071:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144660.872124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.872189:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659968 00000100:00100000:2.0:1746144660.872193:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659968 00000100:00100000:3.0:1746144660.872203:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746659840 00000100:00100000:3.0:1746144660.872206:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746659840 00010000:00010000:3.0:1746144660.872219:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00002000:00100000:2.0:1746144660.872225:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3178496->3383295) req@ffff88012e12f480 x1830964746659968/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746144660.872238:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5872 00000100:00100000:3.0:1746144660.872243:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746659840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.872254:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.872259:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.872268:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.872286:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01a3cd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed3b expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.872300:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.872304:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.872311:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.872317:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.872349:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144660.872351:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660224 00000100:00100000:1.0:1746144660.872355:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660224 00002000:00100000:1.0:1746144660.872369:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (1011712->1015807) req@ffff88012e12f800 x1830964746660224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746144660.872371:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746659840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 128us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.872377:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5872 00002000:00100000:1.0:1746144660.872378:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12f800 with x1830964746660224 ext(1011712->1015807) 00002000:00010000:1.0:1746144660.872382:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12f800 00000100:00100000:1.0:1746144660.872401:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4495 00000100:00100000:1.0:1746144660.872406:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746660224:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144660.872628:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12f480 with x1830964746659968 ext(3178496->3383295) 00010000:00010000:2.0:1746144660.872635:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.872647:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 24 pid: 7257 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144660.872653:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e12f480 00010000:00010000:2.0:1746144660.872668:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.872673:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144660.872675:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 876 00000100:00100000:3.0:1746144660.872681:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746659968:12345-192.168.204.23@tcp:4:multiop.0 00000004:00200000:2.0:1746144660.872690:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144660.872818:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3be00/0xa7c849b16e01a405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.872832:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.872838:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.872840:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144660.872843:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3ba00, rc 0) 00000100:00100000:2.0:1746144660.872877:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29131:x1830964746659712:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2593us (2797us total) trans 8589943979 rc 0/0 00000100:00100000:2.0:1746144660.872883:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10092 00000100:00100000:1.0:1746144660.873215:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746660224:12345-192.168.204.23@tcp:3:cat.0 Request processed in 809us (1091us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144660.873221:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4495 00002000:00100000:1.0:1746144660.873226:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (1011712->1015807) req@ffff88012e12f800 x1830964746660224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.873233:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12f800 with x1830964746660224 ext(1011712->1015807) 00002000:00010000:1.0:1746144660.873236:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12f800 00000100:00100000:2.0:1746144660.876290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.876364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.876424:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660352 00000100:00100000:3.0:1746144660.876434:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660352 00000100:00100000:3.0:1746144660.876475:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10093 00000100:00100000:3.0:1746144660.876481:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29131:x1830964746660352:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.876504:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.876520:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad400/0xa7c849b16e01a41a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed7a expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.876598:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144660.876614:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.876614:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660480 00000100:00100000:1.0:1746144660.876618:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660480 00010000:00010000:3.0:1746144660.876622:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144660.876644:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11782 00000100:00100000:1.0:1746144660.876649:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:29126:x1830964746660480:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144660.876657:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.876659:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.876669:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed81 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.876670:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.876681:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747484800:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.876689:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.876697:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.876704:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.876710:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.876714:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.876716:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1847295] (req 1048576->1847295) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.876734:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.876742:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144660.876751:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747484928:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.876757:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746144660.876785:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.876792:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 7 pid: 8453 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144660.876800:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747485056:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.876824:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.876831:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 36 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144660.876838:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747485184:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.876853:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.879499:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747484928:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.879512:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747485056:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144660.879519:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747485184:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144660.879549:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1847295] (req 1048576->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.879565:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cfa5800, rc 0) 00000100:00100000:1.0:1746144660.879617:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+34:29126:x1830964746660480:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2966us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.879625:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11782 00000100:00100000:0.0:1746144660.879794:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747484800:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144660.879817:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144660.879882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.879900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.879929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.879947:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660736 00000100:00100000:1.0:1746144660.879952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.879954:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660736 00000100:00100000:1.0:1746144660.879969:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660992 00000100:00100000:1.0:1746144660.879971:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660992 00010000:00010000:2.0:1746144660.879979:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144660.879983:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 37 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.879999:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660608 00000100:00100000:2.0:1746144660.880001:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660608 00010000:00010000:2.0:1746144660.880011:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 12 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.881121:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746660864 00000100:00100000:3.0:1746144660.881126:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746660864 00000100:00100000:1.0:1746144660.881141:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5873 00000100:00100000:1.0:1746144660.881150:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746660736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.881156:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 8 pid: 8453 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144660.881166:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144660.881169:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5874 00000100:00100000:3.0:1746144660.881174:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746660992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.881182:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.881191:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 37 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144660.881191:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144660.881201:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 37 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:0.0:1746144660.881369:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5875 00000100:00100000:0.0:1746144660.881377:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746660608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.881388:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144660.881394:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 12 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144660.881401:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 12 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144660.881416:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a40c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed73 expref: 12 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144660.881430:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144660.881435:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.881449:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.881456:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.881473:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.881502:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746660608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.881507:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5875 00000100:00100000:0.0:1746144660.881522:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5876 00000100:00100000:0.0:1746144660.881527:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746660864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144660.881534:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.882368:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7ea400/0xa7c849b16e01a348 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed03 expref: 37 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144660.882368:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144660.882381:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144660.882392:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993ea00/0xa7c849b16e01a39c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed1f expref: 34 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.882399:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 8 pid: 8453 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.882407:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 8 pid: 8453 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144660.882414:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144660.882421:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f4e00/0xa7c849b16e01a3db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed49 expref: 8 pid: 8453 timeout: 740 lvb_type: 1 00010000:00010000:0.0:1746144660.882430:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144660.882432:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144660.882438:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746660736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1289us (2556us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144660.882438:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 33 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.882443:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5873 00010000:00010000:0.0:1746144660.882446:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 33 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.882474:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 32 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.882487:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747485312:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144660.882546:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34540 going to sleep for 11 seconds 00010000:00010000:0.0:1746144660.882570:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.882577:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144660.882622:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:0.0:1746144660.882627:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144660.882643:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144660.882671:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad400/0xa7c849b16e01a41a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.882682:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144660.882689:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144660.882691:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144660.882693:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdad600, rc 0) 00000100:00100000:0.0:1746144660.882730:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29131:x1830964746660352:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6247us (6450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.882737:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10093 00000100:00100000:3.0:1746144660.882797:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746660992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1622us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.882802:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5874 00000100:00100000:3.0:1746144660.883968:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746659968:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 11283us (11905us total) trans 17179873256 rc 0/0 00000100:00100000:3.0:1746144660.883981:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 876 00002000:00100000:3.0:1746144660.883991:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3178496->3383295) req@ffff88012e12f480 x1830964746659968/t17179873256(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.884000:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12f480 with x1830964746659968 ext(3178496->3383295) 00010000:00010000:3.0:1746144660.884008:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.884021:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144660.884027:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e12f480 00000100:00100000:0.0:1746144660.885456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.885587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.885685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.885891:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747485312:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144660.885911:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.885946:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746660864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4418us (5992us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.885955:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5876 00000100:00100000:1.0:1746144660.886478:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746661248 00000100:00100000:1.0:1746144660.886486:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746661248 00000100:00100000:1.0:1746144660.886523:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746661120 00000100:00100000:1.0:1746144660.886526:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746661120 00000100:00100000:1.0:1746144660.886539:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746661376 00000100:00100000:1.0:1746144660.886540:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746661376 00000100:00100000:1.0:1746144660.886553:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11783 00000100:00100000:1.0:1746144660.886560:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746661248:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144660.886579:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144660.886597:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e46dc00/0xa7c849b16e01a42f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed8f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144660.886649:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747485440:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144660.886699:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.886795:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11784 00000100:00100000:3.0:1746144660.886805:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746661120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.886813:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.886823:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044e00/0xa7c849b16e01a436 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed88 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.886850:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747485568:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.886876:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.886892:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11785 00000100:00100000:3.0:1746144660.886897:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746661376:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144660.886903:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.886910:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044800/0xa7c849b16e01a43d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed96 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.886939:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747485696:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.886960:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.889398:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747485440:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144660.889431:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e46dc00/0xa7c849b16e01a42f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed8f expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.889446:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e46dc00/0xa7c849b16e01a42f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed8f expref: 8 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.889460:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46dc00, rc 0) 00000100:00100000:1.0:1746144660.889499:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746661248:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2937us (4047us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144660.889506:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11783 00000100:00100000:3.0:1746144660.890318:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747485568:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.890355:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044e00/0xa7c849b16e01a436 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed88 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.890365:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044e00/0xa7c849b16e01a436 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed88 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.890373:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044e00, rc 0) 00000100:00100000:3.0:1746144660.890402:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746661120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3599us (4815us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.890408:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11784 00000100:00100000:2.0:1746144660.890624:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747485696:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.890647:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044800/0xa7c849b16e01a43d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed96 expref: 7 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.890656:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044800/0xa7c849b16e01a43d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed96 expref: 7 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.890669:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044800, rc 0) 00000100:00100000:2.0:1746144660.890708:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746661376:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3810us (5021us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.890714:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11785 00000100:00100000:0.0:1746144660.891277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.891465:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746661504 00000100:00100000:2.0:1746144660.891472:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746661504 00010000:00010000:2.0:1746144660.891501:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.891533:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5877 00000100:00100000:2.0:1746144660.891541:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746661504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.891554:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.891564:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.891575:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.891595:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e46fe00/0xa7c849b16e01a3b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3178496->3383295) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed34 expref: 26 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.891607:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.891609:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.891617:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 11 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.891625:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 11 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.891660:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 11 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.891671:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747485824:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144660.891747:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144660.893278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.893346:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746661760 00000100:00100000:3.0:1746144660.893353:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746661760 00002000:00100000:3.0:1746144660.893393:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1843200->1847295) req@ffff88012e12d880 x1830964746661760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.893402:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12d880 with x1830964746661760 ext(1843200->1847295) 00002000:00010000:3.0:1746144660.893407:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12d880 00000100:00100000:3.0:1746144660.893430:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4496 00000100:00100000:3.0:1746144660.893436:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746661760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144660.893589:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746661760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 153us (316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144660.893599:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4496 00002000:00100000:3.0:1746144660.893604:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1843200->1847295) req@ffff88012e12d880 x1830964746661760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/4536 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.893610:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12d880 with x1830964746661760 ext(1843200->1847295) 00002000:00010000:3.0:1746144660.893613:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12d880 00000100:00100000:0.0:1746144660.894490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.894708:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746662016 00000100:00100000:2.0:1746144660.894713:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746662016 00000100:00100000:2.0:1746144660.894758:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10094 00000100:00100000:2.0:1746144660.894765:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29131:x1830964746662016:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144660.894779:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.894796:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b000/0xa7c849b16e01a444 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ed9d expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.894888:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.894902:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895271:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895283:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895288:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895293:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895298:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ca3ba00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144660.895307:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895313:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895324:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.895326:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144660.895329:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895334:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3ba00/0xa7c849b16e01a44b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144660.895358:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b000/0xa7c849b16e01a444 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed9d expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.895364:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b000/0xa7c849b16e01a444 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed9d expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.895370:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3b000, rc 0) 00000100:00100000:2.0:1746144660.895415:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29131:x1830964746662016:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 649us (927us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.895420:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10094 00000100:00100000:0.0:1746144660.897027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.897043:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747485824:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144660.897051:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746662272 00000100:00100000:0.0:1746144660.897058:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746662272 00010000:00010000:2.0:1746144660.897066:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144660.897109:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4075 00000100:00100000:2.0:1746144660.897110:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746661504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5569us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144660.897116:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:29126:x1830964746662272:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144660.897119:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5877 00000100:00100000:0.0:1746144660.898031:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:29126:x1830964746662272:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 912us (1007us total) trans 8589943980 rc 0/0 00000100:00100000:0.0:1746144660.898039:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4075 00000100:00100000:0.0:1746144660.899432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.900048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.900091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.900119:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746662528 00000100:00100000:3.0:1746144660.900128:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746662528 00000100:00100000:0.0:1746144660.900232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.901213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.901233:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746663040 00000100:00100000:0.0:1746144660.901240:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746663040 00000100:00100000:3.0:1746144660.901645:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746662784 00000100:00100000:3.0:1746144660.901651:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746662784 00000100:00100000:3.0:1746144660.901677:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746662400 00000100:00100000:3.0:1746144660.901679:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746662400 00000100:00100000:3.0:1746144660.901691:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746662656 00000100:00100000:3.0:1746144660.901693:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746662656 00000100:00100000:3.0:1746144660.901719:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11786 00000100:00100000:3.0:1746144660.901726:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746662528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.901748:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.901768:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a452 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edab expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144660.901799:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4076 00000100:00100000:3.0:1746144660.901823:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747485952:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144660.901897:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11787 00000100:00100000:2.0:1746144660.901905:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746662784:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.901913:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.901923:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edb9 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.901938:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.901940:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144660.901948:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 27 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.901964:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 27 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.901974:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3be00, rc 0) 00000100:00100000:0.0:1746144660.901995:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29131:x1830964746663040:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746144660.902012:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746662784:12345-192.168.204.23@tcp:101:cat.0 Request processed in 107us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.902018:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11787 00000100:00100000:2.0:1746144660.902035:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11788 00000100:00100000:2.0:1746144660.902039:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746662400:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.902045:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.902051:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a800/0xa7c849b16e01a460 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eda4 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144660.902076:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747486080:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144660.902101:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11789 00000100:00100000:1.0:1746144660.902110:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746662656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144660.902120:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144660.902124:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d60c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144660.902151:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edb2 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144660.902168:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.902170:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144660.902178:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 39 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.902191:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 39 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144660.902200:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f22b000, rc 0) 00000100:00100000:3.0:1746144660.902227:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.902234:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746662656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 126us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144660.902240:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11789 00000100:00100000:0.0:1746144660.902453:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29131:x1830964746663040:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 647us (1247us total) trans 8589943981 rc 0/0 00000100:00100000:0.0:1746144660.902459:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4076 00000100:00100000:0.0:1746144660.902500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.902843:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746663296 00000100:00100000:1.0:1746144660.902848:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746663296 00002000:00100000:1.0:1746144660.902870:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b571180 x1830964746663296/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.902882:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571180 with x1830964746663296 ext(2097152->3145727) 00002000:00010000:1.0:1746144660.902886:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b571180 00000100:00100000:1.0:1746144660.902905:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4497 00000100:00100000:1.0:1746144660.902910:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746663296:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144660.903840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.904371:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746663552 00000100:00100000:3.0:1746144660.904381:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746663552 00002000:00100000:3.0:1746144660.904418:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b571500 x1830964746663552/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.904427:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571500 with x1830964746663552 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.904433:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b571500 00000100:00100000:3.0:1746144660.904462:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4498 00000100:00100000:3.0:1746144660.904470:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746663552:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.905206:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747486080:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144660.905241:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a800/0xa7c849b16e01a460 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eda4 expref: 27 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144660.905253:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3a800/0xa7c849b16e01a460 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eda4 expref: 27 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144660.906385:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747485952:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.906434:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a452 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edab expref: 38 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.906446:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a452 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edab expref: 38 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.906462:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb6000, rc 0) 00000100:00100000:3.0:1746144660.906515:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746662528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4787us (7084us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.906525:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11786 00010000:00010000:2.0:1746144660.906654:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a800, rc 0) 00000100:00100000:2.0:1746144660.906690:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746662400:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4649us (6608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144660.906697:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11788 00000100:00100000:0.0:1746144660.913913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.914292:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746663552:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9821us (10451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144660.914303:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4498 00002000:00100000:3.0:1746144660.914316:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b571500 x1830964746663552/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144660.914325:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571500 with x1830964746663552 ext(3145728->4194303) 00002000:00010000:3.0:1746144660.914332:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b571500 00000100:00100000:2.0:1746144660.914406:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746663680 00000100:00100000:2.0:1746144660.914417:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746663680 00000100:00100000:2.0:1746144660.914456:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11790 00000100:00100000:2.0:1746144660.914464:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29135:x1830964746663680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144660.914480:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144660.914499:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edc0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.914531:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.914540:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.914541:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144660.914544:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.914575:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.914587:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144660.914603:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486208:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.914660:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.914779:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746663296:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11866us (12277us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144660.914788:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4497 00002000:00100000:1.0:1746144660.914793:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b571180 x1830964746663296/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.914801:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571180 with x1830964746663296 ext(2097152->3145727) 00002000:00010000:1.0:1746144660.914804:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b571180 00000100:00100000:2.0:1746144660.917634:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486208:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144660.917670:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144660.917808:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3bc00, rc 0) 00000100:00100000:2.0:1746144660.917876:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29135:x1830964746663680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3411us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.917885:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11790 00000100:00100000:0.0:1746144660.918057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.918130:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746663808 00000100:00100000:1.0:1746144660.918163:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746663808 00002000:00100000:1.0:1746144660.918201:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (1011712->1048575) req@ffff88012b571c00 x1830964746663808/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.918210:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571c00 with x1830964746663808 ext(1011712->1048575) 00010000:00010000:1.0:1746144660.918216:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 12 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144660.918228:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 12 pid: 4758 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144660.918238:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b571c00 00000100:00100000:1.0:1746144660.918416:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 877 00000100:00100000:1.0:1746144660.918424:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746663808:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144660.921587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.921753:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746663936 00000100:00100000:3.0:1746144660.921763:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746663936 00000100:00100000:3.0:1746144660.921807:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11791 00000100:00100000:3.0:1746144660.921814:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746663936:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.921833:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.921851:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bb6600/0xa7c849b16e01a475 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edc7 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.921901:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486336:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144660.921975:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144660.922475:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746663808:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4049us (4416us total) trans 17179873257 rc 0/0 00000100:00100000:1.0:1746144660.922484:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 877 00002000:00100000:1.0:1746144660.922493:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (1011712->1048575) req@ffff88012b571c00 x1830964746663808/t17179873257(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.922502:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571c00 with x1830964746663808 ext(1011712->1048575) 00010000:00010000:1.0:1746144660.922509:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 16 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144660.922521:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 16 pid: 4758 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144660.922527:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b571c00 00000100:00100000:0.0:1746144660.923916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144660.924050:0:29370:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88009ee08e00 x1830964747486336) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 15 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.924091:0:29370:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 15 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.924115:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044a00/0xa7c849b16e01a3f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1011712->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed65 expref: 15 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.924163:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486336:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144660.924197:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.924199:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.924206:0:29370:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.924215:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.924245:0:29370:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.924261:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486464:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144660.924325:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.924367:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746664064 00000100:00100000:2.0:1746144660.924373:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746664064 00000100:00100000:2.0:1746144660.924419:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 633 00000100:00100000:2.0:1746144660.924425:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746664064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.924437:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.924439:0:16008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a7c849b16e01a3f7) 00010000:00010000:2.0:1746144660.924441:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.924458:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746664064:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 33us (545us total) trans 0 rc 116/116 00000100:00100000:2.0:1746144660.924464:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 633 00000100:00100000:3.0:1746144660.926542:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486464:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144660.926588:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bb6600/0xa7c849b16e01a475 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc7 expref: 14 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.926603:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bb6600/0xa7c849b16e01a475 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc7 expref: 14 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.926613:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb6600, rc 0) 00000100:00100000:3.0:1746144660.926646:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746663936:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4832us (5072us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144660.926653:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11791 00000100:00100000:0.0:1746144660.930379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.930434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.930504:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746664320 00000100:00100000:1.0:1746144660.930515:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746664320 00002000:00100000:1.0:1746144660.930564:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b572300 x1830964746664320/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.930575:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572300 with x1830964746664320 ext(0->1048575) 00002000:00010000:1.0:1746144660.930581:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572300 00000100:00100000:1.0:1746144660.930599:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746664576 00000100:00100000:1.0:1746144660.930603:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746664576 00002000:00100000:1.0:1746144660.930614:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b572680 x1830964746664576/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.930620:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572680 with x1830964746664576 ext(4194304->4935679) 00002000:00010000:1.0:1746144660.930624:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572680 00000100:00100000:1.0:1746144660.932220:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4499 00000100:00100000:1.0:1746144660.932234:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746664320:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144660.932721:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4500 00000100:00100000:0.0:1746144660.932731:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746664576:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.943655:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746664576:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10902us (13195us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144660.943668:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4500 00002000:00100000:2.0:1746144660.943682:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b572680 x1830964746664576/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.943691:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572680 with x1830964746664576 ext(4194304->4935679) 00002000:00010000:2.0:1746144660.943698:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572680 00000100:00100000:1.0:1746144660.946555:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746664320:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14315us (16179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144660.946567:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4499 00002000:00100000:1.0:1746144660.946579:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b572300 x1830964746664320/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.946588:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572300 with x1830964746664320 ext(0->1048575) 00002000:00010000:1.0:1746144660.946593:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572300 00000100:00100000:0.0:1746144660.948477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.949074:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746664704 00000100:00100000:3.0:1746144660.949095:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746664704 00000100:00100000:3.0:1746144660.949217:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11792 00000100:00100000:3.0:1746144660.949226:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746664704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.949247:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.949268:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edce expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.949294:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.949296:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.949307:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 14 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.949329:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 14 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144660.949340:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb6400, rc 0) 00000100:00100000:3.0:1746144660.949673:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746664704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 446us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.949679:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11792 00000100:00100000:0.0:1746144660.953262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.953492:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746664832 00000100:00100000:3.0:1746144660.953502:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746664832 00000100:00100000:3.0:1746144660.953558:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11793 00000100:00100000:3.0:1746144660.953566:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29135:x1830964746664832:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144660.953590:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.953611:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edd5 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.953643:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 32 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.953651:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144660.953652:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144660.953655:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 38 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.953687:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 32 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.953703:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 32 pid: 8453 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.953716:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747486592:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.953820:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.958737:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747486592:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144660.958798:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 38 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.958817:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb6000, rc 0) 00000100:00100000:3.0:1746144660.958870:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:29135:x1830964746664832:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5303us (5617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.958880:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11793 00000100:00100000:0.0:1746144660.961540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.961726:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746664960 00000100:00100000:1.0:1746144660.961735:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746664960 00002000:00100000:1.0:1746144660.961783:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1847295) req@ffff88012b573100 x1830964746664960/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.961793:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573100 with x1830964746664960 ext(1048576->1847295) 00010000:00010000:1.0:1746144660.961801:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 33 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144660.961815:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 33 pid: 8453 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144660.961826:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b573100 00000100:00100000:1.0:1746144660.961856:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 878 00000100:00100000:1.0:1746144660.961863:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746664960:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144660.967904:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746664960:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6029us (6362us total) trans 21474840501 rc 0/0 00000100:00100000:1.0:1746144660.967916:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 878 00002000:00100000:1.0:1746144660.967929:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1847295) req@ffff88012b573100 x1830964746664960/t21474840501(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:301/0 lens 488/448 e 0 to 0 dl 1746144671 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.967939:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573100 with x1830964746664960 ext(1048576->1847295) 00010000:00010000:1.0:1746144660.967949:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 35 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144660.967964:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 35 pid: 8453 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144660.967971:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b573100 00000100:00100000:0.0:1746144660.975239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.975616:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746665088 00000100:00100000:3.0:1746144660.975628:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746665088 00010000:00010000:3.0:1746144660.975672:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 35 pid: 8453 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.975716:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5878 00000100:00100000:3.0:1746144660.975725:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746665088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144660.975742:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144660.975768:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 35 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.975785:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 35 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.975809:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cfa5800/0xa7c849b16e01a428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1847295) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed81 expref: 35 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.976272:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.976275:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144660.976284:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.976293:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.976332:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144660.976345:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747486720:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144660.976441:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144660.979487:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747486720:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144660.979521:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144660.979889:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746665088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4163us (4659us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144660.979901:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5878 00000100:00100000:0.0:1746144660.981955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144660.982003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144660.982278:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746665344 00000100:00100000:1.0:1746144660.982287:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746665344 00000100:00100000:2.0:1746144660.982321:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746665472 00000100:00100000:2.0:1746144660.982326:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746665472 00002000:00100000:1.0:1746144660.982334:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012b573800 x1830964746665344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144660.982344:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573800 with x1830964746665344 ext(1048576->2097151) 00002000:00100000:2.0:1746144660.982345:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b573b80 x1830964746665472/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/0 e 0 to 0 dl 1746144671 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746144660.982349:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b573800 00002000:00100000:2.0:1746144660.982353:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573b80 with x1830964746665472 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.982357:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b573b80 00000100:00100000:1.0:1746144660.982368:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4501 00000100:00100000:1.0:1746144660.982375:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746665344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144660.982378:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4502 00000100:00100000:2.0:1746144660.982384:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746665472:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144660.989059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144660.989167:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746665856 00000100:00100000:3.0:1746144660.989183:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746665856 00000100:00100000:3.0:1746144660.989296:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10095 00000100:00100000:3.0:1746144660.989305:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29140:x1830964746665856:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144660.989331:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144660.989352:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb6600/0xa7c849b16e01a48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eddc expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.989463:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.989479:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.989486:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.989518:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.989530:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 10 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144660.989542:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747486848:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144660.989634:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144660.992620:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746665472:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10220us (10601us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144660.992634:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4502 00002000:00100000:2.0:1746144660.992647:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b573b80 x1830964746665472/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.992656:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573b80 with x1830964746665472 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.992662:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b573b80 00000100:00100000:0.0:1746144660.992987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144660.993046:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746665984 00000100:00100000:3.0:1746144660.993051:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747486848:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144660.993052:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746665984 00010000:00010000:2.0:1746144660.993077:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144660.993098:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144660.993113:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5879 00000100:00100000:2.0:1746144660.993121:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746665984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144660.993153:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144660.993160:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.993171:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.993192:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdad600/0xa7c849b16e01a421 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed7a expref: 11 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144660.993220:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144660.993225:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.993233:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.993240:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144660.993256:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144660.993287:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746665984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 166us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144660.993293:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5879 00010000:00010000:3.0:1746144660.993383:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144660.993390:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144660.993410:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144660.993548:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bb6600/0xa7c849b16e01a48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 312 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.993563:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 311 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144660.993570:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144660.993573:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144660.993575:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e46fe00, rc 0) 00000100:00100000:3.0:1746144660.993607:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29140:x1830964746665856:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4303us (4560us total) trans 8589943982 rc 0/0 00000100:00100000:3.0:1746144660.993613:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10095 00000100:00100000:2.0:1746144660.994839:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746665344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12457us (12885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144660.994847:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4501 00002000:00100000:2.0:1746144660.994856:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012b573800 x1830964746665344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:301/0 lens 488/440 e 0 to 0 dl 1746144671 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144660.994865:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573800 with x1830964746665344 ext(1048576->2097151) 00002000:00010000:2.0:1746144660.994869:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b573800 00000100:00100000:0.0:1746144661.001986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.003277:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746666112 00000100:00100000:3.0:1746144661.003289:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746666112 00000100:00100000:3.0:1746144661.003339:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11794 00000100:00100000:3.0:1746144661.003347:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29140:x1830964746666112:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144661.003368:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.003387:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ede3 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.003418:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.003432:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 5 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.003439:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.003446:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.003448:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.003452:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1761280->1867775] (req 1761280->1867775) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.003484:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.003495:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 28 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144661.003507:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486976:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.004245:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 5 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.004255:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 5 pid: 4758 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144661.004263:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747487104:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.005858:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 13 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.005872:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.005884:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747487232:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.005919:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.006927:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747486976:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144661.009819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.009852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.009883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.009904:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746666624 00000100:00100000:2.0:1746144661.009915:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746666624 00000100:00100000:1.0:1746144661.009941:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746666240 00000100:00100000:1.0:1746144661.009948:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746666240 00002000:00100000:2.0:1746144661.009955:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092934000 x1830964746666624/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.009964:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934000 with x1830964746666624 ext(3145728->4194303) 00002000:00010000:2.0:1746144661.009969:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092934000 00010000:00010000:1.0:1746144661.009978:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 30 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.009989:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746666496 00000100:00100000:2.0:1746144661.009992:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746666496 00002000:00100000:2.0:1746144661.010000:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092936a00 x1830964746666496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.010005:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936a00 with x1830964746666496 ext(2097152->3145727) 00002000:00010000:2.0:1746144661.010007:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092936a00 00000100:00100000:2.0:1746144661.010025:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4503 00000100:00100000:2.0:1746144661.010031:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746666624:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144661.010163:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4504 00000100:00100000:3.0:1746144661.010173:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746666496:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.010387:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5880 00000100:00100000:1.0:1746144661.010393:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746666240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144661.010408:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144661.010425:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 31 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144661.010521:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 31 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144661.010545:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cfa5e00/0xa7c849b16e01a333 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecee expref: 31 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144661.010565:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.010607:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746666240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 213us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.010613:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5880 00000100:00100000:2.0:1746144661.011868:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747487104:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.011880:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747487232:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.011922:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1761280->1867775] (req 1761280->1867775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.011937:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1400, rc 0) 00000100:00100000:2.0:1746144661.012001:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29140:x1830964746666112:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8653us (10024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.012009:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11794 00000100:00100000:1.0:1746144661.012878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.012903:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746666880 00000100:00100000:0.0:1746144661.012909:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746666880 00010000:00010000:0.0:1746144661.012936:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 14 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.012952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.012966:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746667008 00000100:00100000:1.0:1746144661.012969:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746667008 00010000:00010000:1.0:1746144661.012991:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 6 pid: 4758 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144661.013018:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5881 00000100:00100000:1.0:1746144661.013024:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746667008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144661.013038:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144661.013057:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 6 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144661.013066:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 6 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144661.013094:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5045200/0xa7c849b16e01a3e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed57 expref: 6 pid: 4758 timeout: 740 lvb_type: 1 00010000:00010000:1.0:1746144661.013109:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144661.013119:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5882 00000100:00100000:0.0:1746144661.013125:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746666880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144661.013131:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1960:x1830964746667008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 107us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144661.013148:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144661.013153:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5881 00010000:00010000:0.0:1746144661.013158:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 14 pid: 4758 timeout: 740 lvb_type: 0 00000100:00080000:1.0:1746144661.013169:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746144661.013171:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 14 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144661.013184:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136932c00/0xa7c849b16e01a2fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ecc4 expref: 14 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144661.013202:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.013205:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.013213:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.013221:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.013253:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.013264:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747487360:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144661.013330:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.019045:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f435180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747487360:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.019072:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.019767:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746666880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6640us (6892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.019778:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5882 00000100:00100000:0.0:1746144661.020745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.021096:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746667264 00000100:00100000:2.0:1746144661.021103:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746667264 00000100:00100000:1.0:1746144661.021661:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746666624:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11628us (11849us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.021669:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4503 00002000:00100000:1.0:1746144661.021677:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092934000 x1830964746666624/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.021685:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934000 with x1830964746666624 ext(3145728->4194303) 00002000:00010000:1.0:1746144661.021690:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092934000 00000100:00100000:3.0:1746144661.021694:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746666496:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11523us (11840us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.021701:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4504 00002000:00100000:3.0:1746144661.021705:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092936a00 x1830964746666496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.021712:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936a00 with x1830964746666496 ext(2097152->3145727) 00002000:00010000:3.0:1746144661.021714:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092936a00 00002000:00100000:2.0:1746144661.021756:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1761280->1765375) req@ffff88009f436d80 x1830964746667264/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.021763:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f436d80 with x1830964746667264 ext(1761280->1765375) 00002000:00010000:2.0:1746144661.021766:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f436d80 00000100:00100000:2.0:1746144661.021791:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4505 00000100:00100000:2.0:1746144661.021799:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746667264:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144661.021945:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746667264:12345-192.168.204.23@tcp:3:cat.0 Request processed in 147us (1201us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144661.021952:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4505 00002000:00100000:2.0:1746144661.021956:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1761280->1765375) req@ffff88009f436d80 x1830964746667264/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.021962:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f436d80 with x1830964746667264 ext(1761280->1765375) 00002000:00010000:2.0:1746144661.021965:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f436d80 00000100:00100000:0.0:1746144661.028818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.028916:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746667520 00000100:00100000:3.0:1746144661.028926:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746667520 00002000:00100000:3.0:1746144661.028974:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1863680->1867775) req@ffff88009f434a80 x1830964746667520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.028984:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434a80 with x1830964746667520 ext(1863680->1867775) 00002000:00010000:3.0:1746144661.028990:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f434a80 00000100:00100000:3.0:1746144661.029023:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4506 00000100:00100000:3.0:1746144661.029031:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746667520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144661.029266:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746667520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 236us (458us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144661.029274:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4506 00002000:00100000:3.0:1746144661.029280:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1863680->1867775) req@ffff88009f434a80 x1830964746667520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.029286:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434a80 with x1830964746667520 ext(1863680->1867775) 00002000:00010000:3.0:1746144661.029289:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f434a80 00000100:00100000:0.0:1746144661.032418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.032545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.032627:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746667776 00000100:00100000:2.0:1746144661.032641:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746667776 00002000:00100000:2.0:1746144661.032687:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f435180 x1830964746667776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.032697:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435180 with x1830964746667776 ext(4194304->4935679) 00002000:00010000:2.0:1746144661.032703:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435180 00000100:00100000:2.0:1746144661.032722:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4507 00000100:00100000:2.0:1746144661.032728:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746667776:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144661.033118:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668032 00000100:00100000:3.0:1746144661.033126:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668032 00000100:00100000:3.0:1746144661.033173:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10096 00000100:00100000:3.0:1746144661.033371:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+21:29142:x1830964746668032:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144661.033391:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.033413:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010a00/0xa7c849b16e01a4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edea expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.033594:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.033607:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.033618:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.033767:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.033778:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.033784:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034092:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011000/0xa7c849b16e01a4bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034101:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011000/0xa7c849b16e01a4bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034107:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011000/0xa7c849b16e01a4bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144661.034116:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144661.034228:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034234:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034239:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034245:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f010c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.034248:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034254:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034262:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144661.034265:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.034269:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034274:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010c00/0xa7c849b16e01a4ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034299:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034304:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034308:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034311:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f010e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.034313:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034317:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034322:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639200) 00010000:00010000:3.0:1746144661.034324:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.034326:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034330:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010e00/0xa7c849b16e01a4b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.034368:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f010a00/0xa7c849b16e01a4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edea expref: 24 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.034383:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011000/0xa7c849b16e01a4bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edea expref: 23 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.034388:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.034390:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144661.034392:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f011000, rc 0) 00000100:00100000:3.0:1746144661.034456:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:29142:x1830964746668032:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1276us (1910us total) trans 8589943983 rc 0/0 00000100:00100000:3.0:1746144661.034462:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10096 00000100:00100000:0.0:1746144661.038765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.038836:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668160 00000100:00100000:2.0:1746144661.038846:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668160 00000100:00100000:2.0:1746144661.038885:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11795 00000100:00100000:2.0:1746144661.038892:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+34:29142:x1830964746668160:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.038911:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.038927:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edf1 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.038957:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.038966:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 6 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.038973:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 37 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.038980:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.038981:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.038985:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2539520->2605055] (req 2539520->2605055) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.039022:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 37 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.039035:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 37 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.039047:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747487488:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.039573:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 6 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.039582:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 6 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.039589:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747487616:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.039614:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.039620:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.039627:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747487744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.039639:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.041002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.041661:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746667776:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8931us (9742us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144661.041673:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4507 00002000:00100000:3.0:1746144661.041683:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f435180 x1830964746667776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.041692:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435180 with x1830964746667776 ext(4194304->4935679) 00002000:00010000:3.0:1746144661.041697:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435180 00000100:00100000:2.0:1746144661.041777:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668288 00000100:00100000:2.0:1746144661.041784:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668288 00000100:00100000:2.0:1746144661.041828:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 634 00000100:00100000:2.0:1746144661.041833:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746668288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.041846:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.041868:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011000/0xa7c849b16e01a4bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edea expref: 23 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.041884:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.041888:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.041902:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746668288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 70us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.041908:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 634 00000100:00100000:0.0:1746144661.046065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.046066:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747487488:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.046076:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747487616:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.046094:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747487744:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144661.046108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144661.046130:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2539520->2605055] (req 2539520->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 35 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.046154:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144661.046168:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb27e00, rc 0) 00000100:00100000:2.0:1746144661.046220:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+35:29142:x1830964746668160:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7326us (7462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.046229:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11795 00000100:00100000:2.0:1746144661.046257:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668416 00000100:00100000:2.0:1746144661.046263:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668416 00000100:00100000:2.0:1746144661.046297:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11796 00000100:00100000:2.0:1746144661.046302:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746668416:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.046320:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.046334:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb27000/0xa7c849b16e01a4d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edf8 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.046351:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.046359:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb27000/0xa7c849b16e01a4d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf8 expref: 39 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.046367:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb27000/0xa7c849b16e01a4d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf8 expref: 39 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.046377:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb27000, rc 0) 00000100:00100000:2.0:1746144661.046390:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746668416:12345-192.168.204.23@tcp:101:cat.0 Request processed in 88us (337us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.046395:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11796 00000100:00100000:2.0:1746144661.046437:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668672 00000100:00100000:2.0:1746144661.046440:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668672 00010000:00010000:2.0:1746144661.046451:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 38 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.046465:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668544 00000100:00100000:2.0:1746144661.046466:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668544 00010000:00010000:2.0:1746144661.046480:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 7 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.046491:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5883 00000100:00100000:2.0:1746144661.046495:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746668672:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.046506:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.046527:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 38 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.046536:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 38 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.046550:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e865000/0xa7c849b16e01a181 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebe4 expref: 38 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.046557:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.046571:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746668672:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 76us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.046576:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5883 00000100:00100000:2.0:1746144661.046607:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5884 00000100:00100000:2.0:1746144661.046611:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746668544:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.046616:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.046621:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 7 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.046629:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 7 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.046638:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f70a000/0xa7c849b16e01a20d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec46 expref: 7 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.046649:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.046660:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746668544:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 49us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.046664:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5884 00000100:00080000:2.0:1746144661.046676:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144661.048693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.048916:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668800 00000100:00100000:3.0:1746144661.048925:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668800 00010000:00010000:3.0:1746144661.048960:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.049184:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5885 00000100:00100000:3.0:1746144661.049192:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746668800:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.049207:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.049231:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.049243:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.049263:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a0fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb90 expref: 35 pid: 7257 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.049451:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.049453:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.049460:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.049467:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.049499:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.049510:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747487872:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.049581:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.049774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.049843:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746668928 00000100:00100000:3.0:1746144661.049847:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746668928 00000100:00100000:3.0:1746144661.049908:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11797 00000100:00100000:3.0:1746144661.049913:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746668928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.049928:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.049939:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152edff expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.049973:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747488000:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144661.050313:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21280c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746144661.051701:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144660 -> 1746144661 00002000:00010000:3.0:1746144661.051706:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144660 -> 1746144661 00002000:00010000:3.0:1746144661.051708:0:8388:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144660 -> 1746144661 00000100:00100000:3.0:1746144661.051726:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747488000:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144661.051748:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4d7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edff expref: 38 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.051759:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edff expref: 38 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.051767:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f011800, rc 0) 00000100:00100000:2.0:1746144661.051940:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747487872:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.051967:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.052018:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746668928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2103us (2244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.052018:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+34:1962:x1830964746668800:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2828us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.052025:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11797 00000100:00100000:2.0:1746144661.052026:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5885 00000100:00100000:0.0:1746144661.052494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.052561:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746669184 00000100:00100000:3.0:1746144661.052566:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746669184 00002000:00100000:3.0:1746144661.052598:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2539520->2543615) req@ffff88012e12e300 x1830964746669184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.052607:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12e300 with x1830964746669184 ext(2539520->2543615) 00002000:00010000:3.0:1746144661.052612:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12e300 00000100:00100000:3.0:1746144661.052681:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4508 00000100:00100000:3.0:1746144661.052689:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746669184:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.052836:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746669184:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 147us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144661.052842:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4508 00002000:00100000:3.0:1746144661.052847:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2539520->2543615) req@ffff88012e12e300 x1830964746669184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.052854:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12e300 with x1830964746669184 ext(2539520->2543615) 00002000:00010000:3.0:1746144661.052857:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12e300 00000100:00100000:0.0:1746144661.054876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.055006:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746669440 00000100:00100000:3.0:1746144661.055011:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746669440 00002000:00100000:3.0:1746144661.055033:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2600960->2605055) req@ffff88012e12c700 x1830964746669440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.055041:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12c700 with x1830964746669440 ext(2600960->2605055) 00002000:00010000:3.0:1746144661.055045:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12c700 00000100:00100000:3.0:1746144661.055055:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4509 00000100:00100000:3.0:1746144661.055060:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746669440:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.055237:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746669440:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 176us (364us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144661.055243:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4509 00002000:00100000:3.0:1746144661.055248:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2600960->2605055) req@ffff88012e12c700 x1830964746669440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.055254:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12c700 with x1830964746669440 ext(2600960->2605055) 00002000:00010000:3.0:1746144661.055257:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12c700 00000100:00100000:0.0:1746144661.056482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.056656:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746669696 00000100:00100000:2.0:1746144661.056662:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746669696 00000100:00100000:2.0:1746144661.056702:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4077 00000100:00100000:2.0:1746144661.056708:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:29142:x1830964746669696:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144661.056911:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:29142:x1830964746669696:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 203us (430us total) trans 8589943984 rc 0/0 00000100:00100000:2.0:1746144661.056917:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4077 00000100:00100000:0.0:1746144661.067893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.067964:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746669952 00000100:00100000:3.0:1746144661.067974:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746669952 00000100:00100000:3.0:1746144661.068016:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10097 00000100:00100000:3.0:1746144661.068024:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:29148:x1830964746669952:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.068063:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.068089:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011e00/0xa7c849b16e01a4de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee06 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.068222:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068234:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068244:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068256:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068261:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068266:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068363:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011a00/0xa7c849b16e01a4f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068371:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011a00/0xa7c849b16e01a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068375:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011a00/0xa7c849b16e01a4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144661.068385:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144661.068467:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068472:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068478:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068482:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f011800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.068485:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068490:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068498:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144661.068501:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.068504:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068508:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011800/0xa7c849b16e01a4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068534:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068538:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068541:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068549:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f011c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.068551:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068555:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068559:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f639200) 00010000:00010000:3.0:1746144661.068561:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.068562:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068565:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011c00/0xa7c849b16e01a4ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.068598:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011e00/0xa7c849b16e01a4de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee06 expref: 26 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.068606:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011a00/0xa7c849b16e01a4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee06 expref: 25 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.068611:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.068612:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144661.068615:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f011a00, rc 0) 00000100:00100000:3.0:1746144661.068659:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:29148:x1830964746669952:12345-192.168.204.23@tcp:101:cat.0 Request processed in 636us (775us total) trans 8589943985 rc 0/0 00000100:00100000:3.0:1746144661.068665:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10097 00000100:00100000:0.0:1746144661.071415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.071921:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.071983:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746670208 00000100:00100000:2.0:1746144661.071992:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746670208 00000100:00100000:2.0:1746144661.072027:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4078 00000100:00100000:2.0:1746144661.072034:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:29148:x1830964746670208:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144661.072289:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746670336 00000100:00100000:3.0:1746144661.072293:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746670336 00000100:00100000:3.0:1746144661.072319:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 635 00000100:00100000:3.0:1746144661.072323:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746670336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.072332:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.072353:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f011a00/0xa7c849b16e01a4f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee06 expref: 26 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.072769:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:29148:x1830964746670208:12345-192.168.204.23@tcp:35:cat.0 Request processed in 734us (1362us total) trans 8589943986 rc 0/0 00000100:00100000:2.0:1746144661.072778:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4078 00010000:00010000:3.0:1746144661.072919:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.072924:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.072942:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746670336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 618us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.072947:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 635 00000100:00100000:0.0:1746144661.078894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.078993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.079037:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746670464 00000100:00100000:0.0:1746144661.079046:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746670464 00000100:00100000:0.0:1746144661.079098:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746670592 00000100:00100000:0.0:1746144661.079100:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746670592 00000100:00100000:0.0:1746144661.079119:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11798 00000100:00100000:0.0:1746144661.079126:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746670464:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144661.079163:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144661.079183:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee0d expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.079207:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.079209:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.079218:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 35 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144661.079235:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 35 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144661.079251:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5000, rc 0) 00000100:00100000:0.0:1746144661.079295:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746670464:12345-192.168.204.23@tcp:101:cat.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144661.079300:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11798 00000100:00100000:0.0:1746144661.079314:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11799 00000100:00100000:0.0:1746144661.079318:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746670592:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144661.079324:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144661.079333:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a508 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee14 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.079371:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488128:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144661.079420:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34840 going to sleep for 11 seconds 00002000:00010000:2.0:1746144661.081356:0:29370:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746144660 -> 1746144661 00002000:00010000:2.0:1746144661.081363:0:29370:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746144660 -> 1746144661 00000100:00100000:2.0:1746144661.081388:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488128:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.081428:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a508 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee14 expref: 14 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.081440:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f4c00/0xa7c849b16e01a508 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee14 expref: 14 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.081485:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f4c00, rc 0) 00000100:00100000:2.0:1746144661.082068:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746670592:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2746us (3071us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.082075:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11799 00000100:00100000:0.0:1746144661.087224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.087270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.087328:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746670976 00000100:00100000:3.0:1746144661.087339:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746670976 00002000:00100000:3.0:1746144661.087395:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0f800 x1830964746670976/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.087406:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f800 with x1830964746670976 ext(1048576->2097151) 00002000:00010000:3.0:1746144661.087412:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0f800 00000100:00100000:3.0:1746144661.087434:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746671104 00000100:00100000:3.0:1746144661.087436:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746671104 00002000:00100000:3.0:1746144661.087448:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0e300 x1830964746671104/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.087454:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e300 with x1830964746671104 ext(0->1048575) 00002000:00010000:3.0:1746144661.087457:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0e300 00000100:00100000:3.0:1746144661.087468:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4510 00000100:00100000:3.0:1746144661.087474:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746670976:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.088771:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4511 00000100:00100000:1.0:1746144661.088780:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746671104:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144661.098161:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746670976:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10647us (10908us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.098174:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4510 00002000:00100000:3.0:1746144661.098186:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0f800 x1830964746670976/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.098195:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f800 with x1830964746670976 ext(1048576->2097151) 00002000:00010000:3.0:1746144661.098201:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0f800 00000100:00100000:1.0:1746144661.102806:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746671104:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14012us (15519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.102820:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4511 00002000:00100000:1.0:1746144661.102832:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0e300 x1830964746671104/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.102841:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e300 with x1830964746671104 ext(0->1048575) 00002000:00010000:1.0:1746144661.102847:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0e300 00000100:00100000:0.0:1746144661.110001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.110127:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746671232 00000100:00100000:2.0:1746144661.110163:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746671232 00000100:00100000:2.0:1746144661.110218:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11800 00000100:00100000:2.0:1746144661.110226:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:29148:x1830964746671232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.110248:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.110267:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee1b expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.110298:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.110310:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144661.110311:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144661.110314:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.110342:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.110354:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 26 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.110366:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488256:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.111402:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.112175:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488256:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.112201:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.112216:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb27a00, rc 0) 00000100:00100000:2.0:1746144661.112248:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:29148:x1830964746671232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2023us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.112257:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11800 00000100:00100000:0.0:1746144661.113423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.113606:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746671360 00000100:00100000:1.0:1746144661.113615:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746671360 00002000:00100000:1.0:1746144661.113660:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1761280->1867775) req@ffff88009ea0c380 x1830964746671360/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.113670:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c380 with x1830964746671360 ext(1761280->1867775) 00010000:00010000:1.0:1746144661.113678:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 27 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.113692:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 27 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144661.113698:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0c380 00000100:00100000:1.0:1746144661.113724:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 879 00000100:00100000:1.0:1746144661.113731:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746671360:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144661.116768:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746671360:12345-192.168.204.23@tcp:4:cat.0 Request processed in 3023us (3337us total) trans 17179873258 rc 0/0 00000100:00100000:1.0:1746144661.116785:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 879 00002000:00100000:1.0:1746144661.116797:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1761280->1867775) req@ffff88009ea0c380 x1830964746671360/t17179873258(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.116807:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c380 with x1830964746671360 ext(1761280->1867775) 00010000:00010000:1.0:1746144661.116816:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.116833:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144661.116839:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0c380 00000100:00100000:0.0:1746144661.119120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.119463:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746671488 00000100:00100000:3.0:1746144661.119472:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746671488 00010000:00010000:3.0:1746144661.119510:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.119546:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5886 00000100:00100000:3.0:1746144661.119553:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746671488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.119567:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.119590:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.119601:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.119622:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e2c1400/0xa7c849b16e01a49f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->1867775) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ede3 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.119646:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.119647:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.119656:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 13 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.119668:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 13 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.119699:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 13 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.119715:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747488384:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.120014:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.123837:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747488384:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.123861:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.123916:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746671488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4362us (4803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.123927:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5886 00000100:00100000:0.0:1746144661.124594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.124703:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746671744 00000100:00100000:1.0:1746144661.124710:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746671744 00002000:00100000:1.0:1746144661.124751:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092879f80 x1830964746671744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.124760:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879f80 with x1830964746671744 ext(1048576->2097151) 00002000:00010000:1.0:1746144661.124765:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879f80 00000100:00100000:1.0:1746144661.125545:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4512 00000100:00100000:1.0:1746144661.125554:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746671744:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.135128:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746671744:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9561us (10521us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.135151:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4512 00002000:00100000:1.0:1746144661.135163:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092879f80 x1830964746671744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.135179:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879f80 with x1830964746671744 ext(1048576->2097151) 00002000:00010000:1.0:1746144661.135186:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879f80 00000100:00100000:0.0:1746144661.152893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.153047:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672256 00000100:00100000:1.0:1746144661.153057:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672256 00002000:00100000:1.0:1746144661.153120:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3211264->4194303) req@ffff88009287b800 x1830964746672256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.153130:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b800 with x1830964746672256 ext(3211264->4194303) 00002000:00010000:1.0:1746144661.153170:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287b800 00000100:00100000:1.0:1746144661.153202:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4513 00000100:00100000:1.0:1746144661.153210:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+35:1963:x1830964746672256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.155502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.157419:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672000 00000100:00100000:3.0:1746144661.157432:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672000 00002000:00100000:3.0:1746144661.157483:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3211263) req@ffff88009287b480 x1830964746672000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 504/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.157493:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b480 with x1830964746672000 ext(2097152->3211263) 00002000:00010000:3.0:1746144661.157499:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287b480 00000100:00100000:3.0:1746144661.157528:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4514 00000100:00100000:3.0:1746144661.157536:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+37:1962:x1830964746672000:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.167437:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+37:1963:x1830964746672256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14213us (14539us total) trans 0 rc 983040/983040 00000100:00100000:1.0:1746144661.167451:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4513 00002000:00100000:1.0:1746144661.167466:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3211264->4194303) req@ffff88009287b800 x1830964746672256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.167475:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b800 with x1830964746672256 ext(3211264->4194303) 00002000:00010000:1.0:1746144661.167482:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287b800 00000100:00100000:3.0:1746144661.185740:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746672000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 28192us (30234us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.185757:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4514 00002000:00100000:3.0:1746144661.185769:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3211263) req@ffff88009287b480 x1830964746672000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 504/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.185778:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b480 with x1830964746672000 ext(2097152->3211263) 00002000:00010000:3.0:1746144661.185784:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287b480 00000100:00100000:0.0:1746144661.185936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.186063:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672384 00000100:00100000:2.0:1746144661.186072:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672384 00000100:00100000:2.0:1746144661.186114:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11801 00000100:00100000:2.0:1746144661.186121:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29151:x1830964746672384:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.186172:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.186191:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee22 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.186222:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 13 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.186231:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.186238:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.186240:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.186243:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3514368->3911679] (req 3514368->3911679) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.186271:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.186283:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.186294:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488512:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.186358:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 13 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.186366:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 13 pid: 8453 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.186913:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488640:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.186940:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.189830:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488512:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144661.193601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.193746:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747488640:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.193782:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3514368->3911679] (req 3514368->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.193801:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb26800, rc 0) 00000100:00100000:2.0:1746144661.193856:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29151:x1830964746672384:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7733us (7921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.193865:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11801 00000100:00100000:3.0:1746144661.195267:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672512 00000100:00100000:3.0:1746144661.195277:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672512 00000100:00100000:1.0:1746144661.195296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144661.195314:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144661.195326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.195341:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5887 00000100:00100000:1.0:1746144661.195341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.195348:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746672512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.195362:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144661.195381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144661.195383:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.195395:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144661.195403:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672640 00000100:00100000:1.0:1746144661.195407:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672640 00010000:00010000:3.0:1746144661.195418:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3be00/0xa7c849b16e01a459 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb9 expref: 29 pid: 8388 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144661.195427:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672768 00000100:00100000:1.0:1746144661.195430:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672768 00010000:00010000:3.0:1746144661.195435:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.195447:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746672896 00000100:00100000:1.0:1746144661.195449:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746672896 00000100:00100000:1.0:1746144661.195458:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746673024 00000100:00100000:1.0:1746144661.195459:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746673024 00000100:00100000:3.0:1746144661.195465:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11802 00000100:00100000:3.0:1746144661.195471:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:29148:x1830964746672640:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144661.195474:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11803 00010000:00010000:3.0:1746144661.195485:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.195496:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee29 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.195510:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.195515:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3514368->3911679] (req 3514368->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.195521:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144661.195524:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 15 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.195557:0:30345:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3514368->3911679] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.195568:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 15 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.195575:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f011200, rc 0) 00000100:00100000:3.0:1746144661.195607:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+15:29148:x1830964746672640:12345-192.168.204.23@tcp:101:cat.0 Request processed in 137us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.195635:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746672768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.195644:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144661.195668:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11804 00000100:00100000:0.0:1746144661.195679:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746672896:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144661.195686:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144661.195693:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a524 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee37 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.195704:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.195711:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a524 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee37 expref: 31 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144661.195820:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3aa00/0xa7c849b16e01a524 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee37 expref: 31 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144661.195833:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3aa00, rc 0) 00000100:00100000:0.0:1746144661.195851:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746672896:12345-192.168.204.23@tcp:101:cat.0 Request processed in 175us (509us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144661.195857:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11804 00000100:00100000:0.0:1746144661.195871:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11805 00000100:00100000:0.0:1746144661.195875:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746673024:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144661.195882:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144661.195891:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a52b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee3e expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.195920:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747488896:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144661.195962:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.196002:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11802 00000100:00100000:3.0:1746144661.196032:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746672512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 684us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.196038:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5887 00010000:00010000:1.0:1746144661.196115:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee30 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.196127:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.196129:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.196158:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 29 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.196168:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 29 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.196176:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418ec00, rc 0) 00000100:00100000:1.0:1746144661.196192:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746672768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 559us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.196197:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11803 00000100:00100000:0.0:1746144661.197283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.197611:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746673152 00000100:00100000:3.0:1746144661.197620:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746673152 00010000:00010000:3.0:1746144661.197650:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 15 pid: 8453 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.197858:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5888 00000100:00100000:3.0:1746144661.197866:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746673152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.197881:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.197902:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 15 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.197915:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 15 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.197937:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5045000/0xa7c849b16e01a3fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed6c expref: 15 pid: 8453 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.197953:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.197954:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.197959:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.197967:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.197997:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.198009:0:7101:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 28 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.198021:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747489024:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.198118:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.198446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.198486:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746673408 00000100:00100000:2.0:1746144661.198491:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746673408 00000100:00100000:2.0:1746144661.198532:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10098 00000100:00100000:2.0:1746144661.198537:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:29155:x1830964746673408:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.198555:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.198570:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26000/0xa7c849b16e01a539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee45 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.198678:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198689:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198701:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198714:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198719:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198724:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198826:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26a00/0xa7c849b16e01a54e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198835:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26a00/0xa7c849b16e01a54e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198840:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26a00/0xa7c849b16e01a54e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144661.198848:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144661.198928:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198934:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198940:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198946:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb26600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.198949:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198957:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198966:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144661.198969:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144661.198972:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198976:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26600/0xa7c849b16e01a540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.198998:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.199002:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.199006:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.199010:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb26400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.199012:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.199017:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.199022:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8a00) 00010000:00010000:2.0:1746144661.199023:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144661.199025:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.199029:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26400/0xa7c849b16e01a547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144661.199052:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747488896:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.199064:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26000/0xa7c849b16e01a539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee45 expref: 28 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.199074:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26a00/0xa7c849b16e01a54e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee45 expref: 27 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.199089:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.199091:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144661.199091:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a52b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee3e expref: 38 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.199093:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb26a00, rc 0) 00010000:00010000:1.0:1746144661.199100:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3a000/0xa7c849b16e01a52b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee3e expref: 38 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.199113:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3a000, rc 0) 00000100:00100000:2.0:1746144661.199120:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+27:29155:x1830964746673408:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 583us (675us total) trans 8589943987 rc 0/0 00000100:00100000:2.0:1746144661.199127:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10098 00000100:00100000:1.0:1746144661.199129:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746673024:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3254us (3749us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144661.199153:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11805 00000100:00100000:3.0:1746144661.201510:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747489024:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.201531:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.201578:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746673152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3713us (4300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.201590:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5888 00000100:00100000:1.0:1746144661.206009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.206129:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746673536 00000100:00100000:3.0:1746144661.206165:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746673536 00000100:00100000:3.0:1746144661.206230:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 636 00000100:00100000:3.0:1746144661.206239:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746673536:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.206258:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.206285:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb26a00/0xa7c849b16e01a54e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee45 expref: 27 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.206300:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.206304:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.206355:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746673536:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.206362:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 636 00000100:00100000:1.0:1746144661.206494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.206661:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746673792 00000100:00100000:3.0:1746144661.206664:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746673792 00002000:00100000:3.0:1746144661.206692:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3514368->3518463) req@ffff88009f168380 x1830964746673792/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.206706:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168380 with x1830964746673792 ext(3514368->3518463) 00010000:00010000:3.0:1746144661.206714:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.206725:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.206731:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f168380 00000100:00100000:3.0:1746144661.207048:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 880 00000100:00100000:3.0:1746144661.207054:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746673792:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.207515:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746673792:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 461us (1020us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144661.207521:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 880 00002000:00100000:3.0:1746144661.207526:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3514368->3518463) req@ffff88009f168380 x1830964746673792/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.207533:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168380 with x1830964746673792 ext(3514368->3518463) 00010000:00010000:3.0:1746144661.207538:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.207548:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 29 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.207553:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f168380 00000100:00100000:0.0:1746144661.208912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.208955:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746673920 00000100:00100000:1.0:1746144661.208962:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746673920 00000100:00100000:1.0:1746144661.209000:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11806 00000100:00100000:1.0:1746144661.209007:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:29155:x1830964746673920:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144661.209021:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.209039:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee4c expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.209069:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.209088:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.209095:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.209096:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.209100:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [917504->1048575] (req 917504->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 15 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.209132:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.209173:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:1.0:1746144661.209185:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747489152:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144661.209270:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 28 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.209279:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 28 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.209287:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747489280:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144661.209305:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.210398:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747489152:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144661.210408:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747489280:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144661.210431:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [917504->1048575] (req 917504->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 15 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.210444:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009badfa00, rc 0) 00000100:00100000:1.0:1746144661.210469:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:29155:x1830964746673920:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1463us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.210477:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11806 00000100:00100000:0.0:1746144661.211253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.211330:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746674048 00000100:00100000:2.0:1746144661.211337:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746674048 00010000:00010000:2.0:1746144661.211364:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.211447:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5889 00000100:00100000:2.0:1746144661.211454:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746674048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.211468:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.211495:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.211506:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.211540:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bb6400/0xa7c849b16e01a47c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edce expref: 15 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.211561:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.211634:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746674048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 179us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.211641:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5889 00000100:00100000:0.0:1746144661.211991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.212051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.212091:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746674432 00000100:00100000:3.0:1746144661.212096:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746674432 00000100:00100000:2.0:1746144661.212111:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746674176 00000100:00100000:2.0:1746144661.212115:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746674176 00002000:00100000:3.0:1746144661.212125:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009287a300 x1830964746674432/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746144661.212128:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00002000:00100000:3.0:1746144661.212163:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287a300 with x1830964746674432 ext(1048576->2097151) 00002000:00010000:3.0:1746144661.212167:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009287a300 00000100:00100000:2.0:1746144661.212168:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5890 00000100:00100000:2.0:1746144661.212173:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746674176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.212180:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.212190:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.212191:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4515 00000100:00100000:3.0:1746144661.212197:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746674432:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:2.0:1746144661.212198:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.212211:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ca3bc00/0xa7c849b16e01a46e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edc0 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.212220:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.212222:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.212229:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.212237:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.212266:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.212276:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747489408:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144661.212387:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.213192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.213257:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746674688 00000100:00100000:1.0:1746144661.213262:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746674688 00002000:00100000:1.0:1746144661.213288:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3907584->3911679) req@ffff88009287bb80 x1830964746674688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.213295:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287bb80 with x1830964746674688 ext(3907584->3911679) 00010000:00010000:1.0:1746144661.213302:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.213314:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144661.213319:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009287bb80 00000100:00100000:1.0:1746144661.213351:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 881 00000100:00100000:1.0:1746144661.213358:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746674688:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.213479:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746674688:12345-192.168.204.23@tcp:3:cat.0 Request processed in 121us (288us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144661.213485:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 881 00002000:00100000:1.0:1746144661.213490:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3907584->3911679) req@ffff88009287bb80 x1830964746674688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.213496:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287bb80 with x1830964746674688 ext(3907584->3911679) 00010000:00010000:1.0:1746144661.213501:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.213509:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144661.213515:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009287bb80 00000100:00100000:0.0:1746144661.215846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.215869:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747489408:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.215890:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.215936:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746674176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3761us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.215947:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5890 00000100:00100000:3.0:1746144661.216003:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746674944 00000100:00100000:3.0:1746144661.216011:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746674944 00002000:00100000:3.0:1746144661.216048:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (917504->921599) req@ffff88009287ad80 x1830964746674944/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.216057:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287ad80 with x1830964746674944 ext(917504->921599) 00002000:00010000:3.0:1746144661.216062:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009287ad80 00000100:00100000:3.0:1746144661.216103:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4516 00000100:00100000:3.0:1746144661.216110:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746674944:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.216416:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746674944:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 305us (581us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144661.216423:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4516 00002000:00100000:3.0:1746144661.216429:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (917504->921599) req@ffff88009287ad80 x1830964746674944/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.216440:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287ad80 with x1830964746674944 ext(917504->921599) 00002000:00010000:3.0:1746144661.216443:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009287ad80 00000100:00100000:0.0:1746144661.218074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.218656:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746675200 00000100:00100000:3.0:1746144661.218665:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746675200 00002000:00100000:3.0:1746144661.218709:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3514368->3911679) req@ffff880092878380 x1830964746675200/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.218718:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878380 with x1830964746675200 ext(3514368->3911679) 00010000:00010000:3.0:1746144661.218728:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.218742:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.218749:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092878380 00000100:00100000:3.0:1746144661.218783:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 882 00000100:00100000:3.0:1746144661.218792:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746675200:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144661.223269:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746674432:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11061us (11267us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.223269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.223281:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4515 00002000:00100000:3.0:1746144661.223295:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009287a300 x1830964746674432/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144661.223300:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746675328 00002000:00100000:3.0:1746144661.223305:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287a300 with x1830964746674432 ext(1048576->2097151) 00000100:00100000:1.0:1746144661.223308:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746675328 00002000:00010000:3.0:1746144661.223311:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009287a300 00000100:00100000:2.0:1746144661.223376:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11807 00000100:00100000:2.0:1746144661.223386:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+35:29155:x1830964746675328:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.223401:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.223421:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee53 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.223451:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 36 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.223460:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 36 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.223468:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.223469:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.223473:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.223500:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 36 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.223511:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 36 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.223522:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747489536:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.223586:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 36 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.223593:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 36 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.223600:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747489664:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.223613:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.228194:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746675200:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9392us (10116us total) trans 17179873259 rc 0/0 00000100:00100000:3.0:1746144661.228209:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 882 00002000:00100000:3.0:1746144661.228222:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3514368->3911679) req@ffff880092878380 x1830964746675200/t17179873259(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.228238:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878380 with x1830964746675200 ext(3514368->3911679) 00010000:00010000:3.0:1746144661.228248:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.228263:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 30 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.228270:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092878380 00000100:00100000:0.0:1746144661.232739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.232783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.232828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.232843:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746675456 00000100:00100000:1.0:1746144661.232853:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746675456 00000100:00100000:0.0:1746144661.232864:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746675712 00000100:00100000:0.0:1746144661.232868:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746675712 00010000:00010000:1.0:1746144661.232900:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.233119:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746675584 00000100:00100000:2.0:1746144661.233123:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746675584 00000100:00100000:3.0:1746144661.233292:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5891 00000100:00100000:3.0:1746144661.233305:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746675456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.233324:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.233353:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.233366:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.233394:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.233439:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746675456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 139us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.233445:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5891 00010000:00010000:2.0:1746144661.233484:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 37 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:2.0:1746144661.233513:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5892 00000100:00100000:2.0:1746144661.233522:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+37:1962:x1830964746675584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.233530:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.233540:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 37 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.233615:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 37 pid: 29370 timeout: 740 lvb_type: 1 00010000:00010000:2.0:1746144661.233652:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.233658:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.233665:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 37 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.233677:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 37 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.233717:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 37 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.233733:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747489792:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144661.233984:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144661.234157:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5000/0xa7c849b16e01a501 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee0d expref: 37 pid: 29370 timeout: 740 lvb_type: 1 00000100:00100000:0.0:1746144661.234337:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11808 00000100:00100000:2.0:1746144661.234405:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747489536:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144661.234512:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29156:x1830964746675712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.234532:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bb6000/0xa7c849b16e01a483 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edd5 expref: 36 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.234542:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747489664:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.234566:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.234575:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb26c00, rc 0) 00000100:00100000:2.0:1746144661.234596:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+36:29155:x1830964746675328:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 11212us (11333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.234601:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11807 00010000:00010000:0.0:1746144661.234654:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144661.234668:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee5a expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.234684:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144661.234686:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144661.234689:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.234697:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.234704:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009badf600, rc 0) 00000100:00100000:0.0:1746144661.234720:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29156:x1830964746675712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 266us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144661.234728:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11808 00000100:00100000:3.0:1746144661.235231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.235282:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746675840 00000100:00100000:1.0:1746144661.235287:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746675840 00010000:00010000:1.0:1746144661.235305:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.235322:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5893 00000100:00100000:1.0:1746144661.235328:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746675840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144661.235337:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144661.235355:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.235365:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.235378:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb26800/0xa7c849b16e01a516 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3514368->3911679) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee22 expref: 31 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.235401:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.235403:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.235408:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.235420:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.235427:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.235428:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.235430:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 30 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.235436:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 30 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.235458:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 30 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144661.235467:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747489920:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144661.235526:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144661.235534:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747490048:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144661.235551:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.237943:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747489920:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144661.237957:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce86680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747490048:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144661.237980:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.238035:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746675840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2704us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.238048:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5893 00000100:00100000:2.0:1746144661.238560:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b573480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747489792:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.238573:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.238605:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746675584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5086us (5821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.238611:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5892 00000100:00100000:0.0:1746144661.239454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.239495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.239541:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746676224 00000100:00100000:2.0:1746144661.239547:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746676224 00000100:00100000:3.0:1746144661.239567:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746676352 00000100:00100000:3.0:1746144661.239571:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746676352 00002000:00100000:2.0:1746144661.239579:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee5500 x1830964746676224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.239586:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5500 with x1830964746676224 ext(3145728->4194303) 00002000:00010000:2.0:1746144661.239589:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee5500 00002000:00100000:3.0:1746144661.239591:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1175552->1179647) req@ffff880093ee5180 x1830964746676352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.239600:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5180 with x1830964746676352 ext(1175552->1179647) 00002000:00010000:3.0:1746144661.239603:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5180 00000100:00100000:2.0:1746144661.239611:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4517 00000100:00100000:3.0:1746144661.239625:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4518 00000100:00100000:3.0:1746144661.239630:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746676352:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144661.239662:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746676224:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.240365:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746676352:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 733us (867us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144661.240371:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4518 00002000:00100000:3.0:1746144661.240377:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1175552->1179647) req@ffff880093ee5180 x1830964746676352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.240384:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5180 with x1830964746676352 ext(1175552->1179647) 00002000:00010000:3.0:1746144661.240387:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5180 00000100:00100000:0.0:1746144661.241786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.242910:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746676608 00000100:00100000:3.0:1746144661.242918:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746676608 00002000:00100000:3.0:1746144661.242953:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093ee7100 x1830964746676608/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.242962:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7100 with x1830964746676608 ext(2097152->3145727) 00002000:00010000:3.0:1746144661.242967:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee7100 00000100:00100000:3.0:1746144661.242984:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4519 00000100:00100000:3.0:1746144661.242990:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746676608:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.252247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.252747:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746676864 00000100:00100000:1.0:1746144661.252759:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746676864 00000100:00100000:1.0:1746144661.252806:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4079 00000100:00100000:1.0:1746144661.252815:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+26:29155:x1830964746676864:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144661.253030:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+27:29155:x1830964746676864:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 215us (789us total) trans 8589943988 rc 0/0 00000100:00100000:1.0:1746144661.253038:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4079 00000100:00100000:0.0:1746144661.253392:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746676224:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 13771us (13937us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144661.253401:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4517 00002000:00100000:0.0:1746144661.253413:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee5500 x1830964746676224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.253421:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5500 with x1830964746676224 ext(3145728->4194303) 00002000:00010000:0.0:1746144661.253426:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee5500 00000100:00100000:0.0:1746144661.261529:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746676608:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18526us (19733us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144661.261543:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4519 00002000:00100000:0.0:1746144661.261557:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093ee7100 x1830964746676608/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.261567:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7100 with x1830964746676608 ext(2097152->3145727) 00002000:00010000:0.0:1746144661.261573:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee7100 00000100:00100000:2.0:1746144661.266692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.266727:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746677120 00000100:00100000:2.0:1746144661.266737:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746677120 00002000:00100000:2.0:1746144661.266784:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b573480 x1830964746677120/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.266795:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573480 with x1830964746677120 ext(4194304->4935679) 00002000:00010000:2.0:1746144661.266800:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b573480 00000100:00100000:2.0:1746144661.266821:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4520 00000100:00100000:2.0:1746144661.266829:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746677120:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.274998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.275030:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746677248 00000100:00100000:1.0:1746144661.275039:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746677248 00000100:00100000:1.0:1746144661.275097:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11809 00000100:00100000:1.0:1746144661.275106:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29156:x1830964746677248:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.275126:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.275163:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee61 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.275195:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.275203:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144661.275205:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144661.275208:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.275240:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 34 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.275254:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 34 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.275266:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747490176:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144661.275345:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.278187:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746677120:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11070us (11217us total) trans 0 rc 741376/741376 00000100:00100000:0.0:1746144661.278199:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4520 00002000:00100000:0.0:1746144661.278211:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b573480 x1830964746677120/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.278225:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573480 with x1830964746677120 ext(4194304->4935679) 00002000:00010000:0.0:1746144661.278231:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b573480 00000100:00100000:0.0:1746144661.278314:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747490176:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144661.278339:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 37 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.278355:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f349200, rc 0) 00000100:00100000:0.0:1746144661.278371:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29156:x1830964746677248:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3268us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144661.278377:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11809 00000100:00100000:0.0:1746144661.278628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.278645:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746677376 00000100:00100000:0.0:1746144661.278650:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746677376 00002000:00100000:0.0:1746144661.278681:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2539520->2605055) req@ffff880093ee5880 x1830964746677376/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.278689:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5880 with x1830964746677376 ext(2539520->2605055) 00010000:00010000:0.0:1746144661.278694:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 35 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144661.278705:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 35 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:0.0:1746144661.278711:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ee5880 00000100:00100000:0.0:1746144661.278727:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 883 00000100:00100000:0.0:1746144661.278733:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746677376:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144661.283247:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+37:1961:x1830964746677376:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4501us (4607us total) trans 21474840502 rc 0/0 00000100:00100000:2.0:1746144661.283260:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 883 00002000:00100000:2.0:1746144661.283272:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2539520->2605055) req@ffff880093ee5880 x1830964746677376/t21474840502(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.283281:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5880 with x1830964746677376 ext(2539520->2605055) 00010000:00010000:2.0:1746144661.283291:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.283307:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144661.283314:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ee5880 00000100:00100000:2.0:1746144661.283374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.283397:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746677504 00000100:00100000:2.0:1746144661.283404:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746677504 00000100:00100000:2.0:1746144661.283431:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11810 00000100:00100000:2.0:1746144661.283437:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:1963:x1830964746677504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.283453:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.283468:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e01a578 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee68 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.283516:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747490304:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144661.283562:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746144661.286492:0:10724:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144661 -> 1746144662 00000100:00100000:2.0:1746144661.286519:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747490304:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.286550:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e01a578 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee68 expref: 38 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.286562:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b19f0400/0xa7c849b16e01a578 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee68 expref: 38 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.286591:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19f0400, rc 0) 00000100:00100000:2.0:1746144661.286633:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:1963:x1830964746677504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3195us (3258us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.286652:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11810 00000100:00100000:3.0:1746144661.288411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.288437:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746677632 00000100:00100000:3.0:1746144661.288445:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746677632 00010000:00010000:3.0:1746144661.288480:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.288508:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5894 00000100:00100000:3.0:1746144661.288517:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+37:1960:x1830964746677632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.288531:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.288550:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.288561:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.288582:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb27e00/0xa7c849b16e01a4c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->2605055) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edf1 expref: 37 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.288596:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.288598:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.288606:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.288614:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.288648:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 36 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.288661:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747490432:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.288719:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.290815:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747490432:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144661.290836:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.290874:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+36:1960:x1830964746677632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2356us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.290884:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5894 00000100:00100000:1.0:1746144661.290979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.291002:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746677760 00000100:00100000:1.0:1746144661.291546:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746677760 00000100:00100000:1.0:1746144661.291581:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11811 00000100:00100000:1.0:1746144661.291587:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+36:1963:x1830964746677760:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.291606:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.291623:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee6f expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.291644:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.291646:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.291654:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 37 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.291669:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 37 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.291680:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f348600, rc 0) 00000100:00100000:1.0:1746144661.292354:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:1963:x1830964746677760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 764us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.292360:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11811 00000100:00100000:0.0:1746144661.302569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.302608:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746678016 00000100:00100000:0.0:1746144661.302618:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746678016 00002000:00100000:0.0:1746144661.303880:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093ee6a00 x1830964746678016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.303891:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6a00 with x1830964746678016 ext(2097152->3145727) 00002000:00010000:0.0:1746144661.303897:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee6a00 00000100:00100000:0.0:1746144661.304178:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4521 00000100:00100000:0.0:1746144661.304188:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746678016:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.308482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.308511:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746678272 00000100:00100000:0.0:1746144661.308519:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746678272 00002000:00100000:0.0:1746144661.308561:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee4a80 x1830964746678272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.308570:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4a80 with x1830964746678272 ext(3145728->4194303) 00002000:00010000:0.0:1746144661.308576:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee4a80 00000100:00100000:0.0:1746144661.308600:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4522 00000100:00100000:0.0:1746144661.308606:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746678272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.308939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.308965:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746678528 00000100:00100000:1.0:1746144661.308968:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746678528 00002000:00100000:1.0:1746144661.308988:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fb44000 x1830964746678528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.308996:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb44000 with x1830964746678528 ext(3145728->4194303) 00002000:00010000:1.0:1746144661.308999:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb44000 00000100:00100000:1.0:1746144661.309012:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4523 00000100:00100000:1.0:1746144661.309017:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746678528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.325866:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746678016:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21670us (23300us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144661.325880:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4521 00002000:00100000:0.0:1746144661.325895:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093ee6a00 x1830964746678016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.325904:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6a00 with x1830964746678016 ext(2097152->3145727) 00002000:00010000:0.0:1746144661.325912:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee6a00 00000100:00100000:0.0:1746144661.333529:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746678528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24501us (24581us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144661.333542:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4523 00002000:00100000:0.0:1746144661.333555:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fb44000 x1830964746678528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.333564:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb44000 with x1830964746678528 ext(3145728->4194303) 00002000:00010000:0.0:1746144661.333570:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb44000 00000100:00100000:1.0:1746144661.333995:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746678272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25386us (25517us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.334004:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4522 00002000:00100000:1.0:1746144661.334010:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee4a80 x1830964746678272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.334018:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4a80 with x1830964746678272 ext(3145728->4194303) 00002000:00010000:1.0:1746144661.334022:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee4a80 00000100:00100000:1.0:1746144661.341131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.341179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.341199:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746678784 00000100:00100000:2.0:1746144661.341209:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746678784 00000100:00100000:2.0:1746144661.341250:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746678656 00000100:00100000:2.0:1746144661.341252:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746678656 00000100:00100000:2.0:1746144661.341269:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11812 00000100:00100000:2.0:1746144661.341419:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746678784:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144661.341426:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11813 00000100:00100000:1.0:1746144661.341434:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746678656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.341443:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.341443:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.341460:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009423a000/0xa7c849b16e01a58d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee7d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.341460:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f348400/0xa7c849b16e01a586 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee76 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144661.341510:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747490560:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144661.341580:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.341649:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747490688:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144661.341671:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746144661.347012:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144661 -> 1746144662 00000100:00100000:1.0:1746144661.347042:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747490560:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144661.347082:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f348400/0xa7c849b16e01a586 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee76 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.347097:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f348400/0xa7c849b16e01a586 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee76 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.347108:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f348400, rc 0) 00000100:00100000:1.0:1746144661.347174:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746678656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5740us (5992us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144661.347183:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11813 00002000:00010000:2.0:1746144661.347552:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144661 -> 1746144662 00000100:00100000:2.0:1746144661.347566:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747490688:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.347582:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009423a000/0xa7c849b16e01a58d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee7d expref: 38 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.347592:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009423a000/0xa7c849b16e01a58d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee7d expref: 38 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.347600:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009423a000, rc 0) 00000100:00100000:2.0:1746144661.348643:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746678784:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7222us (7515us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.348650:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11812 00000100:00100000:0.0:1746144661.355564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.355600:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679040 00000100:00100000:0.0:1746144661.355610:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679040 00002000:00100000:0.0:1746144661.355681:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093ee6300 x1830964746679040/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.355691:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6300 with x1830964746679040 ext(4194304->4935679) 00002000:00010000:0.0:1746144661.355697:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee6300 00000100:00100000:0.0:1746144661.355719:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4524 00000100:00100000:0.0:1746144661.355728:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746679040:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.365205:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746679040:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9469us (9641us total) trans 0 rc 741376/741376 00000100:00100000:0.0:1746144661.365217:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4524 00002000:00100000:0.0:1746144661.365229:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093ee6300 x1830964746679040/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.365239:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6300 with x1830964746679040 ext(4194304->4935679) 00002000:00010000:0.0:1746144661.365246:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee6300 00000100:00100000:1.0:1746144661.370185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.370214:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679296 00000100:00100000:1.0:1746144661.370218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.370225:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679296 00000100:00100000:1.0:1746144661.370236:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679168 00000100:00100000:1.0:1746144661.370239:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679168 00000100:00100000:1.0:1746144661.370268:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11814 00000100:00100000:2.0:1746144661.370273:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11815 00000100:00100000:1.0:1746144661.370275:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746679168:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144661.370279:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746679296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.370292:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.370292:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.370310:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009423a800/0xa7c849b16e01a59b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee8b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.370310:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f349c00/0xa7c849b16e01a594 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee84 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.370365:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747490944:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144661.370365:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747490816:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144661.370442:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.370442:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.373842:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747490944:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144661.373842:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747490816:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.373874:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009423a800/0xa7c849b16e01a59b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee8b expref: 38 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.373874:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f349c00/0xa7c849b16e01a594 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee84 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.373887:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009423a800/0xa7c849b16e01a59b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee8b expref: 38 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.373887:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f349c00/0xa7c849b16e01a594 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee84 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.373898:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009423a800, rc 0) 00010000:00010000:1.0:1746144661.373898:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f349c00, rc 0) 00000100:00100000:1.0:1746144661.373940:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746679168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3664us (3719us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.373943:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746679296:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3663us (3767us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144661.373948:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11814 00000100:00100000:2.0:1746144661.373952:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11815 00000100:00100000:1.0:1746144661.377098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000001:00080000:2.0:1746144661.377347:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840495 is committed 00000001:00080000:2.0:1746144661.377372:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840477 is committed 00000001:00080000:2.0:1746144661.377411:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840430 is committed 00000001:00080000:2.0:1746144661.377418:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840501 is committed 00000001:00080000:2.0:1746144661.377427:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840496 is committed 00000001:00080000:2.0:1746144661.377456:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840470 is committed 00000001:00080000:2.0:1746144661.377507:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840474 is committed 00000001:00080000:2.0:1746144661.377553:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840500 is committed 00000100:00100000:1.0:1746144661.377684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.377706:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679552 00000100:00100000:1.0:1746144661.377715:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679552 00000100:00100000:1.0:1746144661.377749:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679424 00000100:00100000:1.0:1746144661.377752:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679424 00000100:00100000:1.0:1746144661.377766:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11816 00000100:00100000:1.0:1746144661.377774:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1961:x1830964746679552:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.377793:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.377810:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f349000/0xa7c849b16e01a5a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee99 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144661.377871:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747491072:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144661.377941:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.377958:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11817 00000100:00100000:1.0:1746144661.377963:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746679424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.377971:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.377981:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f349a00/0xa7c849b16e01a5a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ee92 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144661.378003:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747491200:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144661.378026:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.379611:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747491200:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144661.379641:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f349a00/0xa7c849b16e01a5a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee92 expref: 31 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.379654:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f349a00/0xa7c849b16e01a5a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee92 expref: 31 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.379662:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f349a00, rc 0) 00000100:00100000:1.0:1746144661.379699:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746679424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1734us (2014us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144661.379705:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11817 00000100:00100000:2.0:1746144661.379713:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747491072:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.379736:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f349000/0xa7c849b16e01a5a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee99 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.379751:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f349000/0xa7c849b16e01a5a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee99 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.379855:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f349000, rc 0) 00000100:00100000:2.0:1746144661.379891:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1961:x1830964746679552:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2117us (2804us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.379897:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11816 00000100:00100000:0.0:1746144661.461792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.462255:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679680 00000100:00100000:2.0:1746144661.462266:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679680 00000100:00100000:2.0:1746144661.462329:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11818 00000100:00100000:2.0:1746144661.462336:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29161:x1830964746679680:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.462356:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.462375:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eea0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.462405:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.462413:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.462419:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.462421:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.462424:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2220032->3088383] (req 2220032->3088383) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.462459:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.462470:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.462482:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747491328:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.462603:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.462612:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 13 pid: 30345 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.462620:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747491456:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.462644:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.467607:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747491328:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144661.470171:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.470473:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747491456:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.470509:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2220032->3088383] (req 2220032->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.470527:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009423a200, rc 0) 00000100:00100000:2.0:1746144661.470577:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29161:x1830964746679680:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8241us (8798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.470591:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11818 00000100:00100000:1.0:1746144661.470816:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679808 00000100:00100000:1.0:1746144661.470825:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679808 00010000:00010000:1.0:1746144661.470857:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.470897:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5895 00000100:00100000:1.0:1746144661.470904:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746679808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144661.470918:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144661.470941:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.470951:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.470974:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009badf600/0xa7c849b16e01a56a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee5a expref: 31 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.470989:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.471013:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746679808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 109us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.471018:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5895 00000100:00100000:0.0:1746144661.471330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.472301:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746679936 00000100:00100000:3.0:1746144661.472308:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746679936 00010000:00010000:3.0:1746144661.472333:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 14 pid: 30345 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.472365:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5896 00000100:00100000:3.0:1746144661.472371:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746679936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.472382:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.472398:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 14 pid: 30345 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.472410:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 14 pid: 30345 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.472426:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f011200/0xa7c849b16e01a51d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee29 expref: 14 pid: 30345 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.472460:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.472462:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.472469:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.472479:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.472513:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.472530:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747491584:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.472605:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.477129:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747491584:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.477188:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.477249:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746679936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4876us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.477262:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5896 00000100:00100000:1.0:1746144661.480454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.480697:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746680192 00000100:00100000:0.0:1746144661.480708:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746680192 00002000:00100000:0.0:1746144661.480760:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2220032->2224127) req@ffff88009b32ca80 x1830964746680192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.480772:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ca80 with x1830964746680192 ext(2220032->2224127) 00002000:00010000:0.0:1746144661.480777:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32ca80 00000100:00100000:2.0:1746144661.481003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.481966:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4525 00000100:00100000:0.0:1746144661.481977:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746680192:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.482252:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746680448 00000100:00100000:3.0:1746144661.482257:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746680448 00000100:00100000:3.0:1746144661.482290:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10099 00000100:00100000:3.0:1746144661.482296:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+27:29164:x1830964746680448:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144661.482313:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.482331:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eea7 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.482496:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482511:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482522:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482535:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482540:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482545:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482644:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482652:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482657:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144661.482664:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144661.482743:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482762:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482767:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482772:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f2d1000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.482775:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482782:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482792:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144661.482795:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.482800:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482808:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1000/0xa7c849b16e01a5be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482833:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482838:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482842:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482846:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f2d0c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.482848:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482852:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482859:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008e51eb00) 00010000:00010000:3.0:1746144661.482861:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.482863:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482867:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.482903:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea7 expref: 30 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.482912:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea7 expref: 29 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.482922:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.482924:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144661.482926:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2d1200, rc 0) 00000100:00100000:1.0:1746144661.483028:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746680192:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1052us (2583us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144661.483037:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4525 00002000:00100000:1.0:1746144661.483044:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2220032->2224127) req@ffff88009b32ca80 x1830964746680192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.483052:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32ca80 with x1830964746680192 ext(2220032->2224127) 00002000:00010000:1.0:1746144661.483056:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32ca80 00000100:00100000:3.0:1746144661.483900:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:29164:x1830964746680448:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1601us (2894us total) trans 8589943989 rc 0/0 00000100:00100000:3.0:1746144661.483907:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10099 00000100:00100000:0.0:1746144661.490840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.491353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.491473:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746680832 00000100:00100000:1.0:1746144661.491486:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746680832 00002000:00100000:1.0:1746144661.491541:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3084288->3088383) req@ffff880093ee7480 x1830964746680832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.491553:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7480 with x1830964746680832 ext(3084288->3088383) 00002000:00010000:1.0:1746144661.491559:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee7480 00000100:00100000:1.0:1746144661.491592:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4526 00000100:00100000:1.0:1746144661.491602:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746680832:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.492972:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746680576 00000100:00100000:3.0:1746144661.492982:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746680576 00000100:00100000:3.0:1746144661.493048:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 637 00000100:00100000:3.0:1746144661.493057:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746680576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.493085:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.493116:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea7 expref: 29 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.493167:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.493173:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.495109:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746680832:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 3498us (3747us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144661.495121:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4526 00002000:00100000:1.0:1746144661.495946:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3084288->3088383) req@ffff880093ee7480 x1830964746680832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.495958:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7480 with x1830964746680832 ext(3084288->3088383) 00002000:00010000:1.0:1746144661.495963:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee7480 00000100:00100000:3.0:1746144661.496849:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746680576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3791us (6018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.496858:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 637 00000100:00100000:0.0:1746144661.516497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.516602:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746681088 00000100:00100000:3.0:1746144661.516613:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746681088 00000100:00100000:3.0:1746144661.516673:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10100 00000100:00100000:3.0:1746144661.516681:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e327450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:29169:x1830964746681088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.516709:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.516886:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0e00/0xa7c849b16e01a5da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eeae expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.517013:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517027:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517038:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517051:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517058:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517063:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517265:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5ef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517274:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517279:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5ef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144661.517288:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144661.517376:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517382:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517391:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517396:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f2d1200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.517399:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517405:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517414:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144661.517416:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.517420:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517425:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1200/0xa7c849b16e01a5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.517999:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518005:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518009:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518013:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f2d1e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144661.518015:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518018:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518028:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008e51eb00) 00010000:00010000:3.0:1746144661.518030:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144661.518032:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518036:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a5e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.518087:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0e00/0xa7c849b16e01a5da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeae expref: 31 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.518097:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5ef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeae expref: 30 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.518103:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.518105:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144661.518107:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2d0c00, rc 0) 00000100:00100000:3.0:1746144661.518521:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e327450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+30:29169:x1830964746681088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1839us (2032us total) trans 8589943990 rc 0/0 00000100:00100000:3.0:1746144661.518529:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10100 00000100:00100000:0.0:1746144661.520770:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.520818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.520886:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746681216 00000100:00100000:3.0:1746144661.520895:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746681216 00000100:00100000:3.0:1746144661.520943:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 638 00000100:00100000:3.0:1746144661.520951:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+30:1962:x1830964746681216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.520966:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.520990:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2d0c00/0xa7c849b16e01a5ef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeae expref: 30 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.521012:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.521016:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.521050:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746681216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.521057:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 638 00000100:00100000:1.0:1746144661.521239:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746681472 00000100:00100000:1.0:1746144661.521244:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746681472 00000100:00100000:1.0:1746144661.521267:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4080 00000100:00100000:1.0:1746144661.521272:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+29:29169:x1830964746681472:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144661.521949:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+30:29169:x1830964746681472:12345-192.168.204.23@tcp:35:cat.0 Request processed in 676us (1130us total) trans 8589943991 rc 0/0 00000100:00100000:1.0:1746144661.521955:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4080 00000100:00100000:0.0:1746144661.532492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.534192:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746681600 00000100:00100000:2.0:1746144661.534204:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746681600 00000100:00100000:2.0:1746144661.534269:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11819 00000100:00100000:2.0:1746144661.534279:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746681600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.534300:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.534322:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009423b000/0xa7c849b16e01a5fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eeb5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.534384:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747491712:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144661.534490:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00002000:00010000:2.0:1746144661.542017:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144661 -> 1746144662 00002000:00010000:2.0:1746144661.542028:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144661 -> 1746144662 00002000:00010000:2.0:1746144661.542031:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144661 -> 1746144662 00000100:00100000:2.0:1746144661.542064:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747491712:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.542117:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009423b000/0xa7c849b16e01a5fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeb5 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.542164:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009423b000/0xa7c849b16e01a5fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeb5 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.542210:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009423b000, rc 0) 00000100:00100000:2.0:1746144661.542310:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746681600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8030us (9828us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.542325:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11819 00000100:00100000:1.0:1746144661.551743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.553713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.553746:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746681856 00000100:00100000:2.0:1746144661.553758:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746681856 00002000:00100000:2.0:1746144661.553820:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->917503) req@ffff88009b32d500 x1830964746681856/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.553832:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32d500 with x1830964746681856 ext(0->917503) 00002000:00010000:2.0:1746144661.553838:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32d500 00000100:00100000:2.0:1746144661.553898:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4527 00000100:00100000:2.0:1746144661.553908:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746681856:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.555752:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682112 00000100:00100000:0.0:1746144661.555764:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682112 00002000:00100000:0.0:1746144661.555806:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1179648->2097151) req@ffff88009b32d180 x1830964746682112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.555815:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32d180 with x1830964746682112 ext(1179648->2097151) 00002000:00010000:0.0:1746144661.555820:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32d180 00000100:00100000:0.0:1746144661.555843:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4528 00000100:00100000:0.0:1746144661.555849:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746682112:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144661.593237:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746682112:12345-192.168.204.23@tcp:3:cat.0 Request processed in 37372us (39517us total) trans 0 rc 917504/917504 00000100:00100000:2.0:1746144661.593250:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4528 00002000:00100000:2.0:1746144661.593265:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1179648->2097151) req@ffff88009b32d180 x1830964746682112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.593274:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32d180 with x1830964746682112 ext(1179648->2097151) 00002000:00010000:2.0:1746144661.593281:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b32d180 00000100:00100000:2.0:1746144661.594973:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746681856:12345-192.168.204.23@tcp:3:cat.0 Request processed in 41059us (43236us total) trans 0 rc 917504/917504 00000100:00100000:2.0:1746144661.594983:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4527 00002000:00100000:2.0:1746144661.594991:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e8:0x0] (0->917503) req@ffff88009b32d500 x1830964746681856/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.594999:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32d500 with x1830964746681856 ext(0->917503) 00002000:00010000:2.0:1746144661.595004:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32d500 00000100:00100000:1.0:1746144661.612868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.612911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.612940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.613097:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682240 00000100:00100000:0.0:1746144661.613108:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682240 00000100:00100000:3.0:1746144661.613667:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682368 00000100:00100000:3.0:1746144661.613672:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682368 00000100:00100000:0.0:1746144661.614424:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682496 00000100:00100000:0.0:1746144661.614428:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682496 00000100:00100000:3.0:1746144661.615212:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11820 00000100:00100000:3.0:1746144661.615223:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746682240:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.615246:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.615269:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f2d1800/0xa7c849b16e01a604 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eebc expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.615335:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747491840:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144661.615433:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.615458:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11821 00000100:00100000:3.0:1746144661.615464:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1960:x1830964746682368:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.615473:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.615484:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a60b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eec3 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.615509:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747491968:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144661.615529:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.615938:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11822 00000100:00100000:2.0:1746144661.615947:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:29169:x1830964746682496:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.615955:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.615964:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eeca expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.615983:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.615990:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144661.615992:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144661.615995:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.616022:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.616034:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 31 pid: 8450 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.616046:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747492096:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.616125:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00002000:00010000:3.0:1746144661.626800:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144661 -> 1746144662 00002000:00010000:3.0:1746144661.626810:0:4758:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144661 -> 1746144662 00000100:00100000:2.0:1746144661.626977:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747491840:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.627026:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f2d1800/0xa7c849b16e01a604 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eebc expref: 31 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.627040:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f2d1800/0xa7c849b16e01a604 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eebc expref: 31 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.627080:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2d1800, rc 0) 00000100:00100000:2.0:1746144661.627171:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746682240:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11949us (14314us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.627181:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11820 00002000:00010000:3.0:1746144661.627960:0:29370:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144661 -> 1746144662 00002000:00010000:3.0:1746144661.627964:0:29370:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144661 -> 1746144662 00000100:00100000:0.0:1746144661.627980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.627981:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747491968:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144661.628000:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a60b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eec3 expref: 16 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.628010:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2d1e00/0xa7c849b16e01a60b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eec3 expref: 16 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144661.628018:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682624 00010000:00010000:3.0:1746144661.628021:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2d1e00, rc 0) 00000100:00100000:0.0:1746144661.628025:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682624 00000100:00100000:3.0:1746144661.628042:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1960:x1830964746682368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 12578us (15131us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144661.628047:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11821 00002000:00100000:0.0:1746144661.628075:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2220032->3088383) req@ffff88008b9a3800 x1830964746682624/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.628085:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3800 with x1830964746682624 ext(2220032->3088383) 00010000:00010000:0.0:1746144661.628094:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 30 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144661.628107:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 30 pid: 8450 timeout: 740 lvb_type: 0 00002000:00010000:0.0:1746144661.628113:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a3800 00000100:00100000:0.0:1746144661.628130:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 884 00000100:00100000:0.0:1746144661.628153:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746682624:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:2.0:1746144661.628168:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747492096:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.628184:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.628195:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009423aa00, rc 0) 00000100:00100000:2.0:1746144661.628216:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:29169:x1830964746682496:12345-192.168.204.23@tcp:101:cat.0 Request processed in 12272us (15275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.628222:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11822 00000100:00100000:2.0:1746144661.642464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.642555:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682752 00000100:00100000:3.0:1746144661.642564:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682752 00000100:00100000:3.0:1746144661.642605:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11823 00000100:00100000:3.0:1746144661.642613:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29172:x1830964746682752:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.642635:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.642657:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eed1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.642686:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.642694:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144661.642697:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144661.642700:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.642729:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 13 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.642740:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 13 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.642752:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747492224:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.642819:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.653550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.653617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.653645:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746683008 00000100:00100000:2.0:1746144661.653653:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746683008 00002000:00100000:2.0:1746144661.653700:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (917504->1048575) req@ffff88009b481500 x1830964746683008/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.653710:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481500 with x1830964746683008 ext(917504->1048575) 00010000:00010000:2.0:1746144661.653720:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 14 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.653724:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746682624:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 25571us (25744us total) trans 17179873260 rc 0/0 00010000:00010000:2.0:1746144661.653733:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 14 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.653734:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 884 00002000:00010000:2.0:1746144661.653740:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b481500 00002000:00100000:1.0:1746144661.653741:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2220032->3088383) req@ffff88008b9a3800 x1830964746682624/t17179873260(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.653747:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3800 with x1830964746682624 ext(2220032->3088383) 00010000:00010000:1.0:1746144661.653754:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 34 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.653760:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 34 pid: 8450 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.653762:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 885 00002000:00010000:1.0:1746144661.653766:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a3800 00000100:00100000:2.0:1746144661.653769:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746683008:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1746144661.653840:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746682880 00000100:00100000:3.0:1746144661.653844:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746682880 00000100:00100000:3.0:1746144661.653866:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11824 00000100:00100000:3.0:1746144661.653870:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+15:29164:x1830964746682880:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144661.653879:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144661.653942:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747492224:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144661.653968:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.653982:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094625200, rc 0) 00000100:00100000:0.0:1746144661.654003:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29172:x1830964746682752:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11391us (11549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144661.654012:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11823 00010000:00010000:3.0:1746144661.654758:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eed8 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.654780:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144661.654786:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.654791:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144661.654794:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2277376->3145727] (req 2277376->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.654830:0:29370:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.655086:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2277376->3145727] (req 2277376->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.655096:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e487400, rc 0) 00000100:00100000:3.0:1746144661.655201:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:29164:x1830964746682880:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1328us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.655206:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11824 00000100:00100000:0.0:1746144661.657095:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.657513:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746683136 00000100:00100000:1.0:1746144661.657523:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746683136 00010000:00010000:1.0:1746144661.657560:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 33 pid: 8450 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.657599:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5897 00000100:00100000:1.0:1746144661.657606:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746683136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144661.657620:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144661.657642:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 33 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.657659:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 33 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.657682:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009423a200/0xa7c849b16e01a5b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2220032->3088383) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eea0 expref: 33 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.657700:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.657701:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.657708:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.657716:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.657745:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.657754:0:7102:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00000100:00100000:1.0:1746144661.657766:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747492480:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144661.657832:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.658524:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746683008:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 4753us (4904us total) trans 17179873261 rc 0/0 00000100:00100000:3.0:1746144661.658534:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 885 00002000:00100000:3.0:1746144661.658543:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (917504->1048575) req@ffff88009b481500 x1830964746683008/t17179873261(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.658553:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481500 with x1830964746683008 ext(917504->1048575) 00010000:00010000:3.0:1746144661.658559:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 17 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.658568:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 17 pid: 10724 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.658573:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b481500 00000100:00100000:0.0:1746144661.661702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.661828:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746683264 00000100:00100000:2.0:1746144661.661838:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746683264 00000100:00100000:1.0:1746144661.661855:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747492480:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.661873:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 17 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.661876:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144661.661915:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746683136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4309us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.661923:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5897 00000100:00100000:1.0:1746144661.661942:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5898 00000100:00100000:1.0:1746144661.661947:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746683264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144661.661960:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144661.661982:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 17 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.661993:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 17 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.662015:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009badfa00/0xa7c849b16e01a55c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 917504->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee4c expref: 17 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.662028:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.662031:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.662036:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.662044:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.662081:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144661.662091:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747492608:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144661.662173:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.670646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.670730:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746683520 00000100:00100000:3.0:1746144661.670743:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746683520 00000100:00100000:1.0:1746144661.670766:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747492608:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144661.670791:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746144661.670798:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008b9a3b80 x1830964746683520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.670808:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3b80 with x1830964746683520 ext(0->1048575) 00002000:00010000:3.0:1746144661.670813:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a3b80 00000100:00100000:3.0:1746144661.670838:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4529 00000100:00100000:1.0:1746144661.670842:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746683264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 8893us (9150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.670846:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746683520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144661.670853:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5898 00000100:00100000:0.0:1746144661.677611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.677990:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746683904 00000100:00100000:1.0:1746144661.678000:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746683904 00002000:00100000:1.0:1746144661.678049:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008b9a0000 x1830964746683904/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.678058:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0000 with x1830964746683904 ext(2097152->3145727) 00010000:00010000:1.0:1746144661.678076:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.678092:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144661.678099:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a0000 00000100:00100000:1.0:1746144661.678130:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 886 00000100:00100000:1.0:1746144661.678156:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746683904:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144661.678532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.679508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.679531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.679567:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746684032 00000100:00100000:2.0:1746144661.679572:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746684032 00000100:00100000:3.0:1746144661.679575:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746684416 00000100:00100000:3.0:1746144661.679579:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746684416 00002000:00100000:2.0:1746144661.679595:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800937a1180 x1830964746684032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.679600:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b480e00 x1830964746684416/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.679603:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a1180 with x1830964746684032 ext(3145728->4194303) 00002000:00100000:3.0:1746144661.679608:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480e00 with x1830964746684416 ext(3145728->4194303) 00010000:00010000:2.0:1746144661.679609:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 18 pid: 8450 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.679612:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b480e00 00010000:00010000:2.0:1746144661.679619:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 18 pid: 8450 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144661.679624:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937a1180 00000100:00100000:3.0:1746144661.679625:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746684288 00000100:00100000:3.0:1746144661.679626:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746684288 00002000:00100000:3.0:1746144661.679636:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009b483480 x1830964746684288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746144661.679636:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 887 00000100:00100000:2.0:1746144661.679640:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746684032:12345-192.168.204.23@tcp:3:multiop.0 00002000:00100000:3.0:1746144661.679644:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483480 with x1830964746684288 ext(2097152->3145727) 00002000:00010000:3.0:1746144661.679646:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b483480 00000100:00100000:3.0:1746144661.679657:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4530 00000100:00100000:3.0:1746144661.679662:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746684416:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144661.681919:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4531 00000100:00100000:0.0:1746144661.681935:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746684288:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.692804:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746683520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21945us (22162us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.692818:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4529 00002000:00100000:3.0:1746144661.692831:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008b9a3b80 x1830964746683520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.692842:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3b80 with x1830964746683520 ext(0->1048575) 00002000:00010000:3.0:1746144661.692849:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a3b80 00000100:00100000:1.0:1746144661.708126:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746683904:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 29958us (30514us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.708152:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 886 00002000:00100000:1.0:1746144661.708165:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88008b9a0000 x1830964746683904/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.708174:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0000 with x1830964746683904 ext(2097152->3145727) 00010000:00010000:1.0:1746144661.708185:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 18 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:1.0:1746144661.708200:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 18 pid: 8450 timeout: 740 lvb_type: 0 00002000:00010000:1.0:1746144661.708207:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a0000 00000100:00100000:3.0:1746144661.708848:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746684032:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 29203us (30312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.708856:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 887 00002000:00100000:3.0:1746144661.708862:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800937a1180 x1830964746684032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.708869:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a1180 with x1830964746684032 ext(3145728->4194303) 00010000:00010000:3.0:1746144661.708875:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.708885:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00002000:00010000:3.0:1746144661.708891:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937a1180 00010000:00010000:0.0:1746144661.711783:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746144661.714270:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746684416:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 34591us (34745us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.714286:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4530 00002000:00100000:3.0:1746144661.714302:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b480e00 x1830964746684416/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.714313:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480e00 with x1830964746684416 ext(3145728->4194303) 00002000:00010000:3.0:1746144661.714319:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b480e00 00000100:00100000:0.0:1746144661.716046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.716166:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746684672 00000100:00100000:3.0:1746144661.716175:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746684672 00000100:00100000:3.0:1746144661.716220:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11825 00000100:00100000:3.0:1746144661.716227:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:29172:x1830964746684672:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.716247:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.716269:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eedf expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.716302:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.716309:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144661.716310:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144661.716314:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 16 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.716345:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 12 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.716355:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 12 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.716368:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747492736:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.716473:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.718722:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746684288:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 36784us (39179us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144661.718736:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4531 00002000:00100000:2.0:1746144661.718749:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009b483480 x1830964746684288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.718758:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b483480 with x1830964746684288 ext(2097152->3145727) 00002000:00010000:2.0:1746144661.718765:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b483480 00000100:00100000:0.0:1746144661.721882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.721916:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747492736:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.721956:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 16 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.721982:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e486200, rc 0) 00000100:00100000:3.0:1746144661.722039:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29172:x1830964746684672:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5811us (6001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.722048:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11825 00000100:00100000:2.0:1746144661.722442:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746684800 00000100:00100000:2.0:1746144661.722449:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746684800 00002000:00100000:2.0:1746144661.722488:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1179647) req@ffff8800937a0700 x1830964746684800/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.722498:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0700 with x1830964746684800 ext(1048576->1179647) 00010000:00010000:2.0:1746144661.722505:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 11 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.722516:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 11 pid: 4758 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144661.722522:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a0700 00000100:00100000:2.0:1746144661.722539:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 888 00000100:00100000:2.0:1746144661.722546:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746684800:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144661.723879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.724126:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746684928 00000100:00100000:2.0:1746144661.724131:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746684928 00010000:00010000:2.0:1746144661.724168:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.724369:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5899 00000100:00100000:2.0:1746144661.724377:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746684928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.724389:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.724411:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.724422:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.724443:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009423aa00/0xa7c849b16e01a612 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeca expref: 16 pid: 8450 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.724459:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.724462:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.724469:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.724477:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.724510:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.724523:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747492864:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144661.724708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.725315:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746685056 00000100:00100000:3.0:1746144661.725319:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746685056 00000100:00100000:2.0:1746144661.725344:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.725361:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10101 00000100:00080000:2.0:1746144661.725361:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144661.725368:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29176:x1830964746685056:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144661.725391:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.725406:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ea400/0xa7c849b16e01a62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eee6 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.725468:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.725480:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.725489:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.725501:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.725506:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.725512:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144661.725850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.725992:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746685184 00000100:00100000:2.0:1746144661.725996:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746685184 00000100:00100000:2.0:1746144661.726026:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11826 00000100:00100000:2.0:1746144661.726031:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:29169:x1830964746685184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.726039:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.726048:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eeed expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.726063:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.726081:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144661.726083:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144661.726086:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.726106:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.726116:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 17 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.726125:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747492992:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.726174:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d63c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144661.727407:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.727424:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.727430:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.727452:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 310 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.727461:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 310 pid: 15388 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.727470:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747493120:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.727519:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.728772:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746684800:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 6221us (6894us total) trans 21474840503 rc 0/0 00000100:00100000:0.0:1746144661.728782:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 888 00002000:00100000:0.0:1746144661.728794:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1179647) req@ffff8800937a0700 x1830964746684800/t21474840503(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.728803:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0700 with x1830964746684800 ext(1048576->1179647) 00010000:00010000:0.0:1746144661.728811:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:0.0:1746144661.728822:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.728883:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747492864:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.728899:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.728929:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746684928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4547us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.728937:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5899 00000100:00100000:3.0:1746144661.728975:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747493120:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.728989:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144661.729047:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747492992:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.729077:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 16 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.729093:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323400, rc 0) 00000100:00100000:2.0:1746144661.729114:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:29169:x1830964746685184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3082us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.729121:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11826 00002000:00010000:0.0:1746144661.729577:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800937a0700 00000100:00100000:0.0:1746144661.729918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.729952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.729998:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746685696 00000100:00100000:1.0:1746144661.730005:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746685696 00000100:00100000:1.0:1746144661.730038:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4081 00000100:00100000:1.0:1746144661.730046:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29069:x1830964746685696:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746144661.730094:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746685440 00000100:00100000:2.0:1746144661.730098:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746685440 00002000:00100000:2.0:1746144661.730121:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2277376->2281471) req@ffff8800937a2a00 x1830964746685440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.730129:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a2a00 with x1830964746685440 ext(2277376->2281471) 00010000:00010000:2.0:1746144661.730150:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 16 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.730159:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 16 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144661.730166:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937a2a00 00000100:00100000:2.0:1746144661.730192:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 889 00000100:00100000:2.0:1746144661.730199:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746685440:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144661.730357:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746685440:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 157us (439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144661.730363:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 889 00002000:00100000:2.0:1746144661.730368:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2277376->2281471) req@ffff8800937a2a00 x1830964746685440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.730381:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a2a00 with x1830964746685440 ext(2277376->2281471) 00010000:00010000:2.0:1746144661.730386:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 16 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.730394:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 16 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144661.730400:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937a2a00 00000100:00100000:1.0:1746144661.730645:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:29069:x1830964746685696:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 600us (692us total) trans 8589943992 rc 0/0 00000100:00100000:1.0:1746144661.730651:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4081 00000100:00100000:1.0:1746144661.734178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.734243:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746685824 00000100:00100000:3.0:1746144661.734252:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746685824 00000100:00100000:1.0:1746144661.734278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144661.734286:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.734310:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746685952 00000100:00100000:3.0:1746144661.734312:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746685952 00010000:00010000:3.0:1746144661.734324:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 312 pid: 15388 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.734339:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5900 00000100:00100000:3.0:1746144661.734345:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746685824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.734358:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144661.734541:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5901 00000100:00100000:2.0:1746144661.734549:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:1961:x1830964746685952:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.734559:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.734566:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 312 pid: 15388 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.734577:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 312 pid: 15388 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.734598:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46fe00/0xa7c849b16e01a491 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eddc expref: 312 pid: 15388 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.734615:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.734620:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.734630:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.734641:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.734659:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.734700:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1961:x1830964746685952:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.734706:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5901 00010000:00010000:3.0:1746144661.734896:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.734906:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.734907:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.734914:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.734921:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb26c00/0xa7c849b16e01a563 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee53 expref: 13 pid: 4758 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.734939:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.734941:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.734947:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.734955:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746144661.734957:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:2.0:1746144661.734961:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144661.734978:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.734988:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.734989:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.734997:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144661.735001:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747493248:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.735028:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735034:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735040:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3eb000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.735043:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735050:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144661.735072:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2540 going to sleep for 11 seconds 00010000:00010000:2.0:1746144661.735171:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144661.735175:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144661.735178:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735183:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eb000/0xa7c849b16e01a635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735191:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735196:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735200:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735205:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3eae00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.735207:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735211:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735217:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041600) 00010000:00010000:2.0:1746144661.735218:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144661.735220:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735225:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eae00/0xa7c849b16e01a63c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.735258:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3ea400/0xa7c849b16e01a62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 12 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.735269:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 11 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.735275:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.735277:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144661.735279:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3eaa00, rc 0) 00000100:00100000:2.0:1746144661.735753:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29176:x1830964746685056:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 10384us (11043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.735760:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10101 00000100:00100000:3.0:1746144661.739602:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747493248:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.739629:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.739690:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746685824:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5342us (5520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.739701:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5900 00000100:00100000:3.0:1746144661.745480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.745517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.745536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.745566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.745591:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746686080 00000100:00100000:3.0:1746144661.745600:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746686080 00000100:00100000:3.0:1746144661.745643:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746686208 00000100:00100000:3.0:1746144661.745644:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746686208 00000100:00100000:3.0:1746144661.745655:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746686336 00000100:00100000:3.0:1746144661.745656:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746686336 00000100:00100000:3.0:1746144661.745665:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746686464 00000100:00100000:3.0:1746144661.745666:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746686464 00000100:00100000:3.0:1746144661.745678:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11827 00000100:00100000:3.0:1746144661.745685:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746686080:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144661.745703:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.745721:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eef4 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.745745:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.745747:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.745756:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.745771:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.745782:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5345600, rc 0) 00000100:00100000:3.0:1746144661.745828:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746686080:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 143us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.745834:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11827 00000100:00100000:3.0:1746144661.745849:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11828 00000100:00100000:3.0:1746144661.745854:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746686208:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144661.745860:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.745871:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eefb expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.745882:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.745883:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.745887:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.745897:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.745909:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344000, rc 0) 00000100:00100000:3.0:1746144661.745923:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746686208:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 69us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.745928:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11828 00000100:00100000:0.0:1746144661.745934:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11829 00000100:00100000:3.0:1746144661.745939:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11830 00000100:00100000:0.0:1746144661.745943:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746686336:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:3.0:1746144661.745944:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746686464:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144661.745949:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144661.745950:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.745954:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008be71600/0xa7c849b16e01a65f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef09 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.745959:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef02 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.745970:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.745972:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.745977:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144661.745987:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144661.745989:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747493376:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144661.745994:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2de600, rc 0) 00000100:00100000:0.0:1746144661.746295:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746686336:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 354us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144661.746300:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11829 00000100:00100000:3.0:1746144661.746312:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.746382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.746402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.746417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.746445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.746451:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746686592 00000100:00100000:3.0:1746144661.746454:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746686592 00000100:00100000:0.0:1746144661.746475:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746686848 00000100:00100000:0.0:1746144661.746478:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746686848 00000100:00100000:3.0:1746144661.746480:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746687232 00000100:00100000:3.0:1746144661.746483:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746687232 00000100:00100000:3.0:1746144661.746496:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11831 00000100:00100000:3.0:1746144661.746500:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746686592:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144661.746506:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746144661.746506:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800937a0e00 x1830964746686848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746144661.746514:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef10 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746144661.746515:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0e00 with x1830964746686848 ext(1048576->2097151) 00002000:00010000:0.0:1746144661.746520:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a0e00 00010000:00010000:3.0:1746144661.746524:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.746526:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.746531:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144661.746531:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746687104 00000100:00100000:0.0:1746144661.746533:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746687104 00010000:00010000:3.0:1746144661.746540:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746144661.746545:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2277376->3145727) req@ffff8800937a0380 x1830964746687104/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746144661.746546:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093022000, rc 0) 00002000:00100000:0.0:1746144661.746551:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0380 with x1830964746687104 ext(2277376->3145727) 00010000:00010000:0.0:1746144661.746555:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 16 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.746559:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746686592:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.746564:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11831 00010000:00010000:0.0:1746144661.746566:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 16 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:0.0:1746144661.746573:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937a0380 00000100:00100000:3.0:1746144661.746574:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11832 00000100:00100000:3.0:1746144661.746578:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+12:29164:x1830964746687232:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144661.746584:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144661.746585:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 890 00010000:00010000:3.0:1746144661.746589:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef17 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.746590:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746687104:12345-192.168.204.23@tcp:4:multiop.0 00010000:00010000:3.0:1746144661.746603:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 16 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.746610:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.746617:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.746622:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.746623:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.746625:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2224127] (req 2097152->2224127) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.746644:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.746653:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144661.746661:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747493504:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.746687:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.746696:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 7 pid: 30345 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144661.746703:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747493632:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.746729:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 16 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.746736:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 16 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.746743:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747493760:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.746758:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.746776:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4532 00000100:00100000:3.0:1746144661.746781:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746686848:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.751132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.752584:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746687488 00000100:00100000:2.0:1746144661.752596:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746687488 00000100:00100000:2.0:1746144661.752646:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10102 00000100:00100000:2.0:1746144661.752654:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29178:x1830964746687488:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.752696:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.752716:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e487600/0xa7c849b16e01a67b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef1e expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.752816:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.752833:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.752840:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.752873:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.752883:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 10 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.752895:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747493888:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.752961:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.754314:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747493504:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.754326:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747493632:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144661.754335:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747493760:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.754364:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2224127] (req 2097152->2224127) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.754380:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c30f600, rc 0) 00000100:00100000:3.0:1746144661.754420:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:29164:x1830964746687232:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7840us (7973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.754428:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11832 00000100:00100000:2.0:1746144661.754516:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747493376:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.754536:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008be71600/0xa7c849b16e01a65f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef09 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.754545:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008be71600/0xa7c849b16e01a65f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef09 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.754570:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be71600, rc 0) 00000100:00100000:2.0:1746144661.754599:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746686464:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 8655us (9032us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.754606:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11830 00000100:00100000:2.0:1746144661.758772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.759337:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746687744 00000100:00100000:3.0:1746144661.759347:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746687744 00010000:00010000:3.0:1746144661.759383:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 8 pid: 30345 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144661.759412:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5902 00000100:00100000:3.0:1746144661.759419:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746687744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.759434:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.759459:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 8 pid: 30345 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.759469:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 8 pid: 30345 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.759492:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093022000/0xa7c849b16e01a66d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef10 expref: 8 pid: 30345 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.759511:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.759555:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746687744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 137us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.759561:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5902 00000100:00100000:0.0:1746144661.759653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.759707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.759946:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746687616 00000100:00100000:3.0:1746144661.759950:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746687616 00000100:00100000:0.0:1746144661.759961:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747493888:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144661.759962:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 740 lvb_type: 1 00000100:00100000:3.0:1746144661.759976:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746687872 00000100:00100000:3.0:1746144661.759977:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746687872 00010000:00010000:0.0:1746144661.759983:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.759986:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 18 pid: 10724 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.759998:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5903 00000100:00100000:3.0:1746144661.760003:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746687616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.760009:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.760018:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.760026:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.760037:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f348600/0xa7c849b16e01a57f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee6f expref: 13 pid: 10724 timeout: 740 lvb_type: 1 00010000:00010000:3.0:1746144661.760051:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.760515:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746687616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 510us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.760521:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5903 00000100:00100000:3.0:1746144661.760531:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5904 00000100:00100000:3.0:1746144661.760535:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746687872:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.760541:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.760548:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 18 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.760556:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 18 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.760566:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f349200/0xa7c849b16e01a571 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee61 expref: 18 pid: 10724 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.760574:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.760575:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.760582:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.760589:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.760614:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.760624:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747494016:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.760665:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.761193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.761236:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.761325:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746688128 00000100:00100000:3.0:1746144661.761329:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746688128 00000100:00100000:3.0:1746144661.761354:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10103 00000100:00100000:3.0:1746144661.761360:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29176:x1830964746688128:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144661.761375:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.761391:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009945f400/0xa7c849b16e01a689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef25 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.761556:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.761567:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.761573:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144661.762109:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746686848:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15327us (15705us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.762116:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4532 00002000:00100000:3.0:1746144661.762125:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800937a0e00 x1830964746686848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.762146:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0e00 with x1830964746686848 ext(1048576->2097151) 00002000:00010000:3.0:1746144661.762151:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800937a0e00 00000100:00100000:3.0:1746144661.762169:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746688256 00000100:00100000:3.0:1746144661.762172:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746688256 00010000:00010000:3.0:1746144661.762183:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 13 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.762203:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5905 00000100:00100000:3.0:1746144661.762208:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746688256:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.762213:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.762217:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 13 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.762224:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 13 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.762235:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01a64a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eee6 expref: 13 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.762243:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.762247:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.762253:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.762258:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.762264:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.762268:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.762273:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.762298:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.762312:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746688256:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.762317:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5905 00010000:00010000:3.0:1746144661.762329:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144661.762334:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:3.0:1746144661.762343:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144661.762428:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009945f400/0xa7c849b16e01a689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef25 expref: 13 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.762437:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef25 expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.762443:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.762445:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144661.762447:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009945e400, rc 0) 00000100:00100000:3.0:1746144661.762464:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29176:x1830964746688128:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 1105us (1273us total) trans 8589943993 rc 0/0 00000100:00100000:3.0:1746144661.762469:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10103 00010000:00010000:1.0:1746144661.762605:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144661.762611:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144661.762621:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144661.762674:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e487600/0xa7c849b16e01a67b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 314 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.762688:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 313 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.762694:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144661.762696:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746144661.762698:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e486a00, rc 0) 00000100:00100000:1.0:1746144661.762716:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:29178:x1830964746687488:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10063us (11592us total) trans 8589943994 rc 0/0 00000100:00100000:1.0:1746144661.762721:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10102 00000100:00100000:2.0:1746144661.763661:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746687104:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 17067us (17238us total) trans 17179873262 rc 0/0 00000100:00100000:2.0:1746144661.763669:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 890 00002000:00100000:2.0:1746144661.763674:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2277376->3145727) req@ffff8800937a0380 x1830964746687104/t17179873262(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.763687:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800937a0380 with x1830964746687104 ext(2277376->3145727) 00010000:00010000:2.0:1746144661.763694:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 18 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:2.0:1746144661.763705:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 18 pid: 29370 timeout: 740 lvb_type: 0 00002000:00010000:2.0:1746144661.763710:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800937a0380 00000100:00100000:0.0:1746144661.764588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.764718:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746688512 00000100:00100000:2.0:1746144661.764723:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746688512 00000100:00100000:2.0:1746144661.764753:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10104 00000100:00100000:2.0:1746144661.764759:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29176:x1830964746688512:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144661.764778:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.764781:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144661.764798:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009945e400/0xa7c849b16e01a690 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef25 expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.764813:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.764816:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144661.764826:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a6a5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef2c expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.764901:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.764915:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 312 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.764926:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 4/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.764953:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 312 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.764963:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 312 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:2.0:1746144661.764975:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747494144:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.765040:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.765182:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747494016:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.765198:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.765219:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1960:x1830964746687872:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4683us (5511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.765227:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5904 00000100:00100000:2.0:1746144661.765533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.765588:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746688640 00000100:00100000:3.0:1746144661.765592:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746688640 00010000:00010000:3.0:1746144661.765607:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 18 pid: 29370 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.765635:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5906 00000100:00100000:3.0:1746144661.765640:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746688640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.765650:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.765670:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 18 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.765679:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 18 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.765693:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e487400/0xa7c849b16e01a620 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed8 expref: 18 pid: 29370 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.765706:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.765708:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.765714:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.765721:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.765731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144661.765744:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.765753:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747494272:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144661.765791:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746688896 00000100:00100000:2.0:1746144661.765794:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746688896 00002000:00100000:2.0:1746144661.765819:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2220032->2224127) req@ffff880136958000 x1830964746688896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.765829:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958000 with x1830964746688896 ext(2220032->2224127) 00000100:00100000:3.0:1746144661.765830:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b23c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746144661.765833:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136958000 00000100:00100000:2.0:1746144661.765843:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4533 00000100:00100000:2.0:1746144661.765849:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746688896:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144661.765990:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746688896:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 141us (258us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144661.765996:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4533 00002000:00100000:2.0:1746144661.766002:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2220032->2224127) req@ffff880136958000 x1830964746688896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.766015:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958000 with x1830964746688896 ext(2220032->2224127) 00002000:00010000:2.0:1746144661.766017:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136958000 00000100:00100000:2.0:1746144661.767264:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747494144:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.767288:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144661.767296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.767349:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746689152 00000100:00100000:3.0:1746144661.767354:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746689152 00010000:00010000:3.0:1746144661.767374:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 313 pid: 14709 timeout: 740 lvb_type: 0 00000100:00100000:3.0:1746144661.767403:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5907 00000100:00100000:3.0:1746144661.767409:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:1963:x1830964746689152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.767418:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.767423:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 313 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.767432:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 313 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.767450:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e486a00/0xa7c849b16e01a682 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef1e expref: 313 pid: 14709 timeout: 740 lvb_type: 0 00010000:00010000:3.0:1746144661.767461:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144661.767466:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.767478:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.767484:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144661.767497:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.767534:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:1963:x1830964746689152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 125us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.767541:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5907 00000100:00100000:3.0:1746144661.767580:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747494272:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.767588:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.767603:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746688640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1963us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.767609:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5906 00000100:00100000:0.0:1746144661.767633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.767682:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746689408 00000100:00100000:1.0:1746144661.767687:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746689408 00000100:00100000:1.0:1746144661.767710:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4082 00000100:00100000:1.0:1746144661.767715:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+30:29164:x1830964746689408:12345-192.168.204.23@tcp:35:multiop.0 00010000:00010000:2.0:1746144661.767813:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767819:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767835:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767840:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767845:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767850:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e7e400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.767854:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767860:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767866:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.767869:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144661.767872:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.767876:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ac lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144661.767882:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+31:29164:x1830964746689408:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 167us (249us total) trans 8589943995 rc 0/0 00000100:00100000:1.0:1746144661.767888:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4082 00010000:00010000:2.0:1746144661.767903:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a6a5 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef2c expref: 12 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.767911:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a6a5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef2c expref: 12 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.767918:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e200, rc 0) 00000100:00100000:2.0:1746144661.767938:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29176:x1830964746688512:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3179us (3353us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.767943:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10104 00000100:00100000:0.0:1746144661.770832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.770901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.770957:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746689792 00000100:00100000:3.0:1746144661.770967:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746689792 00002000:00100000:3.0:1746144661.771012:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013695b480 x1830964746689792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.771022:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b480 with x1830964746689792 ext(3145728->4194303) 00002000:00010000:3.0:1746144661.771027:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695b480 00000100:00100000:3.0:1746144661.771052:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746689920 00000100:00100000:3.0:1746144661.771055:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746689920 00002000:00100000:3.0:1746144661.771079:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136959c00 x1830964746689920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.771085:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959c00 with x1830964746689920 ext(3145728->4194303) 00002000:00010000:3.0:1746144661.771088:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959c00 00000100:00100000:3.0:1746144661.771108:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4534 00000100:00100000:3.0:1746144661.771114:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746689792:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144661.771192:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4535 00000100:00100000:2.0:1746144661.771200:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746689920:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144661.777630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.777677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.777736:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746690048 00000100:00100000:2.0:1746144661.777738:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746690176 00000100:00100000:3.0:1746144661.777746:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746690048 00000100:00100000:2.0:1746144661.777746:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746690176 00000100:00100000:3.0:1746144661.777801:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11833 00000100:00100000:3.0:1746144661.777810:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746690048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.777830:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144661.777840:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11834 00000100:00100000:2.0:1746144661.777847:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1961:x1830964746690176:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.777848:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef33 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.777855:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.777865:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef3a expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.777869:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.777872:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.777882:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 33 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.777897:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 33 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.777908:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3a4e00, rc 0) 00000100:00100000:2.0:1746144661.777908:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747494400:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144661.777949:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746690048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 140us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.777955:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11833 00000100:00100000:2.0:1746144661.778006:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.779448:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746689920:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 8244us (8541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144661.779456:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4535 00002000:00100000:2.0:1746144661.779465:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136959c00 x1830964746689920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.779474:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959c00 with x1830964746689920 ext(3145728->4194303) 00002000:00010000:2.0:1746144661.779479:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959c00 00000100:00100000:0.0:1746144661.781627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.782351:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746690432 00000100:00100000:2.0:1746144661.782359:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746690432 00000100:00100000:2.0:1746144661.782399:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4083 00000100:00100000:2.0:1746144661.782405:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29176:x1830964746690432:12345-192.168.204.23@tcp:35:mirror_io.0 00002000:00010000:3.0:1746144661.782542:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144661 -> 1746144662 00002000:00010000:3.0:1746144661.782546:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144661 -> 1746144662 00000100:00100000:3.0:1746144661.782568:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747494400:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144661.782597:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef3a expref: 16 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.782610:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a6ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef3a expref: 16 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.782639:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e400, rc 0) 00000100:00100000:3.0:1746144661.782685:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1961:x1830964746690176:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4837us (5006us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144661.782692:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11834 00000100:00100000:2.0:1746144661.782860:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29176:x1830964746690432:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 454us (1240us total) trans 8589943996 rc 0/0 00000100:00100000:2.0:1746144661.782866:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4083 00000100:00100000:2.0:1746144661.784399:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746689792:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 13282us (13576us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144661.784409:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4534 00002000:00100000:2.0:1746144661.784418:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013695b480 x1830964746689792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.784428:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b480 with x1830964746689792 ext(3145728->4194303) 00002000:00010000:2.0:1746144661.784432:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695b480 00000100:00100000:0.0:1746144661.790304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.790361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.790421:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746690560 00000100:00100000:2.0:1746144661.790459:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746690560 00000100:00100000:2.0:1746144661.790514:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746690688 00000100:00100000:2.0:1746144661.790517:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746690688 00000100:00100000:2.0:1746144661.790551:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11835 00000100:00100000:2.0:1746144661.790561:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746690560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.790582:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.790602:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef41 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.790626:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.790628:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.790638:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 18 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.790653:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 18 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.790665:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7ea00, rc 0) 00000100:00100000:2.0:1746144661.790708:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746690560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 150us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.790714:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11835 00000100:00100000:2.0:1746144661.790730:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11836 00000100:00100000:2.0:1746144661.790734:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746690688:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.790741:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.790756:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef48 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.790769:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.790771:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.790775:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 13 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.790790:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 13 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.790797:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f800, rc 0) 00000100:00100000:2.0:1746144661.790813:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746690688:12345-192.168.204.23@tcp:101:cat.0 Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.790819:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11836 00000100:00100000:0.0:1746144661.792517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.792585:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746690944 00000100:00100000:2.0:1746144661.792593:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746690944 00002000:00100000:2.0:1746144661.792643:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136959f80 x1830964746690944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.792656:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959f80 with x1830964746690944 ext(2097152->3145727) 00002000:00010000:2.0:1746144661.792663:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959f80 00000100:00100000:2.0:1746144661.792692:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4536 00000100:00100000:2.0:1746144661.792697:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746690944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.795401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.795470:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691200 00000100:00100000:1.0:1746144661.795481:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691200 00002000:00100000:1.0:1746144661.795518:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012d0c4380 x1830964746691200/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.795528:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4380 with x1830964746691200 ext(4194304->4935679) 00002000:00010000:1.0:1746144661.795534:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4380 00000100:00100000:1.0:1746144661.795553:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4537 00000100:00100000:1.0:1746144661.795559:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746691200:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144661.801545:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746690944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8836us (9020us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.801557:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4536 00002000:00100000:3.0:1746144661.801570:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136959f80 x1830964746690944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.801578:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959f80 with x1830964746690944 ext(2097152->3145727) 00002000:00010000:3.0:1746144661.801584:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959f80 00000100:00100000:1.0:1746144661.806662:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746691200:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11091us (11258us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144661.806678:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4537 00002000:00100000:1.0:1746144661.806692:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012d0c4380 x1830964746691200/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.806702:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4380 with x1830964746691200 ext(4194304->4935679) 00002000:00010000:1.0:1746144661.806708:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4380 00000100:00100000:0.0:1746144661.808423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.809794:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691328 00000100:00100000:1.0:1746144661.809812:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691328 00000100:00100000:1.0:1746144661.809963:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11837 00000100:00100000:1.0:1746144661.809972:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:29172:x1830964746691328:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.809991:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.810009:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef4f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.810041:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 12 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.810049:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144661.810051:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144661.810054:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 16 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.810098:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 12 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.810111:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 12 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144661.810130:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494528:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144661.810258:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.812478:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494528:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144661.812504:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 16 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.812521:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094624600, rc 0) 00000100:00100000:1.0:1746144661.812556:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29172:x1830964746691328:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2585us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.812563:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11837 00000100:00100000:0.0:1746144661.820235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.820384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.820477:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691456 00000100:00100000:1.0:1746144661.820488:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691456 00002000:00100000:1.0:1746144661.820538:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2224127) req@ffff88012d0c6d80 x1830964746691456/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.820548:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6d80 with x1830964746691456 ext(2097152->2224127) 00010000:00010000:1.0:1746144661.820557:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 13 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144661.820571:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 13 pid: 30345 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746144661.820578:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d0c6d80 00000100:00100000:2.0:1746144661.820596:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691584 00000100:00100000:2.0:1746144661.820601:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691584 00000100:00100000:1.0:1746144661.820612:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 891 00000100:00100000:1.0:1746144661.820620:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746691456:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144661.820626:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11838 00000100:00100000:2.0:1746144661.820633:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746691584:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144661.820643:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.820660:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a6d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef56 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.820711:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494656:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144661.820790:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.824953:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494656:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144661.824991:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a6d6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef56 expref: 16 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.825006:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a6d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef56 expref: 16 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.825022:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380e00, rc 0) 00000100:00100000:3.0:1746144661.825077:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746691584:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4443us (4692us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144661.825087:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11838 00000100:00100000:1.0:1746144661.829502:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746691456:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8868us (9266us total) trans 21474840504 rc 0/0 00000100:00100000:1.0:1746144661.829517:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 891 00002000:00100000:1.0:1746144661.829532:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2224127) req@ffff88012d0c6d80 x1830964746691456/t21474840504(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:302/0 lens 488/448 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.829542:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6d80 with x1830964746691456 ext(2097152->2224127) 00010000:00010000:1.0:1746144661.829553:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 15 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144661.829570:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 15 pid: 30345 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746144661.829578:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d0c6d80 00000100:00100000:0.0:1746144661.830774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.830833:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691712 00000100:00100000:3.0:1746144661.830843:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691712 00000100:00100000:3.0:1746144661.830888:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11839 00000100:00100000:3.0:1746144661.830895:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1963:x1830964746691712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.830913:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.830928:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090a39c00/0xa7c849b16e01a6dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef5d expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144661.830977:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494784:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144661.832048:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144661.833085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144661.833383:0:8453:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88008b9a0380 x1830964747494784) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 16 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144661.833387:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691840 00000100:00100000:3.0:1746144661.833393:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691840 00010000:00010000:2.0:1746144661.833420:0:8453:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 16 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144661.833445:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c30f600/0xa7c849b16e01a674 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2224127) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef17 expref: 16 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144661.833460:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494784:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144661.833479:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.833480:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.833487:0:8453:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.833494:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.833523:0:8453:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 15 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.833533:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494912:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144661.833572:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 639 00000100:00100000:3.0:1746144661.833579:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746691840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.833590:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144661.833590:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144661.833593:0:7101:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie a7c849b16e01a674) 00010000:00010000:3.0:1746144661.833594:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.833614:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746691840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 36us (535us total) trans 0 rc 116/116 00000100:00100000:3.0:1746144661.834318:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 639 00000100:00100000:2.0:1746144661.836437:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747494912:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.836473:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090a39c00/0xa7c849b16e01a6dd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef5d expref: 15 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.836490:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090a39c00/0xa7c849b16e01a6dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef5d expref: 15 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.836500:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a39c00, rc 0) 00000100:00100000:2.0:1746144661.838921:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746691712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8012us (8137us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144661.838934:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11839 00000100:00100000:0.0:1746144661.839218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.839320:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746691968 00000100:00100000:2.0:1746144661.839328:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746691968 00000100:00100000:2.0:1746144661.839365:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11840 00000100:00100000:2.0:1746144661.839372:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29178:x1830964746691968:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.839391:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.839410:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef64 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.839441:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.839450:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.839457:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.839459:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.839462:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.839499:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144661.839512:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746144661.839524:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747495040:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.839611:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.839620:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 17 pid: 29370 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144661.839627:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747495168:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.839658:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.843324:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747495040:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144661.843337:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747495168:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144661.843364:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.843383:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53be800, rc 0) 00000100:00100000:2.0:1746144661.843440:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:29178:x1830964746691968:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4067us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.843452:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11840 00000100:00100000:0.0:1746144661.846230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.846265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.846294:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746692224 00000100:00100000:1.0:1746144661.846304:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746692224 00000100:00100000:0.0:1746144661.846304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.846323:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746692480 00000100:00100000:0.0:1746144661.846326:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746692480 00002000:00100000:0.0:1746144661.846349:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d4380 x1830964746692480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.846350:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8801309d5f80 x1830964746692224/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.846359:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5f80 with x1830964746692224 ext(2097152->3145727) 00002000:00100000:0.0:1746144661.846359:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4380 with x1830964746692480 ext(3145728->4194303) 00002000:00010000:1.0:1746144661.846364:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d5f80 00002000:00010000:0.0:1746144661.846364:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d4380 00000100:00100000:0.0:1746144661.847020:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746692736 00000100:00100000:0.0:1746144661.847024:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746692736 00002000:00100000:0.0:1746144661.847040:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8801309d7800 x1830964746692736/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144661.847046:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d7800 with x1830964746692736 ext(3145728->4194303) 00010000:00010000:0.0:1746144661.847053:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746144661.847076:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 741 lvb_type: 1 00002000:00010000:0.0:1746144661.847083:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801309d7800 00000100:00100000:1.0:1746144661.847542:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 892 00000100:00100000:1.0:1746144661.847551:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746692736:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144661.847608:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4538 00000100:00100000:2.0:1746144661.847616:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4539 00000100:00100000:3.0:1746144661.847618:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746692224:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144661.847668:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746692480:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144661.848880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.848950:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746692864 00000100:00100000:3.0:1746144661.848956:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746692864 00010000:00010000:3.0:1746144661.848982:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 18 pid: 29370 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144661.849010:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5908 00000100:00100000:3.0:1746144661.849015:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746692864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144661.849025:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144661.849039:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 18 pid: 29370 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144661.849054:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 18 pid: 29370 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144661.849083:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f323400/0xa7c849b16e01a643 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eeed expref: 18 pid: 29370 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144661.849111:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.849164:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746692864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 149us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.849169:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5908 00000100:00100000:1.0:1746144661.862944:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746692736:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 15384us (16628us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144661.862956:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 892 00002000:00100000:1.0:1746144661.862967:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8801309d7800 x1830964746692736/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.862977:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d7800 with x1830964746692736 ext(3145728->4194303) 00010000:00010000:1.0:1746144661.862986:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144661.863001:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 34 pid: 30345 timeout: 741 lvb_type: 1 00002000:00010000:1.0:1746144661.863008:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801309d7800 00000100:00100000:2.0:1746144661.867437:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746692480:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 19802us (21158us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144661.867448:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4539 00002000:00100000:2.0:1746144661.867459:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d4380 x1830964746692480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.867468:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4380 with x1830964746692480 ext(3145728->4194303) 00002000:00010000:2.0:1746144661.867473:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d4380 00000100:00100000:3.0:1746144661.871929:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746692224:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 24302us (25695us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.871940:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4538 00002000:00100000:3.0:1746144661.871951:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8801309d5f80 x1830964746692224/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.871961:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5f80 with x1830964746692224 ext(2097152->3145727) 00002000:00010000:3.0:1746144661.871967:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d5f80 00000100:00100000:2.0:1746144661.878956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.879050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.879120:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746693120 00000100:00100000:3.0:1746144661.879130:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746693120 00000100:00100000:3.0:1746144661.879185:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11841 00000100:00100000:3.0:1746144661.879192:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:29172:x1830964746693120:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.879212:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.879229:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef6b expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.879253:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.879254:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144661.879266:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.879282:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.879292:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a38c00, rc 0) 00000100:00100000:3.0:1746144661.879333:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29172:x1830964746693120:12345-192.168.204.23@tcp:101:cat.0 Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.879338:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11841 00000100:00100000:0.0:1746144661.879391:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746692992 00000100:00100000:0.0:1746144661.879397:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746692992 00010000:00010000:0.0:1746144661.879414:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 35 pid: 30345 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746144661.879430:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5909 00000100:00100000:0.0:1746144661.879434:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746692992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144661.879441:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144661.879460:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 35 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746144661.879475:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 35 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746144661.879489:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3a4e00/0xa7c849b16e01a6b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef33 expref: 35 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746144661.879504:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.879506:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144661.879509:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.879516:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144661.879541:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144661.879551:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747495296:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144661.879594:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144661.883351:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747495296:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144661.883372:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144661.883422:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746692992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3986us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144661.883435:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5909 00000100:00100000:0.0:1746144661.884561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.884604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.884616:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746693376 00000100:00100000:3.0:1746144661.884625:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746693376 00002000:00100000:3.0:1746144661.884670:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8801309d5880 x1830964746693376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.884680:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5880 with x1830964746693376 ext(3145728->4194303) 00002000:00010000:3.0:1746144661.884684:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5880 00000100:00100000:3.0:1746144661.884790:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746693504 00000100:00100000:3.0:1746144661.884793:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746693504 00002000:00100000:3.0:1746144661.884802:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2744320->2748415) req@ffff8801309d6300 x1830964746693504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.884809:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d6300 with x1830964746693504 ext(2744320->2748415) 00002000:00010000:3.0:1746144661.884812:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d6300 00000100:00100000:3.0:1746144661.884830:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4540 00000100:00100000:3.0:1746144661.884837:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746693376:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144661.886708:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4541 00000100:00100000:1.0:1746144661.886719:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746693504:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144661.886815:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746693504:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 99us (2210us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144661.886820:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4541 00002000:00100000:1.0:1746144661.886827:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2744320->2748415) req@ffff8801309d6300 x1830964746693504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144661.886835:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d6300 with x1830964746693504 ext(2744320->2748415) 00002000:00010000:1.0:1746144661.886840:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d6300 00000100:00100000:3.0:1746144661.893657:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746693376:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 8808us (9087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144661.893671:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4540 00002000:00100000:3.0:1746144661.893684:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8801309d5880 x1830964746693376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144661.893694:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5880 with x1830964746693376 ext(3145728->4194303) 00002000:00010000:3.0:1746144661.893700:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5880 00000100:00100000:0.0:1746144661.906839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144661.908352:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144661.908371:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746693760 00000100:00100000:1.0:1746144661.908381:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746693760 00000100:00100000:1.0:1746144661.908444:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11842 00000100:00100000:1.0:1746144661.908453:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29178:x1830964746693760:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144661.908474:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.908494:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef72 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.908614:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.908622:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.908624:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144661.908628:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->2326527] (req 2097152->2326527) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.908661:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.908673:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144661.908735:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746693888 00000100:00100000:3.0:1746144661.908739:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746693888 00000100:00100000:3.0:1746144661.908763:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11843 00000100:00100000:3.0:1746144661.908768:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746693888:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.908777:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.908787:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a39e00/0xa7c849b16e01a6f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef79 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.908807:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a39e00/0xa7c849b16e01a6f9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef79 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.908822:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a39e00/0xa7c849b16e01a6f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef79 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.908838:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a39e00, rc 0) 00000100:00100000:3.0:1746144661.908886:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746693888:12345-192.168.204.23@tcp:101:cat.0 Request processed in 117us (538us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144661.908905:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11843 00000100:00100000:1.0:1746144661.911415:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747495424:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144661.911549:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144661.921055:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747495424:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144661.921102:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->2326527] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.921121:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebec000, rc 0) 00000100:00100000:1.0:1746144661.921211:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29178:x1830964746693760:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 12758us (14382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144661.921220:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11842 00000100:00100000:0.0:1746144661.921570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.922664:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746694144 00000100:00100000:2.0:1746144661.922674:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746694144 00002000:00100000:2.0:1746144661.922721:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8801309d5c00 x1830964746694144/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.922732:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5c00 with x1830964746694144 ext(4194304->4935679) 00002000:00010000:2.0:1746144661.922737:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5c00 00000100:00100000:2.0:1746144661.922772:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4542 00000100:00100000:2.0:1746144661.922780:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746694144:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144661.926313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.926805:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746694272 00000100:00100000:2.0:1746144661.926814:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746694272 00010000:00010000:2.0:1746144661.926854:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144661.926964:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5910 00000100:00100000:2.0:1746144661.926972:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746694272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144661.926986:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144661.927009:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144661.927022:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144661.927044:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094624600/0xa7c849b16e01a6cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef4f expref: 17 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144661.927079:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.927081:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144661.927089:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.927098:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.927155:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144661.927168:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747495552:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144661.928096:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144661.931697:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747495552:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144661.931722:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144661.931781:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746694272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4808us (5478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144661.931793:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5910 00000100:00100000:2.0:1746144661.933924:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746694144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11134us (12345us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144661.933935:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4542 00002000:00100000:2.0:1746144661.933948:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8801309d5c00 x1830964746694144/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/440 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.933958:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5c00 with x1830964746694144 ext(4194304->4935679) 00002000:00010000:2.0:1746144661.933964:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5c00 00000100:00100000:3.0:1746144661.934259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.934389:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746694528 00000100:00100000:2.0:1746144661.934396:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746694528 00002000:00100000:2.0:1746144661.934426:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2322432->2326527) req@ffff88008b9a3100 x1830964746694528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/0 e 0 to 0 dl 1746144672 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.934433:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3100 with x1830964746694528 ext(2322432->2326527) 00002000:00010000:2.0:1746144661.934436:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3100 00000100:00100000:2.0:1746144661.934456:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4543 00000100:00100000:2.0:1746144661.934462:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746694528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144661.934636:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746694528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 173us (376us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144661.934642:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4543 00002000:00100000:2.0:1746144661.934648:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2322432->2326527) req@ffff88008b9a3100 x1830964746694528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:302/0 lens 488/4536 e 0 to 0 dl 1746144672 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144661.934654:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3100 with x1830964746694528 ext(2322432->2326527) 00002000:00010000:2.0:1746144661.934657:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3100 00000100:00100000:0.0:1746144661.937702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.937806:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746694784 00000100:00100000:2.0:1746144661.937815:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746694784 00000100:00100000:0.0:1746144661.938105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.938162:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4084 00000100:00100000:2.0:1746144661.938170:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:29178:x1830964746694784:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144661.938412:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:29178:x1830964746694784:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 241us (718us total) trans 8589943997 rc 0/0 00000100:00100000:2.0:1746144661.938419:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4084 00000100:00100000:1.0:1746144661.939639:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746694912 00000100:00100000:1.0:1746144661.939645:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746694912 00000100:00100000:1.0:1746144661.939683:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11844 00000100:00100000:1.0:1746144661.939689:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746694912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144661.939701:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144661.939717:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1253e00/0xa7c849b16e01a700 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef80 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144661.939745:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1253e00/0xa7c849b16e01a700 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef80 expref: 35 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.939753:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1253e00/0xa7c849b16e01a700 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef80 expref: 35 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144661.939765:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1253e00, rc 0) 00000100:00100000:1.0:1746144661.939789:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746694912:12345-192.168.204.23@tcp:101:cat.0 Request processed in 101us (1685us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144661.939794:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11844 00000100:00100000:0.0:1746144661.945382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144661.945451:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746695040 00000100:00100000:3.0:1746144661.945461:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746695040 00000100:00100000:3.0:1746144661.946001:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11845 00000100:00100000:3.0:1746144661.946011:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746695040:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144661.946030:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144661.946057:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a39800/0xa7c849b16e01a707 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef87 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144661.946101:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a39800/0xa7c849b16e01a707 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef87 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.946112:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a39800/0xa7c849b16e01a707 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef87 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144661.946169:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a39800, rc 0) 00000100:00100000:3.0:1746144661.946222:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1963:x1830964746695040:12345-192.168.204.23@tcp:101:cat.0 Request processed in 212us (848us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144661.946229:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11845 00000100:00100000:0.0:1746144661.995758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144661.995911:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746695296 00000100:00100000:2.0:1746144661.995920:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746695296 00000100:00100000:2.0:1746144661.996017:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10105 00000100:00100000:2.0:1746144661.996026:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+31:29185:x1830964746695296:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144661.996052:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144661.996083:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035400/0xa7c849b16e01a70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef8e expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.996236:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996250:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996262:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996280:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996284:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996289:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996395:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996403:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996409:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144661.996417:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144661.996508:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996515:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996521:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996527:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094034400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.996531:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996537:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996549:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144661.996552:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144661.996556:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996560:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094034400/0xa7c849b16e01a715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996590:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996595:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996600:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996604:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094035e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144661.996605:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996610:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996616:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8b00) 00010000:00010000:2.0:1746144661.996618:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144661.996620:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996624:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035e00/0xa7c849b16e01a71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144661.996662:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035400/0xa7c849b16e01a70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 34 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.996673:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 33 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144661.996679:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144661.996681:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144661.996683:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094034200, rc 0) 00000100:00100000:2.0:1746144661.996748:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+33:29185:x1830964746695296:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 722us (1000us total) trans 8589943998 rc 0/0 00000100:00100000:2.0:1746144661.996754:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10105 00000100:00100000:0.0:1746144662.073236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.073293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.073391:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746695424 00000100:00100000:1.0:1746144662.073400:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746695424 00000100:00100000:1.0:1746144662.073460:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746695552 00000100:00100000:1.0:1746144662.073462:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746695552 00000100:00100000:3.0:1746144662.073643:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11846 00000100:00100000:3.0:1746144662.073655:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746695424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.073675:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.073695:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a38e00/0xa7c849b16e01a731 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef95 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.073732:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a38e00/0xa7c849b16e01a731 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef95 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.073743:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a38e00/0xa7c849b16e01a731 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef95 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.073759:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a38e00, rc 0) 00000100:00100000:3.0:1746144662.073809:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746695424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 158us (585us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.073815:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11846 00000100:00100000:3.0:1746144662.073832:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11847 00000100:00100000:3.0:1746144662.073836:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746695552:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.073843:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.073853:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090a39600/0xa7c849b16e01a738 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ef9c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.073896:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747495680:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144662.073955:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.074455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.074504:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746695808 00000100:00100000:3.0:1746144662.074508:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746695808 00000100:00100000:3.0:1746144662.074548:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10106 00000100:00100000:3.0:1746144662.074553:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:29187:x1830964746695808:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144662.074567:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.074579:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090a39800/0xa7c849b16e01a73f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efa3 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.074672:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.074687:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 32 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.074694:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.074715:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 32 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.074727:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 32 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.074735:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747495808:192.168.204.23@tcp:104: 00000100:00080000:2.0:1746144662.075684:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746144662.075690:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746144662.075694:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144662.076078:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.077083:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747495680:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144662.077114:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090a39600/0xa7c849b16e01a738 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef9c expref: 15 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.077127:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090a39600/0xa7c849b16e01a738 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef9c expref: 15 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.077157:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a39600, rc 0) 00000100:00100000:3.0:1746144662.077193:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746695552:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3354us (3907us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.077200:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11847 00000100:00100000:0.0:1746144662.079029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.079111:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746695936 00000100:00100000:2.0:1746144662.079120:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746695936 00010000:00010000:2.0:1746144662.079224:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 33 pid: 14709 timeout: 741 lvb_type: 0 00000100:00080000:0.0:1746144662.079281:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144662.079531:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747495808:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.079551:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:2.0:1746144662.079655:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5911 00000100:00100000:2.0:1746144662.079663:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746695936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.079679:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.079686:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 33 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.079697:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 33 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.079718:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094034200/0xa7c849b16e01a723 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef8e expref: 33 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.079736:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.079740:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.079749:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.079756:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.079773:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.079828:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746695936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 166us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.079835:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5911 00010000:00010000:2.0:1746144662.079855:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.079861:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144662.079881:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144662.080030:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090a39800/0xa7c849b16e01a73f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 316 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.080043:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 315 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.080049:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.080052:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144662.080055:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380e00, rc 0) 00000100:00100000:2.0:1746144662.080092:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:29187:x1830964746695808:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5538us (5637us total) trans 8589943999 rc 0/0 00000100:00100000:2.0:1746144662.080098:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10106 00000100:00100000:0.0:1746144662.087087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.087169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.087291:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746696192 00000100:00100000:1.0:1746144662.087301:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746696192 00002000:00100000:1.0:1746144662.087351:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920af480 x1830964746696192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.087361:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af480 with x1830964746696192 ext(0->1048575) 00002000:00010000:1.0:1746144662.087367:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920af480 00000100:00100000:1.0:1746144662.087387:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746696448 00000100:00100000:1.0:1746144662.087390:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746696448 00002000:00100000:1.0:1746144662.087401:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ae300 x1830964746696448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.087408:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ae300 with x1830964746696448 ext(1048576->2097151) 00002000:00010000:1.0:1746144662.087411:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ae300 00000100:00100000:1.0:1746144662.087423:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4544 00000100:00100000:1.0:1746144662.087430:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746696192:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144662.088013:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4545 00000100:00100000:2.0:1746144662.088021:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746696448:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144662.100126:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746696192:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12680us (13033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144662.100164:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4544 00002000:00100000:1.0:1746144662.100178:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920af480 x1830964746696192/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.100188:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af480 with x1830964746696192 ext(0->1048575) 00002000:00010000:1.0:1746144662.100194:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920af480 00000100:00100000:2.0:1746144662.101429:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746696448:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13403us (14254us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.101438:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4545 00002000:00100000:2.0:1746144662.101445:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ae300 x1830964746696448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.101453:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ae300 with x1830964746696448 ext(1048576->2097151) 00002000:00010000:2.0:1746144662.101457:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ae300 00000100:00100000:0.0:1746144662.122890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.122960:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746696576 00000100:00100000:3.0:1746144662.122970:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746696576 00000100:00100000:0.0:1746144662.123005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.123202:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746696704 00000100:00100000:3.0:1746144662.123205:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746696704 00000100:00100000:3.0:1746144662.123348:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11848 00000100:00100000:0.0:1746144662.123355:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11849 00000100:00100000:3.0:1746144662.123361:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746696576:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144662.123365:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746696704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.123381:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.123381:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.123403:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e487400/0xa7c849b16e01a754 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efb1 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.123453:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01a75b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efaa expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.123460:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747495936:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144662.123546:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746144662.123650:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01a75b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efaa expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.123666:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01a75b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efaa expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.123692:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380600, rc 0) 00000100:00100000:3.0:1746144662.123734:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746696576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 378us (856us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.123740:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11848 00000100:00100000:0.0:1746144662.126773:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747495936:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144662.126808:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e487400/0xa7c849b16e01a754 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb1 expref: 15 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.126822:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e487400/0xa7c849b16e01a754 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb1 expref: 15 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.126842:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e487400, rc 0) 00000100:00100000:0.0:1746144662.127543:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746696704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4178us (4535us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144662.127552:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11849 00000100:00100000:0.0:1746144662.150615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.150735:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746696832 00000100:00100000:2.0:1746144662.150745:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746696832 00000100:00100000:2.0:1746144662.150803:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11850 00000100:00100000:2.0:1746144662.150811:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+17:29190:x1830964746696832:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144662.150832:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.150854:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efb8 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.150885:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 33 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.150892:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144662.150895:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144662.150899:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 18 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.150931:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 33 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.150943:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 33 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144662.150956:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747496064:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.154852:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.154910:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747496064:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.154942:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 18 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.154962:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094034200, rc 0) 00000100:00100000:2.0:1746144662.156323:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:29190:x1830964746696832:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5505us (5711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.156334:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11850 00000100:00100000:3.0:1746144662.156604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.156788:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746696960 00000100:00100000:0.0:1746144662.156796:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746696960 00002000:00100000:0.0:1746144662.156847:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2744320->3145727) req@ffff88008b9a0380 x1830964746696960/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.156856:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0380 with x1830964746696960 ext(2744320->3145727) 00010000:00010000:0.0:1746144662.156863:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.156877:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 34 pid: 8453 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.156883:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a0380 00000100:00100000:0.0:1746144662.156908:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 893 00000100:00100000:0.0:1746144662.156915:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746696960:12345-192.168.204.23@tcp:4:multiop.0 00000100:00080000:2.0:1746144662.157429:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144662.163575:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746696960:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 6644us (6956us total) trans 17179873263 rc 0/0 00000100:00100000:2.0:1746144662.163590:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 893 00002000:00100000:2.0:1746144662.163605:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2744320->3145727) req@ffff88008b9a0380 x1830964746696960/t17179873263(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.163622:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0380 with x1830964746696960 ext(2744320->3145727) 00010000:00010000:2.0:1746144662.163633:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.163652:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.163658:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008b9a0380 00000100:00100000:0.0:1746144662.173529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.173631:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746697088 00000100:00100000:1.0:1746144662.173641:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746697088 00010000:00010000:1.0:1746144662.173682:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.173722:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5912 00000100:00100000:1.0:1746144662.173729:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746697088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.173744:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.173767:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.173784:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.173806:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01a6e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef64 expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.173824:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.173826:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.173833:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.173841:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.173872:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144662.173883:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747496192:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144662.173962:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.177890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.178730:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746697216 00000100:00100000:2.0:1746144662.178742:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746697216 00000100:00100000:2.0:1746144662.178792:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11851 00000100:00100000:2.0:1746144662.178801:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746697216:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144662.178822:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.178843:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efbf expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.178871:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.178873:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.178882:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 37 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.178900:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 37 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.178911:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094035e00, rc 0) 00000100:00100000:2.0:1746144662.178964:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746697216:12345-192.168.204.23@tcp:101:cat.0 Request processed in 164us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.178971:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11851 00000100:00100000:0.0:1746144662.180509:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747496192:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144662.180530:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.180574:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746697088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6843us (7055us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.180590:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5912 00000100:00100000:0.0:1746144662.182348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.182454:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746697472 00000100:00100000:2.0:1746144662.182462:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746697472 00002000:00100000:2.0:1746144662.182508:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce86680 x1830964746697472/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.182518:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86680 with x1830964746697472 ext(2097152->3145727) 00002000:00010000:2.0:1746144662.182523:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce86680 00000100:00100000:2.0:1746144662.182673:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4546 00000100:00100000:2.0:1746144662.183612:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746697472:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144662.198826:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746697472:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16133us (16473us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.198840:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4546 00002000:00100000:3.0:1746144662.198853:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce86680 x1830964746697472/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.198863:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86680 with x1830964746697472 ext(2097152->3145727) 00002000:00010000:3.0:1746144662.198869:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce86680 00000100:00100000:0.0:1746144662.203693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.203734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.203761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.203793:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746697728 00000100:00100000:0.0:1746144662.203803:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746697728 00002000:00100000:0.0:1746144662.203853:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce84000 x1830964746697728/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.203863:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84000 with x1830964746697728 ext(2097152->3145727) 00002000:00010000:0.0:1746144662.203869:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84000 00000100:00100000:0.0:1746144662.203882:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746697984 00000100:00100000:0.0:1746144662.203884:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746697984 00002000:00100000:0.0:1746144662.203916:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2326528->3375103) req@ffff88012ce85180 x1830964746697984/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.203922:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85180 with x1830964746697984 ext(2326528->3375103) 00002000:00010000:0.0:1746144662.203925:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85180 00000100:00100000:0.0:1746144662.203932:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746698240 00000100:00100000:0.0:1746144662.203934:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746698240 00002000:00100000:0.0:1746144662.203942:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3375104->4194303) req@ffff88012ce84e00 x1830964746698240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.203949:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84e00 with x1830964746698240 ext(3375104->4194303) 00002000:00010000:0.0:1746144662.203951:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84e00 00000100:00100000:0.0:1746144662.203962:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4547 00000100:00100000:0.0:1746144662.203969:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746697728:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.205239:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4548 00000100:00100000:0.0:1746144662.205246:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746697984:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.206566:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4549 00000100:00100000:0.0:1746144662.206573:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746698240:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.207638:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.208620:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746698368 00000100:00100000:3.0:1746144662.208628:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746698368 00000100:00100000:3.0:1746144662.208662:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11852 00000100:00100000:3.0:1746144662.208668:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:29190:x1830964746698368:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.208680:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.208698:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efc6 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.208724:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.208733:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144662.208735:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144662.208738:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.208764:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.208773:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.208785:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496320:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.208844:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2300 going to sleep for 11 seconds 00000100:00080000:2.0:1746144662.210240:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144662.220204:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746697728:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16221us (16507us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.220216:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4547 00002000:00100000:2.0:1746144662.220229:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce84000 x1830964746697728/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.220238:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84000 with x1830964746697728 ext(2097152->3145727) 00002000:00010000:2.0:1746144662.220243:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84000 00000100:00100000:1.0:1746144662.222211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.222307:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496320:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.222341:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.222360:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380600, rc 0) 00000100:00100000:2.0:1746144662.222406:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:29190:x1830964746698368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 13738us (14768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.222418:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11852 00000100:00100000:2.0:1746144662.222446:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746698496 00000100:00100000:2.0:1746144662.222453:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746698496 00002000:00100000:2.0:1746144662.222486:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2326527) req@ffff880092878000 x1830964746698496/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.222494:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878000 with x1830964746698496 ext(2097152->2326527) 00010000:00010000:2.0:1746144662.222500:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 20 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.222512:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 20 pid: 30345 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.222518:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092878000 00000100:00100000:2.0:1746144662.222532:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 894 00000100:00100000:2.0:1746144662.222539:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746698496:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144662.225616:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746697984:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20361us (21871us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144662.225616:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746698240:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19039us (21849us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746144662.225626:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4549 00002000:00100000:1.0:1746144662.225635:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3375104->4194303) req@ffff88012ce84e00 x1830964746698240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.225651:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84e00 with x1830964746698240 ext(3375104->4194303) 00010000:00010000:1.0:1746144662.225660:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.225674:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00002000:00010000:1.0:1746144662.225680:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce84e00 00000100:00100000:2.0:1746144662.225802:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4548 00002000:00100000:2.0:1746144662.225809:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2326528->3375103) req@ffff88012ce85180 x1830964746697984/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.225817:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85180 with x1830964746697984 ext(2326528->3375103) 00010000:00010000:2.0:1746144662.225822:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 18 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.225836:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 18 pid: 30345 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.225842:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce85180 00000100:00100000:1.0:1746144662.228623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.228710:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746698624 00000100:00100000:3.0:1746144662.228720:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746698624 00000100:00100000:3.0:1746144662.228766:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11853 00000100:00100000:3.0:1746144662.228774:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29195:x1830964746698624:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.228792:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.228808:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efcd expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.228836:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144662.228842:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 19 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.228854:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 19 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.228864:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8ffe00, rc 0) 00000100:00100000:3.0:1746144662.229006:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29195:x1830964746698624:12345-192.168.204.23@tcp:101:cat.0 Request processed in 232us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.229012:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11853 00000100:00100000:0.0:1746144662.230799:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746698496:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8254us (8587us total) trans 21474840505 rc 0/0 00000100:00100000:0.0:1746144662.230808:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 894 00002000:00100000:0.0:1746144662.230817:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2326527) req@ffff880092878000 x1830964746698496/t21474840505(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.230823:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878000 with x1830964746698496 ext(2097152->2326527) 00010000:00010000:0.0:1746144662.230831:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.230841:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.230846:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092878000 00000100:00100000:0.0:1746144662.234879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.235267:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746698752 00000100:00100000:2.0:1746144662.235278:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746698752 00010000:00010000:2.0:1746144662.235319:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144662.235356:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5913 00000100:00100000:2.0:1746144662.235364:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746698752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.235380:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.235406:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.235418:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.235442:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebec000/0xa7c849b16e01a6f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef72 expref: 19 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.235476:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.235478:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.235490:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 14 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.235504:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 14 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.235513:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.235515:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.235614:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.235624:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.235664:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.235677:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747496448:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144662.235773:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 14 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.235781:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747496576:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144662.235799:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.239356:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747496448:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144662.239370:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747496576:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144662.239370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144662.239389:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.239428:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1962:x1830964746698752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4064us (4559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.239437:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746698880 00000100:00100000:2.0:1746144662.239438:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5913 00000100:00100000:3.0:1746144662.239443:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746698880 00000100:00100000:3.0:1746144662.239487:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11854 00000100:00100000:3.0:1746144662.239494:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:29185:x1830964746698880:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144662.239682:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.239701:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efd4 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.239731:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.239739:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 17 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.239747:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 6 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.239754:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.239756:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.239759:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1241088->2097151] (req 1241088->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.239898:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 6 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.239911:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 6 pid: 8388 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746144662.239922:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496704:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.240002:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 17 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.240010:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 17 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746144662.240018:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496832:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.240043:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.240050:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.240071:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496960:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.240090:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.244238:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496704:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.244253:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496832:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.244261:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747496960:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.244294:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1241088->2097151] (req 1241088->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.244312:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fee00, rc 0) 00000100:00100000:3.0:1746144662.244644:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:29185:x1830964746698880:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5147us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.244653:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11854 00000100:00100000:0.0:1746144662.250305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.250365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.250497:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746699008 00000100:00100000:1.0:1746144662.250503:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746699136 00000100:00100000:2.0:1746144662.250508:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746699008 00000100:00100000:1.0:1746144662.250508:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746699136 00010000:00010000:2.0:1746144662.250545:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 7 pid: 8388 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.250545:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 18 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.250655:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5914 00000100:00100000:1.0:1746144662.250662:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746699136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.250677:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144662.250753:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5915 00010000:00010000:1.0:1746144662.250754:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 18 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746144662.250759:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746699008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.250767:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.250769:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 18 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746144662.250778:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 7 pid: 8388 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.250791:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f22b000/0xa7c849b16e01a467 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152edb2 expref: 18 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746144662.250883:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 7 pid: 8388 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.250895:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.250941:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746699136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 279us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.250947:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5914 00010000:00010000:2.0:1746144662.250975:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdac000/0xa7c849b16e01a3e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed50 expref: 7 pid: 8388 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746144662.251233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.251252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.251268:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746699520 00000100:00100000:0.0:1746144662.251271:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746699520 00002000:00100000:0.0:1746144662.251299:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d0a80 x1830964746699520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.251308:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0a80 with x1830964746699520 ext(2097152->3145727) 00002000:00010000:0.0:1746144662.251313:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d0a80 00000100:00100000:0.0:1746144662.251327:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4550 00000100:00100000:0.0:1746144662.251332:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746699520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144662.251502:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746699264 00000100:00100000:1.0:1746144662.251505:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746699264 00010000:00010000:1.0:1746144662.251518:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.251594:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.251617:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746699008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 858us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.251623:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5915 00000100:00100000:2.0:1746144662.251634:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5916 00000100:00100000:2.0:1746144662.251639:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746699264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.251645:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.251653:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.251665:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.251676:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01a3aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed2d expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.251685:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.251686:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.251692:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.251700:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.251729:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 15 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.251741:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747497088:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144662.251789:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.251932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.252025:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746699776 00000100:00100000:2.0:1746144662.252028:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746699776 00002000:00100000:2.0:1746144662.252041:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009287b100 x1830964746699776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.252048:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b100 with x1830964746699776 ext(3145728->4194303) 00002000:00010000:2.0:1746144662.252052:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287b100 00000100:00100000:2.0:1746144662.252105:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4551 00000100:00100000:2.0:1746144662.252110:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746699776:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.252302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.252535:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746700032 00000100:00100000:1.0:1746144662.252538:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746700032 00000100:00100000:0.0:1746144662.252547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:1.0:1746144662.252680:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d2300 x1830964746700032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.252689:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2300 with x1830964746700032 ext(2097152->3145727) 00002000:00010000:1.0:1746144662.252692:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d2300 00000100:00100000:0.0:1746144662.253321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.255106:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746700288 00000100:00100000:1.0:1746144662.255114:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746700288 00002000:00100000:1.0:1746144662.255158:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008c7d1c00 x1830964746700288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.255167:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1c00 with x1830964746700288 ext(3145728->4194303) 00002000:00010000:1.0:1746144662.255171:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d1c00 00000100:00100000:1.0:1746144662.255193:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746700544 00000100:00100000:1.0:1746144662.255195:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746700544 00002000:00100000:1.0:1746144662.255207:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d0000 x1830964746700544/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.255218:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0000 with x1830964746700544 ext(3145728->4194303) 00002000:00010000:1.0:1746144662.255221:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0000 00000100:00100000:1.0:1746144662.255231:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4552 00000100:00100000:1.0:1746144662.255236:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746700032:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144662.255366:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4553 00000100:00100000:0.0:1746144662.255375:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746700288:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144662.255990:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4554 00000100:00100000:1.0:1746144662.255995:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746700544:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144662.256569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.256583:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746700800 00000100:00100000:0.0:1746144662.256586:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746700800 00002000:00100000:0.0:1746144662.256604:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1241088->1245183) req@ffff88012e12fb80 x1830964746700800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.256611:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12fb80 with x1830964746700800 ext(1241088->1245183) 00002000:00010000:0.0:1746144662.256614:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12fb80 00000100:00100000:0.0:1746144662.256632:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4555 00000100:00100000:0.0:1746144662.256635:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746700800:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144662.256710:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746700800:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 74us (143us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144662.256718:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4555 00002000:00100000:0.0:1746144662.256721:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1241088->1245183) req@ffff88012e12fb80 x1830964746700800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.256726:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12fb80 with x1830964746700800 ext(1241088->1245183) 00002000:00010000:0.0:1746144662.256728:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12fb80 00000100:00100000:2.0:1746144662.257477:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747497088:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144662.257495:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.257521:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746699264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5881us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.257529:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5916 00000100:00100000:2.0:1746144662.266246:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746700288:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10860us (13686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.266260:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4553 00002000:00100000:2.0:1746144662.266272:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008c7d1c00 x1830964746700288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.266283:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1c00 with x1830964746700288 ext(3145728->4194303) 00002000:00010000:2.0:1746144662.266288:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d1c00 00000100:00100000:0.0:1746144662.283002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.283699:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746700928 00000100:00100000:3.0:1746144662.283708:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746700928 00000100:00100000:3.0:1746144662.283770:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11855 00000100:00100000:3.0:1746144662.283778:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+20:29185:x1830964746700928:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144662.283798:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.283818:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efdb expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.283851:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.283859:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 6 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.283865:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.283875:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.283876:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.283879:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.283910:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 35 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.283920:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 35 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746144662.283932:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747497216:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.284036:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 6 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.284044:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 6 pid: 8450 timeout: 741 lvb_type: 1 00000100:00100000:3.0:1746144662.284052:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747497344:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.284085:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.284093:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 21 pid: 29370 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.284105:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747497472:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.284117:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.284531:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746700544:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 28534us (31210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144662.284541:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4554 00002000:00100000:1.0:1746144662.284550:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d0000 x1830964746700544/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.284559:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0000 with x1830964746700544 ext(3145728->4194303) 00002000:00010000:1.0:1746144662.284564:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0000 00000100:00100000:2.0:1746144662.284864:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746699776:12345-192.168.204.23@tcp:3:cat.0 Request processed in 32752us (32931us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.284871:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4551 00002000:00100000:2.0:1746144662.284877:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009287b100 x1830964746699776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.284884:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b100 with x1830964746699776 ext(3145728->4194303) 00002000:00010000:2.0:1746144662.284887:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287b100 00000100:00100000:3.0:1746144662.288697:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747497216:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.288709:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747497472:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.290740:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746699520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 39396us (39475us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144662.290752:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746700032:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 35515us (38450us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.290756:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4550 00000100:00100000:0.0:1746144662.290758:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4552 00002000:00100000:2.0:1746144662.290768:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d0a80 x1830964746699520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.290768:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d2300 x1830964746700032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.290777:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0a80 with x1830964746699520 ext(2097152->3145727) 00002000:00100000:0.0:1746144662.290777:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2300 with x1830964746700032 ext(2097152->3145727) 00002000:00010000:2.0:1746144662.290782:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d0a80 00002000:00010000:0.0:1746144662.290782:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d2300 00000100:00100000:0.0:1746144662.293358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.293387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.293414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.293467:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701056 00000100:00100000:0.0:1746144662.293468:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701184 00000100:00100000:1.0:1746144662.293476:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701056 00000100:00100000:0.0:1746144662.293476:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701184 00010000:00010000:1.0:1746144662.293512:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 20 pid: 29370 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.293512:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00000100:00100000:0.0:1746144662.293540:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701312 00000100:00100000:0.0:1746144662.293542:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701312 00010000:00010000:0.0:1746144662.293552:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 36 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.293779:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5917 00000100:00100000:1.0:1746144662.293787:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746701184:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.293807:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.293835:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746144662.293866:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5918 00000100:00100000:0.0:1746144662.293877:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5919 00000100:00100000:0.0:1746144662.293883:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746701312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144662.293886:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746701056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.293891:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.293892:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.293912:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00010000:00010000:2.0:1746144662.293941:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 20 pid: 29370 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.293944:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747497344:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.293948:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 20 pid: 29370 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.293969:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb27a00/0xa7c849b16e01a50f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee1b expref: 20 pid: 29370 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.293978:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 19 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.293989:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144662.294001:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 36 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746144662.294010:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 36 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:0.0:1746144662.294019:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009418ec00/0xa7c849b16e01a532 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ee30 expref: 36 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:2.0:1746144662.294026:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746701056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 154us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.294031:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5918 00010000:00010000:0.0:1746144662.294035:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.294048:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746701312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 166us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.294052:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5919 00010000:00010000:3.0:1746144662.294159:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fe400, rc 0) 00000100:00100000:3.0:1746144662.294184:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:29185:x1830964746700928:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10407us (11193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.294190:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11855 00010000:00010000:1.0:1746144662.294323:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2de600/0xa7c849b16e01a666 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef02 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.294344:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.294346:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.294353:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.294361:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.294395:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 17 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144662.294405:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747497600:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144662.294471:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.301007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.301042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.301256:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701440 00000100:00100000:0.0:1746144662.301256:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701568 00000100:00100000:3.0:1746144662.301264:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701440 00000100:00100000:0.0:1746144662.301264:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701568 00000100:00100000:1.0:1746144662.301279:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747497600:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144662.301298:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.301312:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11856 00000100:00100000:0.0:1746144662.301317:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11857 00000100:00100000:3.0:1746144662.301318:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746701440:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144662.301323:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746701568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.301335:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.301335:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144662.301339:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746701184:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7553us (7951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.301348:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5917 00010000:00010000:3.0:1746144662.301351:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a793 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efe2 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.301351:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff0600/0xa7c849b16e01a78c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152efe9 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.301397:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747497856:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144662.301398:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747497728:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144662.301454:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.301459:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.303070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.303130:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701952 00000100:00100000:1.0:1746144662.303236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.303352:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746701824 00000100:00100000:3.0:1746144662.303357:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701824 00002000:00100000:3.0:1746144662.303392:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880092879500 x1830964746701824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.303402:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879500 with x1830964746701824 ext(4194304->4935679) 00002000:00010000:3.0:1746144662.303407:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879500 00000100:00100000:3.0:1746144662.303423:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4556 00000100:00100000:3.0:1746144662.303429:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746701824:12345-192.168.204.23@tcp:3:cat.0 00002000:00010000:0.0:1746144662.303958:0:30345:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746144661 -> 1746144663 00002000:00010000:0.0:1746144662.303962:0:30345:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746144661 -> 1746144663 00002000:00010000:0.0:1746144662.303964:0:30345:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746144661 -> 1746144663 00000100:00100000:0.0:1746144662.303980:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747497728:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144662.304007:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0600/0xa7c849b16e01a78c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efe9 expref: 36 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.304020:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0600/0xa7c849b16e01a78c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efe9 expref: 36 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.304042:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0600, rc 0) 00000100:00100000:0.0:1746144662.304102:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746701568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2778us (3058us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144662.304109:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11857 00002000:00010000:0.0:1746144662.304192:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144661 -> 1746144663 00002000:00010000:0.0:1746144662.304196:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144661 -> 1746144663 00002000:00010000:0.0:1746144662.304197:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144661 -> 1746144663 00000100:00100000:0.0:1746144662.304211:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747497856:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144662.304230:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a793 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efe2 expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.304240:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a793 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efe2 expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.304253:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fe600, rc 0) 00000100:00100000:0.0:1746144662.304274:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746701440:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2956us (3278us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.304277:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746701952 00000100:00100000:0.0:1746144662.304279:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11856 00002000:00100000:2.0:1746144662.304335:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1232896->1236991) req@ffff88012e12e680 x1830964746701952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.304343:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12e680 with x1830964746701952 ext(1232896->1236991) 00002000:00010000:2.0:1746144662.304348:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12e680 00000100:00100000:2.0:1746144662.304397:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4557 00000100:00100000:2.0:1746144662.304405:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746701952:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144662.304563:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746701952:12345-192.168.204.23@tcp:3:cat.0 Request processed in 158us (1496us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144662.304569:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4557 00002000:00100000:2.0:1746144662.304574:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1232896->1236991) req@ffff88012e12e680 x1830964746701952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.304581:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12e680 with x1830964746701952 ext(1232896->1236991) 00002000:00010000:2.0:1746144662.304584:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12e680 00000100:00100000:0.0:1746144662.313926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.314037:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746702208 00000100:00100000:2.0:1746144662.314047:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746702208 00000100:00100000:2.0:1746144662.314102:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11858 00000100:00100000:2.0:1746144662.314110:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746702208:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144662.314129:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144662.314393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.314429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.314432:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746702336 00000100:00100000:0.0:1746144662.314436:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746702336 00000100:00100000:1.0:1746144662.314446:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746702592 00000100:00100000:1.0:1746144662.314449:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746702592 00000100:00100000:0.0:1746144662.314469:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11859 00000100:00100000:0.0:1746144662.314474:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746702336:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144662.314479:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4085 00010000:00010000:0.0:1746144662.314482:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144662.314484:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:29185:x1830964746702592:12345-192.168.204.23@tcp:35:multiop.0 00010000:00010000:0.0:1746144662.314500:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01a79a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eff7 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.314555:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747497984:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144662.314722:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:29185:x1830964746702592:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 236us (291us total) trans 8589944000 rc 0/0 00000100:00100000:1.0:1746144662.314729:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4085 00000100:00100000:0.0:1746144662.316017:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746144662.316122:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094034800/0xa7c849b16e01a7a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152eff0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.316189:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747498112:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144662.316250:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.317050:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746701824:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13618us (13811us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144662.317067:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4556 00002000:00100000:3.0:1746144662.317076:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880092879500 x1830964746701824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.317084:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879500 with x1830964746701824 ext(4194304->4935679) 00002000:00010000:3.0:1746144662.317088:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092879500 00000100:00100000:3.0:1746144662.325401:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747498112:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144662.325436:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094034800/0xa7c849b16e01a7a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eff0 expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.325453:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094034800/0xa7c849b16e01a7a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eff0 expref: 18 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.325469:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094034800, rc 0) 00000100:00100000:3.0:1746144662.325523:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746702208:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11412us (11605us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.325536:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11858 00000100:00100000:2.0:1746144662.326101:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747497984:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144662.326121:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01a79a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eff7 expref: 36 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.326131:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01a79a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eff7 expref: 36 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.326158:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1a00, rc 0) 00000100:00100000:2.0:1746144662.326188:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746702336:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11713us (11795us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.326194:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11859 00000100:00100000:0.0:1746144662.337236:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.338552:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746702720 00000100:00100000:2.0:1746144662.338564:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746702720 00000100:00100000:2.0:1746144662.338607:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11860 00000100:00100000:2.0:1746144662.338614:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746702720:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144662.338634:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.338654:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094034800/0xa7c849b16e01a7a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152effe expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.338710:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747498240:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144662.338886:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.338998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.339127:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746702848 00000100:00100000:3.0:1746144662.339131:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746702848 00000100:00100000:3.0:1746144662.339166:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11861 00000100:00100000:3.0:1746144662.339171:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746702848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.339178:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.339187:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8ff600/0xa7c849b16e01a7af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f005 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.339211:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747498368:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144662.339237:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.343360:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747498240:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144662.343399:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094034800/0xa7c849b16e01a7a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152effe expref: 18 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.343412:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094034800/0xa7c849b16e01a7a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152effe expref: 18 pid: 30345 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144662.343648:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747498368:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144662.343666:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8ff600/0xa7c849b16e01a7af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f005 expref: 36 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.343675:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8ff600/0xa7c849b16e01a7af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f005 expref: 36 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.343972:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8ff600, rc 0) 00000100:00100000:3.0:1746144662.344033:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746702848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4860us (5033us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.344042:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11861 00010000:00010000:2.0:1746144662.344204:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094034800, rc 0) 00000100:00100000:2.0:1746144662.344828:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746702720:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6212us (7600us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.344834:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11860 00000100:00100000:0.0:1746144662.406366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.407726:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746702976 00000100:00100000:2.0:1746144662.407738:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746702976 00000100:00100000:2.0:1746144662.407789:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10107 00000100:00100000:2.0:1746144662.407798:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29201:x1830964746702976:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144662.407824:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.407844:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a7b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f00c expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.407913:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.407927:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.407939:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.407954:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.407960:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.407965:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.408095:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.408105:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 314 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.408112:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.408162:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 314 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.408174:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 314 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144662.408186:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747498496:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.408283:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.410164:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.410323:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747498496:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.410343:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144662.410413:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746703104 00000100:00100000:1.0:1746144662.410419:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746703104 00010000:00010000:1.0:1746144662.410448:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 315 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.410636:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5920 00000100:00100000:1.0:1746144662.410644:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:1962:x1830964746703104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.410656:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.410661:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 315 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.410671:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 315 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.410688:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f380e00/0xa7c849b16e01a746 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efa3 expref: 315 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.410714:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144662.410722:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.410732:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.410738:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.410783:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.410818:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+314:1962:x1830964746703104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 174us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.410824:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5920 00010000:00010000:3.0:1746144662.410912:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.410919:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144662.410962:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:3.0:1746144662.410965:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144662.410981:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.410991:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411000:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411006:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411011:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411016:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094034600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144662.411020:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411026:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411034:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144662.411037:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144662.411041:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411045:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094034600/0xa7c849b16e01a7bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411069:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411075:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411079:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411084:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094034a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144662.411086:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411091:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411097:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8a00) 00010000:00010000:3.0:1746144662.411099:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144662.411101:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411106:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094034a00/0xa7c849b16e01a7c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.411157:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a7b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.411169:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 13 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.411175:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144662.411177:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144662.411179:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094035600, rc 0) 00000100:00100000:3.0:1746144662.411214:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29201:x1830964746702976:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3418us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.411221:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10107 00000100:00100000:0.0:1746144662.415739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.415783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.415808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.415851:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.415894:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746703232 00000100:00100000:0.0:1746144662.415904:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746703232 00000100:00100000:0.0:1746144662.415941:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746703360 00000100:00100000:0.0:1746144662.415943:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746703360 00000100:00100000:0.0:1746144662.415954:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746703488 00000100:00100000:0.0:1746144662.415955:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746703488 00000100:00100000:0.0:1746144662.415963:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746703616 00000100:00100000:0.0:1746144662.415964:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746703616 00000100:00100000:0.0:1746144662.415977:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11862 00000100:00100000:0.0:1746144662.415983:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746703232:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144662.416001:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.416019:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01a7d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f013 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.416082:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747498624:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144662.416171:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11863 00000100:00100000:3.0:1746144662.416178:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746703360:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144662.416185:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.416195:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8fea00/0xa7c849b16e01a7d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f01a expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.416217:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747498752:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144662.416275:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11864 00000100:00100000:1.0:1746144662.416281:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746703488:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144662.416286:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.416293:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f021 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.416302:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.416304:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.416312:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 9 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.416326:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 9 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.416335:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c400, rc 0) 00000100:00100000:0.0:1746144662.416916:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.416937:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11865 00000100:00100000:0.0:1746144662.416943:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746703616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144662.416951:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.416958:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f028 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.416970:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.416972:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.416976:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.416985:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.416992:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0600, rc 0) 00000100:00100000:3.0:1746144662.417031:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.417258:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746703488:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 976us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.417265:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11864 00000100:00100000:0.0:1746144662.417370:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746703616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 426us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.417375:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11865 00000100:00100000:3.0:1746144662.422676:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747498752:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144662.422725:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8fea00/0xa7c849b16e01a7d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f01a expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.422741:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fea00/0xa7c849b16e01a7d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f01a expref: 8 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.422759:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fea00, rc 0) 00000100:00100000:2.0:1746144662.423011:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747498624:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144662.423066:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01a7d2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f013 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.423079:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01a7d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f013 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.423120:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0800, rc 0) 00000100:00100000:3.0:1746144662.423337:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746703360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7155us (7549us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.423347:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11863 00000100:00100000:2.0:1746144662.423480:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746703232:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7493us (7751us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.423486:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11862 00000100:00100000:3.0:1746144662.431754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.431790:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746703872 00000100:00100000:3.0:1746144662.431800:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746703872 00000100:00100000:3.0:1746144662.431846:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10108 00000100:00100000:3.0:1746144662.431853:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29201:x1830964746703872:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144662.431877:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.431897:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fec00/0xa7c849b16e01a7ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f02f expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.431999:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.432014:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.432021:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.432065:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.432076:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 14 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.432088:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747498880:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.432175:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.436443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.436492:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746704000 00000100:00100000:0.0:1746144662.436501:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746704000 00010000:00010000:0.0:1746144662.436542:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.436544:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747498880:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.436566:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144662.436570:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5921 00000100:00100000:0.0:1746144662.436577:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1962:x1830964746704000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.436589:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144662.436595:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.436605:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.436628:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035600/0xa7c849b16e01a7cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f00c expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.436653:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144662.436658:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.436666:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.436672:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.436698:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.436736:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1962:x1830964746704000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 159us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.436743:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5921 00010000:00010000:3.0:1746144662.436752:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.436758:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144662.436782:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144662.436934:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fec00/0xa7c849b16e01a7ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.436962:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.436969:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144662.436971:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144662.436973:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fe200, rc 0) 00000100:00100000:3.0:1746144662.436997:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29201:x1830964746703872:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5145us (5257us total) trans 8589944001 rc 0/0 00000100:00100000:3.0:1746144662.437007:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10108 00000100:00100000:0.0:1746144662.440263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.440370:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746704128 00000100:00100000:3.0:1746144662.440379:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746704128 00000100:00100000:3.0:1746144662.440431:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10109 00000100:00100000:3.0:1746144662.440439:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29201:x1830964746704128:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144662.440470:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.440521:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8ff600/0xa7c849b16e01a803 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f036 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.440607:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.440622:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.440628:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.440657:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.440668:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.440680:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747499008:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.440893:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.443453:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747499008:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144662.443478:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144662.444048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.444105:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746704256 00000100:00100000:2.0:1746144662.444112:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746704256 00010000:00010000:2.0:1746144662.444178:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 16 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.445664:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5922 00000100:00100000:1.0:1746144662.445689:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746704256:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.445707:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.445717:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 16 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.445730:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 16 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.445752:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe200/0xa7c849b16e01a7f5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f02f expref: 16 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.445786:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144662.445792:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.445801:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.445808:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.445831:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.445877:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746704256:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 204us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.445883:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5922 00010000:00010000:0.0:1746144662.446391:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.446398:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144662.446443:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:0.0:1746144662.446447:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144662.446462:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.446493:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8ff600/0xa7c849b16e01a803 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.446979:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.446986:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144662.446989:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144662.446992:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fe600, rc 0) 00000100:00100000:0.0:1746144662.447035:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29201:x1830964746704128:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6595us (6780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.447041:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10109 00000100:00100000:0.0:1746144662.449927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.450007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.450531:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746704384 00000100:00100000:2.0:1746144662.450542:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746704384 00000100:00100000:2.0:1746144662.450586:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746704512 00000100:00100000:2.0:1746144662.450588:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746704512 00000100:00100000:2.0:1746144662.450856:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11866 00000100:00100000:2.0:1746144662.450865:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746704384:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144662.450885:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.450903:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e01a811 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f03d expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.450962:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747499136:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144662.451045:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11867 00000100:00100000:0.0:1746144662.451063:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746704512:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144662.451072:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.451083:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01a818 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f044 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.451110:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499264:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144662.452294:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.452342:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.453437:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499264:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144662.453468:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01a818 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f044 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.453481:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01a818 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f044 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144662.453914:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747499136:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144662.453931:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e01a811 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f03d expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.453946:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094034400/0xa7c849b16e01a811 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f03d expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.453960:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094034400, rc 0) 00000100:00100000:2.0:1746144662.453997:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746704384:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3132us (4079us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.454005:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11866 00010000:00010000:1.0:1746144662.454164:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0000, rc 0) 00000100:00100000:1.0:1746144662.454188:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746704512:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3137us (4181us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144662.454194:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11867 00000100:00100000:0.0:1746144662.458572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.458781:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746704768 00000100:00100000:2.0:1746144662.458791:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746704768 00000100:00100000:2.0:1746144662.458839:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10110 00000100:00100000:2.0:1746144662.458847:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29201:x1830964746704768:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144662.458869:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.458889:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035400/0xa7c849b16e01a81f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f04b expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.458991:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459005:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459016:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459028:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459034:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459041:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459046:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094035000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144662.459050:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459064:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459074:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.459076:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144662.459080:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459085:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035000/0xa7c849b16e01a826 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.459123:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094035400/0xa7c849b16e01a81f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f04b expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.459130:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094035400/0xa7c849b16e01a81f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f04b expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.459160:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094035400, rc 0) 00000100:00100000:2.0:1746144662.459215:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29201:x1830964746704768:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 368us (654us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.459221:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10110 00000100:00100000:0.0:1746144662.464997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.467426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.467502:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705152 00000100:00100000:1.0:1746144662.467514:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705152 00000100:00100000:1.0:1746144662.467579:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11868 00000100:00100000:1.0:1746144662.467588:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29197:x1830964746705152:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144662.467673:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.467692:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f052 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.467726:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.467734:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.467741:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.467792:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.467794:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.467798:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 36 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.467830:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.467843:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.467854:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499392:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.468000:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705024 00000100:00100000:2.0:1746144662.468005:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705024 00000100:00100000:2.0:1746144662.468032:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4086 00000100:00100000:2.0:1746144662.468037:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29201:x1830964746705024:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746144662.468405:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29201:x1830964746705024:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 366us (3419us total) trans 8589944002 rc 0/0 00000100:00100000:2.0:1746144662.468412:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4086 00010000:00010000:1.0:1746144662.468491:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.468500:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 6 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.468507:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499520:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.468536:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.468543:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 17 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.468556:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499648:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.468574:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.471730:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499392:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.471744:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499520:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.471752:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747499648:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.471781:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 36 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.471799:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52dc00, rc 0) 00000100:00100000:1.0:1746144662.472241:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29197:x1830964746705152:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4652us (4820us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.472250:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11868 00000100:00100000:0.0:1746144662.475050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.475108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.475330:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705408 00000100:00100000:1.0:1746144662.475339:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705408 00010000:00010000:1.0:1746144662.475376:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 7 pid: 8453 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.475398:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705280 00000100:00100000:1.0:1746144662.475400:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705280 00010000:00010000:1.0:1746144662.475409:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.475437:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5923 00000100:00100000:1.0:1746144662.475444:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746705408:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.475458:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.475480:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 7 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.475490:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 7 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.475512:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52c400/0xa7c849b16e01a7e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f021 expref: 7 pid: 8453 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.475531:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.475566:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746705408:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 123us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.475572:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5923 00000100:00100000:1.0:1746144662.475584:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5924 00000100:00100000:1.0:1746144662.475588:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746705280:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.475595:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.475600:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.475608:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.475618:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094035e00/0xa7c849b16e01a769 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efbf expref: 36 pid: 30345 timeout: 741 lvb_type: 1 00010000:00010000:1.0:1746144662.475629:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.475640:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746705280:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 52us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.475645:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5924 00000100:00100000:0.0:1746144662.476355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.476468:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705536 00000100:00100000:3.0:1746144662.476472:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705536 00010000:00010000:3.0:1746144662.476486:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 18 pid: 30345 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.476499:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5925 00000100:00100000:3.0:1746144662.476504:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746705536:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.476511:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.476519:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 18 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.476527:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 18 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.476538:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094034200/0xa7c849b16e01a762 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efb8 expref: 18 pid: 30345 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.476613:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.476615:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.476623:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.476630:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.476660:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.476671:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747499776:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.476933:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.477444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.477746:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705664 00000100:00100000:0.0:1746144662.477750:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705664 00000100:00100000:0.0:1746144662.477786:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11869 00000100:00100000:0.0:1746144662.477792:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746705664:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144662.477807:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.477822:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff1800/0xa7c849b16e01a834 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f059 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.477859:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747499904:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144662.477902:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.478216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.478251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.478368:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705920 00000100:00100000:3.0:1746144662.478372:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705920 00000100:00100000:3.0:1746144662.478403:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746705792 00000100:00100000:3.0:1746144662.478405:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746705792 00000100:00100000:3.0:1746144662.478420:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11870 00000100:00100000:3.0:1746144662.478424:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746705920:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144662.478424:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11871 00000100:00100000:1.0:1746144662.478430:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746705792:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.478432:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.478435:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.478440:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe000/0xa7c849b16e01a83b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f067 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.478441:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a842 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f060 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.478457:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe000/0xa7c849b16e01a83b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f067 expref: 38 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144662.478465:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747500032:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144662.478470:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe000/0xa7c849b16e01a83b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f067 expref: 38 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.478479:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fe000, rc 0) 00000100:00100000:3.0:1746144662.478497:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1962:x1830964746705920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 72us (281us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144662.478497:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.478502:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11870 00000100:00100000:3.0:1746144662.478944:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747499776:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144662.478958:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.479316:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746705536:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2810us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.479325:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5925 00000100:00100000:0.0:1746144662.479796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.479878:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706176 00000100:00100000:3.0:1746144662.479882:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706176 00002000:00100000:3.0:1746144662.479909:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3072000->3076095) req@ffff8800a4dd5880 x1830964746706176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.479919:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5880 with x1830964746706176 ext(3072000->3076095) 00002000:00010000:3.0:1746144662.479924:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5880 00000100:00100000:3.0:1746144662.479945:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4558 00000100:00100000:3.0:1746144662.479950:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746706176:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144662.480111:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746706176:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 159us (315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144662.480117:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4558 00002000:00100000:3.0:1746144662.480123:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3072000->3076095) req@ffff8800a4dd5880 x1830964746706176/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.480130:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5880 with x1830964746706176 ext(3072000->3076095) 00002000:00010000:3.0:1746144662.480156:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5880 00000100:00100000:2.0:1746144662.481047:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747499904:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144662.481087:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff1800/0xa7c849b16e01a834 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f059 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.481100:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff1800/0xa7c849b16e01a834 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f059 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.481124:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1800, rc 0) 00000100:00100000:2.0:1746144662.481169:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1962:x1830964746705664:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3377us (3725us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.481175:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11869 00000100:00100000:1.0:1746144662.481250:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747500032:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144662.481267:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a842 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f060 expref: 36 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.481276:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a842 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f060 expref: 36 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.481284:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52de00, rc 0) 00000100:00100000:1.0:1746144662.481302:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746705792:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2872us (3050us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144662.481307:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11871 00000100:00100000:0.0:1746144662.483988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.484092:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706304 00000100:00100000:1.0:1746144662.484101:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706304 00000100:00100000:1.0:1746144662.484340:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11872 00000100:00100000:1.0:1746144662.484349:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29197:x1830964746706304:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144662.484367:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.484389:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f06e expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.484420:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 14 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.484428:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 6 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.484435:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.484442:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.484443:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.484446:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2977791] (req 2097152->2977791) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.484476:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.484488:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.484504:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500160:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.484598:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 6 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.484606:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 6 pid: 8450 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.484613:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500288:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.484634:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 14 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.484643:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 14 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.484650:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f33dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500416:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.484665:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.485883:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500160:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.485892:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500288:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144662.488061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.488319:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f33dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500416:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.488359:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2977791] (req 2097152->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.488377:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706432 00010000:00010000:1.0:1746144662.488382:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c600, rc 0) 00000100:00100000:3.0:1746144662.488385:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706432 00000100:00100000:1.0:1746144662.488421:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29197:x1830964746706304:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4073us (4443us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144662.488425:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00000100:00100000:1.0:1746144662.488429:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11872 00000100:00100000:3.0:1746144662.488446:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5926 00000100:00100000:3.0:1746144662.488452:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746706432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.488464:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.488487:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746144662.488496:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746144662.488516:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01a7e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f028 expref: 7 pid: 8450 timeout: 741 lvb_type: 1 00010000:00010000:3.0:1746144662.488526:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.488543:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746706432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 92us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.488549:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5926 00000100:00100000:0.0:1746144662.493722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.494185:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706560 00000100:00100000:2.0:1746144662.494196:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706560 00010000:00010000:2.0:1746144662.494237:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 15 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144662.494421:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5927 00000100:00100000:2.0:1746144662.494429:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746706560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.494447:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.494473:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 15 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.494485:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 15 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.494508:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f380600/0xa7c849b16e01a770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efc6 expref: 15 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.494528:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.494577:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746706560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 148us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.494584:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5927 00000100:00100000:1.0:1746144662.494738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.494921:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706688 00000100:00100000:3.0:1746144662.494926:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706688 00010000:00010000:3.0:1746144662.494941:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.494957:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5928 00000100:00100000:3.0:1746144662.494962:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746706688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.494969:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.494977:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.494986:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.494999:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8ffe00/0xa7c849b16e01a777 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efcd expref: 18 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.495009:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.495011:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.495017:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.495027:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.495070:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.495082:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747500544:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.495128:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.497125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.497668:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706816 00000100:00100000:1.0:1746144662.497676:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706816 00000100:00100000:1.0:1746144662.497715:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11873 00000100:00100000:1.0:1746144662.497721:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29205:x1830964746706816:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.497738:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.497755:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f075 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.497782:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 13 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.497790:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.497791:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.497794:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.497822:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 13 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.497834:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 13 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.497848:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500672:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.499753:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.500152:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747500544:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144662.500175:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.500210:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746706688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5245us (5470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.500220:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5928 00000100:00100000:0.0:1746144662.502283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.502610:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747500672:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.502636:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.502654:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c000, rc 0) 00000100:00100000:1.0:1746144662.502689:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29205:x1830964746706816:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4967us (5570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.502698:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11873 00000100:00100000:2.0:1746144662.502998:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746706944 00000100:00100000:2.0:1746144662.503005:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746706944 00002000:00100000:2.0:1746144662.503045:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1241088->2097151) req@ffff88013129c000 x1830964746706944/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.503064:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129c000 with x1830964746706944 ext(1241088->2097151) 00010000:00010000:2.0:1746144662.503071:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 14 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.503084:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 14 pid: 7257 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.503091:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013129c000 00000100:00100000:2.0:1746144662.503121:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 895 00000100:00100000:2.0:1746144662.503128:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746706944:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144662.505951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.508504:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746707200 00000100:00100000:3.0:1746144662.508520:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746707200 00002000:00100000:3.0:1746144662.508576:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2973696->2977791) req@ffff88013129ea00 x1830964746707200/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.508587:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ea00 with x1830964746707200 ext(2973696->2977791) 00002000:00010000:3.0:1746144662.508593:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129ea00 00000100:00100000:3.0:1746144662.508624:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4559 00000100:00100000:3.0:1746144662.508631:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746707200:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144662.508829:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746707200:12345-192.168.204.23@tcp:3:cat.0 Request processed in 190us (2881us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144662.508836:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4559 00002000:00100000:3.0:1746144662.508842:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2973696->2977791) req@ffff88013129ea00 x1830964746707200/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.508848:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129ea00 with x1830964746707200 ext(2973696->2977791) 00002000:00010000:3.0:1746144662.508851:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013129ea00 00000100:00100000:0.0:1746144662.511935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.512025:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746707456 00000100:00100000:3.0:1746144662.512034:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746707456 00000100:00100000:3.0:1746144662.512087:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4087 00000100:00100000:3.0:1746144662.512095:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013129c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+314:29197:x1830964746707456:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144662.512298:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:29197:x1830964746707456:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 203us (371us total) trans 8589944003 rc 0/0 00000100:00100000:3.0:1746144662.512305:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4087 00000100:00100000:2.0:1746144662.516828:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013129c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746706944:12345-192.168.204.23@tcp:4:cat.0 Request processed in 13689us (14540us total) trans 21474840506 rc 0/0 00000100:00100000:2.0:1746144662.516840:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 895 00002000:00100000:2.0:1746144662.516853:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1241088->2097151) req@ffff88013129c000 x1830964746706944/t21474840506(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.516862:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013129c000 with x1830964746706944 ext(1241088->2097151) 00010000:00010000:2.0:1746144662.516871:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.516888:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.516894:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013129c000 00000100:00100000:0.0:1746144662.519285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.519508:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746707584 00000100:00100000:3.0:1746144662.519519:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746707584 00010000:00010000:3.0:1746144662.519554:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.519591:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5929 00000100:00100000:3.0:1746144662.519602:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746707584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.519616:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.519639:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.519651:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.519673:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8fee00/0xa7c849b16e01a77e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1241088->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efd4 expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.519703:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.519705:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.519713:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.519721:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.519755:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.519768:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747500800:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.519843:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.521040:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747500800:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144662.521067:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.521256:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746707584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1653us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.521264:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5929 00000100:00100000:0.0:1746144662.522685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.522767:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746707840 00000100:00100000:2.0:1746144662.522775:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746707840 00002000:00100000:2.0:1746144662.522817:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f301f80 x1830964746707840/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.522826:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301f80 with x1830964746707840 ext(1048576->2097151) 00002000:00010000:2.0:1746144662.522830:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f301f80 00000100:00100000:2.0:1746144662.522847:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4560 00000100:00100000:2.0:1746144662.522853:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746707840:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144662.532172:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746707840:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9280us (9453us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.532184:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4560 00002000:00100000:2.0:1746144662.532194:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f301f80 x1830964746707840/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.532202:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f301f80 with x1830964746707840 ext(1048576->2097151) 00002000:00010000:2.0:1746144662.532208:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f301f80 00000100:00100000:0.0:1746144662.537573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.538043:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746707968 00000100:00100000:1.0:1746144662.538061:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746707968 00000100:00100000:1.0:1746144662.538179:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11874 00000100:00100000:1.0:1746144662.538189:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29205:x1830964746707968:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.538211:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.538232:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f07c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.538867:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.538877:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.538879:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.538882:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.538921:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 16 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.538933:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 16 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.538946:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747500928:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.539041:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.545088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.546949:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708224 00000100:00100000:2.0:1746144662.546967:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708224 00000100:00100000:2.0:1746144662.547026:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10111 00000100:00100000:2.0:1746144662.547035:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:29208:x1830964746708224:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144662.547071:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.547093:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025a00/0xa7c849b16e01a85e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f083 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.547224:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.547241:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.547249:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.547285:0:15388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.547296:0:15388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 14 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144662.547314:0:15388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747501056:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.551242:0:15388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.551569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.551645:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708352 00000100:00100000:2.0:1746144662.551654:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708352 00002000:00100000:2.0:1746144662.551700:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1236991) req@ffff88009f302300 x1830964746708352/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.551710:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302300 with x1830964746708352 ext(1048576->1236991) 00010000:00010000:2.0:1746144662.551718:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 17 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.551731:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 17 pid: 7257 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.551738:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f302300 00000100:00100000:2.0:1746144662.551759:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 896 00000100:00100000:2.0:1746144662.551766:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746708352:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144662.552033:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f446300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747500928:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.552065:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.552080:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52d800, rc 0) 00000100:00100000:1.0:1746144662.552116:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29205:x1830964746707968:12345-192.168.204.23@tcp:101:cat.0 Request processed in 13930us (14554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.552124:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11874 00000100:00100000:2.0:1746144662.556333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.557533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.557552:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708480 00000100:00100000:1.0:1746144662.557562:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708480 00000100:00100000:3.0:1746144662.559188:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708736 00000100:00100000:3.0:1746144662.559195:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708736 00000100:00100000:1.0:1746144662.559235:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11875 00000100:00100000:1.0:1746144662.559245:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746708480:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.559266:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.559285:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f08a expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.559316:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.559318:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.559327:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 16 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.559342:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 16 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.559352:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c400, rc 0) 00000100:00100000:1.0:1746144662.559403:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746708480:12345-192.168.204.23@tcp:101:cat.0 Request processed in 160us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.559409:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11875 00000100:00100000:1.0:1746144662.559422:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11876 00000100:00100000:1.0:1746144662.559427:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746708736:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.559435:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.559444:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52d000/0xa7c849b16e01a873 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f098 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.559463:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52d000/0xa7c849b16e01a873 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f098 expref: 20 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.559471:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52d000/0xa7c849b16e01a873 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f098 expref: 20 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.559484:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52d000, rc 0) 00000100:00100000:1.0:1746144662.559497:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746708736:12345-192.168.204.23@tcp:101:cat.0 Request processed in 71us (1967us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144662.559502:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11876 00000100:00100000:0.0:1746144662.559978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.561280:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708608 00000100:00100000:2.0:1746144662.561286:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708608 00000100:00100000:3.0:1746144662.561358:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11877 00000100:00100000:3.0:1746144662.561366:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746708608:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144662.561598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.561611:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708864 00000100:00100000:1.0:1746144662.561614:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708864 00000100:00100000:1.0:1746144662.561635:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11878 00000100:00100000:1.0:1746144662.561640:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746708864:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.561647:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.561659:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a87a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f09f expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144662.561703:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747501184:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144662.561755:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.561849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.561864:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746708992 00000100:00100000:1.0:1746144662.561867:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746708992 00010000:00010000:1.0:1746144662.561886:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.561918:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5930 00000100:00100000:1.0:1746144662.561924:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746708992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.561935:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.561941:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.561951:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.561969:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144662.561974:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.561980:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fe600/0xa7c849b16e01a80a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f036 expref: 15 pid: 14709 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.561983:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15388 initiator: MDT0 00010000:00010000:1.0:1746144662.561990:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144662.561997:0:15388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15388:1830964747501056:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.562001:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144662.562013:0:15388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:1.0:1746144662.562020:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746708992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 96us (170us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144662.562021:0:15388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:1.0:1746144662.562025:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5930 00010000:00010000:2.0:1746144662.562026:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144662.562042:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144662.562296:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025a00/0xa7c849b16e01a85e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 36 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.562308:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 35 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.562340:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.562352:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe800/0xa7c849b16e01a888 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f091 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.562377:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747501312:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144662.562407:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00010000:00010000:2.0:1746144662.562457:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.562463:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144662.562465:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f024a00, rc 0) 00000100:00100000:2.0:1746144662.562487:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+35:29208:x1830964746708224:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 15454us (17412us total) trans 8589944004 rc 0/0 00000100:00100000:2.0:1746144662.562493:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10111 00000100:00100000:0.0:1746144662.563881:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746708352:12345-192.168.204.23@tcp:4:cat.0 Request processed in 12111us (12313us total) trans 17179873264 rc 0/0 00000100:00100000:0.0:1746144662.563891:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 896 00002000:00100000:0.0:1746144662.563900:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1236991) req@ffff88009f302300 x1830964746708352/t17179873264(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.563910:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302300 with x1830964746708352 ext(1048576->1236991) 00010000:00010000:0.0:1746144662.563917:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 21 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.563935:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 21 pid: 7257 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.563941:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f302300 00002000:00010000:1.0:1746144662.564691:0:29370:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144662 -> 1746144663 00002000:00010000:1.0:1746144662.564696:0:29370:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144662 -> 1746144663 00002000:00010000:1.0:1746144662.564698:0:29370:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144662 -> 1746144663 00000100:00100000:1.0:1746144662.564727:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747501184:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144662.564752:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a87a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f09f expref: 17 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.564762:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a87a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f09f expref: 17 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144662.564771:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52d200, rc 0) 00000100:00100000:1.0:1746144662.564803:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746708864:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3162us (3204us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144662.564813:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11878 00000100:00100000:3.0:1746144662.572252:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747501312:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144662.572290:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe800/0xa7c849b16e01a888 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f091 expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.572308:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe800/0xa7c849b16e01a888 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f091 expref: 20 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144662.572323:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fe800, rc 0) 00000100:00100000:3.0:1746144662.572384:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746708608:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11017us (12405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.572393:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11877 00000100:00100000:1.0:1746144662.572631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.573097:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746709120 00000100:00100000:0.0:1746144662.573705:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746709120 00010000:00010000:0.0:1746144662.573740:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 19 pid: 7257 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746144662.573768:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5931 00000100:00100000:0.0:1746144662.573775:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746709120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.573789:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144662.573804:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 19 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.573815:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 19 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.573834:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8fe400/0xa7c849b16e01a785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152efdb expref: 19 pid: 7257 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.573861:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.573863:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.573871:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.573889:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.573926:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.573938:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f303480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747501440:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144662.574021:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.581628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.581652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.581681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.583610:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.584064:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746709760 00000100:00100000:1.0:1746144662.584074:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746709760 00002000:00100000:1.0:1746144662.584126:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012dbb4000 x1830964746709760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.584151:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb4000 with x1830964746709760 ext(1048576->2097151) 00002000:00010000:1.0:1746144662.584157:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb4000 00000100:00100000:1.0:1746144662.584186:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4561 00000100:00100000:1.0:1746144662.584194:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746709760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.586725:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746709248 00000100:00100000:0.0:1746144662.586736:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746709248 00000100:00100000:0.0:1746144662.586786:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746709376 00000100:00100000:0.0:1746144662.586789:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746709376 00000100:00100000:0.0:1746144662.586804:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746709504 00000100:00100000:0.0:1746144662.586806:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746709504 00000100:00100000:0.0:1746144662.586824:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11879 00000100:00100000:0.0:1746144662.586831:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746709248:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144662.586848:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.586866:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0a6 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.586889:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.586892:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.586900:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.586915:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.586926:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62dc00, rc 0) 00000100:00100000:0.0:1746144662.586960:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746709248:12345-192.168.204.23@tcp:101:cat.0 Request processed in 130us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.586966:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11879 00000100:00100000:0.0:1746144662.586979:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11880 00000100:00100000:0.0:1746144662.586984:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746709376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144662.586989:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.586994:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f62de00/0xa7c849b16e01a896 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0ad expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.587008:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f62de00/0xa7c849b16e01a896 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ad expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.587016:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f62de00/0xa7c849b16e01a896 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ad expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.587027:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62de00, rc 0) 00000100:00100000:0.0:1746144662.587037:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746709376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 54us (5385us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144662.587042:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11880 00000100:00100000:0.0:1746144662.587059:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11881 00000100:00100000:0.0:1746144662.587064:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746709504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144662.587070:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.587079:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f62da00/0xa7c849b16e01a89d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0b4 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.587113:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f303100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747501568:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144662.587167:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.587200:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f303480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747501440:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144662.587212:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.587225:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746709120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 13451us (14596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.587232:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5931 00000100:00100000:2.0:1746144662.602762:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f303100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747501568:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144662.602799:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f62da00/0xa7c849b16e01a89d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0b4 expref: 17 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.602814:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f62da00/0xa7c849b16e01a89d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0b4 expref: 17 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.603027:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62da00, rc 0) 00000100:00100000:2.0:1746144662.603096:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746709504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 16029us (21411us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144662.603105:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11881 00000100:00100000:0.0:1746144662.604095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.604284:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746709888 00000100:00100000:2.0:1746144662.604291:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746709888 00000100:00100000:1.0:1746144662.606039:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746709760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21839us (22432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144662.606061:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4561 00002000:00100000:1.0:1746144662.606074:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012dbb4000 x1830964746709760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144662.606084:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb4000 with x1830964746709760 ext(1048576->2097151) 00002000:00010000:1.0:1746144662.606090:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb4000 00000100:00100000:1.0:1746144662.608213:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11882 00000100:00100000:1.0:1746144662.608229:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:29208:x1830964746709888:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144662.608261:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.608281:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0bb expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.608311:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.608322:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.608324:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.608327:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->4194303] (req 3895296->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.608363:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 35 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.608376:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 35 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.608388:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747501696:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.608800:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.612100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.612158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.612254:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747501696:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144662.612287:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->4194303] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.612307:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099592c00, rc 0) 00000100:00100000:0.0:1746144662.612350:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:29208:x1830964746709888:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4127us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.612359:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11882 00000100:00100000:2.0:1746144662.612970:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746710272 00000100:00100000:2.0:1746144662.612977:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746710272 00002000:00100000:2.0:1746144662.613015:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f303b80 x1830964746710272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.613024:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f303b80 with x1830964746710272 ext(1048576->2097151) 00002000:00010000:2.0:1746144662.613028:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f303b80 00000100:00100000:2.0:1746144662.613061:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746710400 00000100:00100000:2.0:1746144662.613063:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746710400 00002000:00100000:2.0:1746144662.613076:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f300380 x1830964746710400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.613082:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300380 with x1830964746710400 ext(1048576->2097151) 00002000:00010000:2.0:1746144662.613085:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f300380 00000100:00100000:2.0:1746144662.613096:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4562 00000100:00100000:2.0:1746144662.613101:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746710272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.613895:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4563 00000100:00100000:0.0:1746144662.613903:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746710400:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.615450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.615501:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746710528 00000100:00100000:2.0:1746144662.615506:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746710528 00010000:00010000:2.0:1746144662.615532:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:2.0:1746144662.615553:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5932 00000100:00100000:2.0:1746144662.615559:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746710528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.615572:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.615593:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.615605:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.615628:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a38c00/0xa7c849b16e01a6eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef6b expref: 36 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.618490:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.618496:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.618510:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.618521:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.618567:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.618582:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747501824:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144662.618669:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.629231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.629891:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746710656 00000100:00100000:0.0:1746144662.630255:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746710656 00000100:00100000:0.0:1746144662.630304:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11883 00000100:00100000:0.0:1746144662.630312:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29205:x1830964746710656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144662.630332:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.630350:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0c2 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.630381:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.630390:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.630392:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.630395:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 37 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.630432:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.630442:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 37 pid: 8450 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746144662.630455:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f303100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747501952:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.630486:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746710400:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16584us (18326us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.630497:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4563 00000100:00100000:0.0:1746144662.630504:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00002000:00100000:2.0:1746144662.630507:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f300380 x1830964746710400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.630516:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f300380 with x1830964746710400 ext(1048576->2097151) 00002000:00010000:2.0:1746144662.630520:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f300380 00000100:00100000:3.0:1746144662.631715:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747501824:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144662.631743:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.631790:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1963:x1830964746710528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 16229us (16341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.631805:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5932 00000100:00100000:0.0:1746144662.632116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.632273:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746710912 00000100:00100000:2.0:1746144662.632278:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746710912 00002000:00100000:2.0:1746144662.632307:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3895296->3899391) req@ffff88009ee03480 x1830964746710912/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.632316:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03480 with x1830964746710912 ext(3895296->3899391) 00002000:00010000:2.0:1746144662.632320:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee03480 00000100:00100000:2.0:1746144662.632347:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4564 00000100:00100000:2.0:1746144662.632352:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746710912:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144662.632508:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746710912:12345-192.168.204.23@tcp:3:cat.0 Request processed in 155us (392us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144662.632514:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4564 00002000:00100000:2.0:1746144662.632518:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3895296->3899391) req@ffff88009ee03480 x1830964746710912/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.632525:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03480 with x1830964746710912 ext(3895296->3899391) 00002000:00010000:2.0:1746144662.632528:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee03480 00000100:00100000:3.0:1746144662.632947:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746710272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19844us (20856us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.632953:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4562 00002000:00100000:3.0:1746144662.632958:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f303b80 x1830964746710272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.632965:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f303b80 with x1830964746710272 ext(1048576->2097151) 00002000:00010000:3.0:1746144662.632968:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f303b80 00000100:00100000:0.0:1746144662.635994:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f303100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747501952:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144662.636025:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 36 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.636057:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0400, rc 0) 00000100:00100000:0.0:1746144662.636118:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29205:x1830964746710656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5805us (6895us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.636126:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11883 00000100:00100000:0.0:1746144662.637761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.637893:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746711040 00000100:00100000:3.0:1746144662.637901:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746711040 00002000:00100000:3.0:1746144662.637940:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3072000->3145727) req@ffff88009ee00a80 x1830964746711040/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.637956:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00a80 with x1830964746711040 ext(3072000->3145727) 00010000:00010000:3.0:1746144662.637963:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 36 pid: 8450 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.637975:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 36 pid: 8450 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746144662.637981:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee00a80 00000100:00100000:3.0:1746144662.638701:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 897 00000100:00100000:3.0:1746144662.638710:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746711040:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144662.643535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.643604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.643659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.643699:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746711424 00000100:00100000:1.0:1746144662.643709:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746711424 00000100:00100000:1.0:1746144662.643751:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746711552 00000100:00100000:1.0:1746144662.643753:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746711552 00000100:00100000:1.0:1746144662.643770:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11884 00000100:00100000:1.0:1746144662.643778:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:29211:x1830964746711424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.643801:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144662.643808:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11885 00000100:00100000:0.0:1746144662.643817:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+16:29208:x1830964746711552:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144662.643820:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0d0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.643824:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.643833:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0d7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.643847:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.643849:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.643852:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.643855:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.643857:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.643859:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.643863:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.643873:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b20ca00, rc 0) 00010000:00010000:0.0:1746144662.643885:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 17 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.643894:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 17 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746144662.643910:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f303100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747502080:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.643914:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:29211:x1830964746711424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.643919:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11884 00000100:00100000:0.0:1746144662.643962:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.644525:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746711040:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5816us (6768us total) trans 17179873265 rc 0/0 00000100:00100000:0.0:1746144662.644534:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 897 00002000:00100000:0.0:1746144662.644543:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3072000->3145727) req@ffff88009ee00a80 x1830964746711040/t17179873265(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.644553:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00a80 with x1830964746711040 ext(3072000->3145727) 00010000:00010000:0.0:1746144662.644560:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 38 pid: 8450 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.644570:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 38 pid: 8450 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.644575:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ee00a80 00000100:00100000:2.0:1746144662.644670:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746711296 00000100:00100000:2.0:1746144662.644674:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746711296 00000100:00100000:2.0:1746144662.644713:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10112 00000100:00100000:2.0:1746144662.644719:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:29213:x1830964746711296:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144662.644733:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.644745:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024400/0xa7c849b16e01a8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0c9 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.644841:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.644855:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.644867:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144662.644877:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144662.644965:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024400/0xa7c849b16e01a8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 318 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.644987:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 317 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.644994:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.644996:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144662.644998:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f025000, rc 0) 00000100:00100000:2.0:1746144662.645021:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29213:x1830964746711296:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 302us (1362us total) trans 8589944005 rc 0/0 00000100:00100000:2.0:1746144662.645026:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10112 00000100:00100000:2.0:1746144662.646198:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f303100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747502080:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.646679:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->3317759] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.646699:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0000, rc 0) 00000100:00100000:2.0:1746144662.646742:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:29208:x1830964746711552:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2926us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.646749:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11885 00000100:00100000:0.0:1746144662.647064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.647221:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746711680 00000100:00100000:2.0:1746144662.647227:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746711680 00002000:00100000:2.0:1746144662.647260:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2977791) req@ffff88009f303100 x1830964746711680/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.647269:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f303100 with x1830964746711680 ext(2097152->2977791) 00010000:00010000:2.0:1746144662.647275:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 18 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.647286:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 18 pid: 8453 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.647292:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f303100 00000100:00100000:0.0:1746144662.647456:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.647579:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 898 00000100:00100000:2.0:1746144662.647586:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746711680:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144662.647718:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746711808 00000100:00100000:3.0:1746144662.647723:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746711808 00010000:00010000:3.0:1746144662.647746:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 38 pid: 8450 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.647780:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5933 00000100:00100000:3.0:1746144662.647786:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746711808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.647799:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144662.647820:0:7101:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144662 -> 1746144663 00002000:00010000:3.0:1746144662.647823:0:7101:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144662 -> 1746144663 00010000:00010000:3.0:1746144662.647830:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 38 pid: 8450 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.647841:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 38 pid: 8450 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.647870:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52dc00/0xa7c849b16e01a82d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f052 expref: 38 pid: 8450 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.647899:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.647902:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.647910:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 37 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.647919:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 37 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.647927:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.647929:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.647933:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.647938:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.647968:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.647980:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747502208:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144662.648064:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 37 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.648073:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747502336:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.648094:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.650887:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747502208:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.650902:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747502336:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144662.650922:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.650971:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746711808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3183us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.650981:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5933 00000100:00100000:0.0:1746144662.656644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.656802:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.656866:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746712192 00000100:00100000:2.0:1746144662.656878:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746712192 00002000:00100000:2.0:1746144662.656927:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4b63b80 x1830964746712192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.656936:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63b80 with x1830964746712192 ext(2097152->3145727) 00002000:00010000:2.0:1746144662.656942:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b63b80 00000100:00100000:2.0:1746144662.656960:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746712320 00000100:00100000:2.0:1746144662.656962:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746712320 00002000:00100000:2.0:1746144662.656974:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4b62300 x1830964746712320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.656980:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62300 with x1830964746712320 ext(2097152->3145727) 00002000:00010000:2.0:1746144662.656983:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62300 00000100:00100000:2.0:1746144662.656996:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4565 00000100:00100000:2.0:1746144662.657003:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746712192:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144662.657894:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4566 00000100:00100000:3.0:1746144662.657903:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746712320:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144662.665216:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746711680:12345-192.168.204.23@tcp:4:cat.0 Request processed in 17617us (18140us total) trans 21474840507 rc 0/0 00000100:00100000:3.0:1746144662.665230:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 898 00002000:00100000:3.0:1746144662.665245:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2977791) req@ffff88009f303100 x1830964746711680/t21474840507(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.665255:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f303100 with x1830964746711680 ext(2097152->2977791) 00010000:00010000:3.0:1746144662.665265:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 20 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.665281:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 20 pid: 8453 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746144662.665288:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f303100 00000100:00100000:2.0:1746144662.670328:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746712192:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13310us (13680us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.670341:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4565 00002000:00100000:2.0:1746144662.670354:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4b63b80 x1830964746712192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.670363:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b63b80 with x1830964746712192 ext(2097152->3145727) 00002000:00010000:2.0:1746144662.670369:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b63b80 00000100:00100000:0.0:1746144662.671269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.671435:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746712448 00000100:00100000:3.0:1746144662.671445:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746712448 00010000:00010000:3.0:1746144662.671482:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 20 pid: 8453 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.671522:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5934 00000100:00100000:3.0:1746144662.671530:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746712448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.671546:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.671571:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 20 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.671584:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 20 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.671607:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c600/0xa7c849b16e01a849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2977791) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f06e expref: 20 pid: 8453 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.671640:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.671643:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.671651:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.671660:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.671697:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.671710:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747502464:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.671776:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.671966:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746712320:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14063us (15163us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144662.671974:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4566 00002000:00100000:0.0:1746144662.671981:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4b62300 x1830964746712320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.671990:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62300 with x1830964746712320 ext(2097152->3145727) 00002000:00010000:0.0:1746144662.671994:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62300 00000100:00100000:0.0:1746144662.674223:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.674271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.674306:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746712576 00000100:00100000:0.0:1746144662.674511:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746712576 00000100:00100000:1.0:1746144662.675639:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746712704 00000100:00100000:1.0:1746144662.675647:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746712704 00000100:00100000:0.0:1746144662.675883:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747502464:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144662.675905:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.676584:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11886 00000100:00100000:3.0:1746144662.676596:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29213:x1830964746712576:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144662.676619:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.676639:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0de expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.676671:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 38 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.676679:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.676685:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144662.676687:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144662.676690:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2224128->2494463] (req 2224128->2494463) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.676720:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.676731:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 20 pid: 8388 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.676743:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747502592:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.676841:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11887 00000100:00100000:1.0:1746144662.676848:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:29205:x1830964746712704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144662.676857:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144662.676866:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0e5 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.676882:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.676887:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.676889:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144662.676892:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.676908:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 16 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.676916:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 16 pid: 4758 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.676924:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747502720:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144662.677228:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4180 going to sleep for 11 seconds 00010000:00010000:3.0:1746144662.677298:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 38 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.677312:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 38 pid: 8388 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.677382:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747502848:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.677401:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.677516:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746712448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5985us (6248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.677526:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5934 00000100:00100000:1.0:1746144662.677977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.678400:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746712960 00000100:00100000:0.0:1746144662.678407:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746712960 00002000:00100000:0.0:1746144662.678442:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3313664->3317759) req@ffff88012dbb4a80 x1830964746712960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.678450:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb4a80 with x1830964746712960 ext(3313664->3317759) 00010000:00010000:0.0:1746144662.678458:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.678468:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.678474:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbb4a80 00000100:00100000:0.0:1746144662.678489:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 899 00000100:00100000:0.0:1746144662.678495:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746712960:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.679594:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746712960:12345-192.168.204.23@tcp:3:cat.0 Request processed in 1094us (1613us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144662.679601:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 899 00002000:00100000:0.0:1746144662.679607:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3313664->3317759) req@ffff88012dbb4a80 x1830964746712960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.679615:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb4a80 with x1830964746712960 ext(3313664->3317759) 00010000:00010000:0.0:1746144662.679620:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.679629:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.679634:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbb4a80 00000100:00100000:0.0:1746144662.681259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.681334:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746713216 00000100:00100000:2.0:1746144662.681343:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746713216 00002000:00100000:2.0:1746144662.681380:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a4b60e00 x1830964746713216/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.681388:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60e00 with x1830964746713216 ext(2097152->3145727) 00010000:00010000:2.0:1746144662.681396:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.681406:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 17 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.681417:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4b60e00 00000100:00100000:2.0:1746144662.681447:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 900 00000100:00100000:2.0:1746144662.681454:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746713216:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.687095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.687120:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747502592:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144662.687128:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746713472 00000100:00100000:0.0:1746144662.687161:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746713472 00010000:00010000:0.0:1746144662.687199:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 39 pid: 8388 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746144662.687225:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5935 00000100:00100000:0.0:1746144662.687232:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1962:x1830964746713472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.687246:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144662.687271:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 39 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.687286:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 39 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.687309:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0400/0xa7c849b16e01a8ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c2 expref: 39 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.687340:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.687385:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747502848:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.687416:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->2494463] (req 2224128->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.687427:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f025600, rc 0) 00000100:00100000:1.0:1746144662.687521:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747502720:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144662.687540:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.687549:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009418ec00, rc 0) 00000100:00100000:0.0:1746144662.688629:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1962:x1830964746713472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1393us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.688638:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5935 00000100:00100000:0.0:1746144662.688689:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.688704:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746713344 00000100:00100000:0.0:1746144662.688707:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746713344 00010000:00010000:0.0:1746144662.688723:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746144662.688737:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5936 00000100:00100000:0.0:1746144662.688741:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746713344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.688749:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144662.688761:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.688768:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.688782:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b20ca00/0xa7c849b16e01a8b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d0 expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.688792:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.688793:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.688800:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.688807:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.688833:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.688845:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747502976:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144662.689347:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:29205:x1830964746712704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 12488us (15064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.689357:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11887 00000100:00100000:3.0:1746144662.689487:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29213:x1830964746712576:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 12892us (15270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.689494:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11886 00000100:00100000:0.0:1746144662.689848:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.694709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.695071:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746713728 00000100:00100000:0.0:1746144662.695082:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746713728 00002000:00100000:0.0:1746144662.695131:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3317759) req@ffff88009fb46a00 x1830964746713728/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.695153:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46a00 with x1830964746713728 ext(3145728->3317759) 00010000:00010000:0.0:1746144662.695164:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.695178:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.695186:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb46a00 00000100:00100000:0.0:1746144662.695205:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 901 00000100:00100000:0.0:1746144662.695213:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746713728:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144662.695415:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746713216:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13959us (14160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.695423:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 900 00002000:00100000:3.0:1746144662.695430:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a4b60e00 x1830964746713216/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.695438:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60e00 with x1830964746713216 ext(2097152->3145727) 00010000:00010000:3.0:1746144662.695443:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.696006:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746144662.696014:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4b60e00 00000100:00100000:1.0:1746144662.698507:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747502976:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144662.698530:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.698574:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746713344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9829us (9882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.698584:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5936 00000100:00100000:1.0:1746144662.698684:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.699166:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746713984 00000100:00100000:3.0:1746144662.699174:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746713984 00002000:00100000:3.0:1746144662.699215:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2224128->2228223) req@ffff88012dbb4e00 x1830964746713984/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.699224:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb4e00 with x1830964746713984 ext(2224128->2228223) 00002000:00010000:3.0:1746144662.699228:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb4e00 00000100:00100000:3.0:1746144662.699249:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4567 00000100:00100000:3.0:1746144662.699255:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746713984:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144662.699411:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746713984:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 156us (727us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144662.699417:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4567 00002000:00100000:3.0:1746144662.699422:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2224128->2228223) req@ffff88012dbb4e00 x1830964746713984/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.699429:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb4e00 with x1830964746713984 ext(2224128->2228223) 00002000:00010000:3.0:1746144662.699432:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb4e00 00000100:00100000:3.0:1746144662.700758:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746713728:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5539us (6056us total) trans 21474840508 rc 0/0 00000100:00100000:3.0:1746144662.700766:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 901 00002000:00100000:3.0:1746144662.700774:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3317759) req@ffff88009fb46a00 x1830964746713728/t21474840508(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.700783:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46a00 with x1830964746713728 ext(3145728->3317759) 00010000:00010000:3.0:1746144662.700791:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.700806:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746144662.700813:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb46a00 00000100:00100000:0.0:1746144662.705845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.706111:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746714112 00000100:00100000:3.0:1746144662.706125:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746714112 00000100:00100000:3.0:1746144662.706230:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11888 00000100:00100000:3.0:1746144662.706238:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+20:29211:x1830964746714112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.706260:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.706281:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0ec expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.706314:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.706322:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.706328:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144662.706330:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144662.706333:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.706370:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.706381:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.706394:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747503104:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.706503:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 36 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.706512:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 36 pid: 4758 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.706520:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747503232:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.706540:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.709498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.710309:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746714240 00000100:00100000:1.0:1746144662.710321:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746714240 00010000:00010000:1.0:1746144662.710361:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.710392:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5937 00000100:00100000:1.0:1746144662.710399:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746714240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.710414:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.710442:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.710453:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.710475:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0000/0xa7c849b16e01a8b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0d7 expref: 19 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.710499:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.710501:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144662.710508:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.710515:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144662.710548:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144662.710566:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747503360:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144662.710657:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.711240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.711999:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746714496 00000100:00100000:2.0:1746144662.712007:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746714496 00002000:00100000:2.0:1746144662.712057:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2490368->2494463) req@ffff88009f302a00 x1830964746714496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.712067:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302a00 with x1830964746714496 ext(2490368->2494463) 00010000:00010000:2.0:1746144662.712075:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.712090:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.712096:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f302a00 00000100:00100000:2.0:1746144662.712117:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 902 00000100:00100000:2.0:1746144662.712123:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746714496:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144662.712310:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746714496:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 186us (1069us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144662.712317:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 902 00002000:00100000:2.0:1746144662.712323:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2490368->2494463) req@ffff88009f302a00 x1830964746714496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.712330:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f302a00 with x1830964746714496 ext(2490368->2494463) 00010000:00010000:2.0:1746144662.712335:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.712342:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.712348:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f302a00 00000100:00100000:3.0:1746144662.713090:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747503104:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144662.713102:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747503232:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144662.713131:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.713168:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6000, rc 0) 00000100:00100000:3.0:1746144662.713198:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:29211:x1830964746714112:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6961us (7367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.713208:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11888 00000100:00100000:0.0:1746144662.713463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.713485:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746714624 00000100:00100000:0.0:1746144662.713489:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746714624 00002000:00100000:0.0:1746144662.713515:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3895296->4194303) req@ffff88009f303800 x1830964746714624/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.713523:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f303800 with x1830964746714624 ext(3895296->4194303) 00010000:00010000:0.0:1746144662.713527:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.713536:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 21 pid: 8388 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.713541:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f303800 00000100:00100000:0.0:1746144662.713554:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 903 00000100:00100000:0.0:1746144662.713560:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746714624:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144662.714666:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747503360:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144662.714682:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.714723:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746714240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4323us (5234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.714733:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5937 00010000:00010000:0.0:1746144662.715031:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144662.730584:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746714624:12345-192.168.204.23@tcp:4:cat.0 Request processed in 17009us (17106us total) trans 17179873266 rc 0/0 00000100:00100000:2.0:1746144662.730599:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 903 00002000:00100000:2.0:1746144662.730615:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3895296->4194303) req@ffff88009f303800 x1830964746714624/t17179873266(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.730624:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f303800 with x1830964746714624 ext(3895296->4194303) 00010000:00010000:2.0:1746144662.730636:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 23 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.730649:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 23 pid: 8388 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.730656:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f303800 00000100:00100000:0.0:1746144662.733349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.733448:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746715008 00000100:00100000:2.0:1746144662.733460:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746715008 00002000:00100000:2.0:1746144662.733510:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2224128->2494463) req@ffff88012d0c5500 x1830964746715008/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.733520:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5500 with x1830964746715008 ext(2224128->2494463) 00010000:00010000:2.0:1746144662.733529:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:2.0:1746144662.733541:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 37 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:2.0:1746144662.733547:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d0c5500 00000100:00100000:2.0:1746144662.733822:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 904 00000100:00100000:2.0:1746144662.733829:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1962:x1830964746715008:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144662.734861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.734888:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.734912:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746715136 00000100:00100000:0.0:1746144662.734916:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746715136 00002000:00100000:0.0:1746144662.734940:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d0c7100 x1830964746715136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.734948:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7100 with x1830964746715136 ext(2097152->3145727) 00002000:00010000:0.0:1746144662.734953:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c7100 00000100:00100000:0.0:1746144662.735732:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746715264 00000100:00100000:0.0:1746144662.735736:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746715264 00000100:00100000:3.0:1746144662.735748:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4568 00002000:00100000:0.0:1746144662.735755:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3895295) req@ffff88012d0c7480 x1830964746715264/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.735762:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7480 with x1830964746715264 ext(3145728->3895295) 00010000:00010000:0.0:1746144662.735769:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00000100:00100000:3.0:1746144662.735777:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746715136:12345-192.168.204.23@tcp:3:multiop.0 00010000:00010000:0.0:1746144662.735779:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.735785:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d0c7480 00000100:00100000:0.0:1746144662.735805:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 905 00000100:00100000:0.0:1746144662.735812:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746715264:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144662.737708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.738240:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746715520 00000100:00100000:0.0:1746144662.738253:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746715520 00010000:00010000:0.0:1746144662.738298:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 23 pid: 8388 timeout: 741 lvb_type: 0 00000100:00100000:1.0:1746144662.741440:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5938 00000100:00100000:1.0:1746144662.741459:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746715520:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.741482:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144662.741507:0:7101:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144662 -> 1746144663 00010000:00010000:1.0:1746144662.741515:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 23 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.741529:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 23 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.741552:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099592c00/0xa7c849b16e01a8a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3895296->18446744073709551615] (req 3895296->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0bb expref: 23 pid: 8388 timeout: 741 lvb_type: 0 00010000:00010000:1.0:1746144662.741576:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.741655:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746715520:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 203us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.741662:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5938 00000100:00100000:3.0:1746144662.745243:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746715008:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 11406us (11895us total) trans 17179873267 rc 0/0 00000100:00100000:3.0:1746144662.745253:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 904 00002000:00100000:3.0:1746144662.745263:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2224128->2494463) req@ffff88012d0c5500 x1830964746715008/t17179873267(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/448 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.745271:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5500 with x1830964746715008 ext(2224128->2494463) 00010000:00010000:3.0:1746144662.745280:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 41 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:3.0:1746144662.745295:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 41 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:3.0:1746144662.745300:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d0c5500 00000100:00100000:3.0:1746144662.748700:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746715136:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 12929us (13827us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.748712:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4568 00002000:00100000:3.0:1746144662.748726:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d0c7100 x1830964746715136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.748734:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7100 with x1830964746715136 ext(2097152->3145727) 00002000:00010000:3.0:1746144662.748741:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c7100 00000100:00100000:0.0:1746144662.749519:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746715264:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 13706us (14628us total) trans 0 rc 749568/749568 00000100:00100000:0.0:1746144662.749527:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 905 00002000:00100000:0.0:1746144662.749532:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3895295) req@ffff88012d0c7480 x1830964746715264/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:H/200/0 rc 749568/749568 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144662.749539:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7480 with x1830964746715264 ext(3145728->3895295) 00010000:00010000:0.0:1746144662.749547:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.749561:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00002000:00010000:0.0:1746144662.749567:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d0c7480 00000100:00100000:2.0:1746144662.758872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.758916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.760288:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746715648 00000100:00100000:0.0:1746144662.760301:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746715648 00010000:00010000:0.0:1746144662.760348:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00000100:00100000:0.0:1746144662.760398:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5939 00000100:00100000:0.0:1746144662.760407:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746715648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.760423:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144662.760448:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.760460:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.760483:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01a8d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2224128->3895295] (req 2224128->2494463) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0de expref: 39 pid: 4758 timeout: 741 lvb_type: 0 00010000:00010000:0.0:1746144662.760506:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.760509:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.760516:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.760523:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.760556:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 21 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.760568:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747503488:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144662.760671:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.760992:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746715776 00000100:00100000:3.0:1746144662.760998:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746715776 00000100:00100000:3.0:1746144662.761097:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11889 00000100:00100000:3.0:1746144662.761104:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:29205:x1830964746715776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.761120:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.761254:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0f3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.761316:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.761318:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.761323:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.761335:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.761343:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f070a00, rc 0) 00000100:00100000:2.0:1746144662.761509:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29205:x1830964746715776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 405us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.761515:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11889 00000100:00100000:0.0:1746144662.765515:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747503488:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144662.765539:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.765701:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746715648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5293us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.765712:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5939 00000100:00100000:0.0:1746144662.766660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.766768:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746716032 00000100:00100000:2.0:1746144662.766776:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746716032 00002000:00100000:2.0:1746144662.766818:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c7800 x1830964746716032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.766827:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7800 with x1830964746716032 ext(3145728->4194303) 00002000:00010000:2.0:1746144662.766832:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c7800 00000100:00100000:2.0:1746144662.766887:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4569 00000100:00100000:2.0:1746144662.766895:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746716032:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.768251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.768406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.768576:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746716288 00000100:00100000:3.0:1746144662.768583:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746716288 00002000:00100000:3.0:1746144662.768616:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c5180 x1830964746716288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.768624:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5180 with x1830964746716288 ext(3145728->4194303) 00002000:00010000:3.0:1746144662.768629:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c5180 00000100:00100000:3.0:1746144662.768645:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746716544 00000100:00100000:3.0:1746144662.768647:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746716544 00002000:00100000:3.0:1746144662.768658:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d5500 x1830964746716544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.768664:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5500 with x1830964746716544 ext(3145728->4194303) 00002000:00010000:3.0:1746144662.768667:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d5500 00000100:00100000:3.0:1746144662.768680:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4570 00000100:00100000:3.0:1746144662.768685:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746716288:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144662.769773:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4571 00000100:00100000:3.0:1746144662.769781:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746716544:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144662.783328:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746716288:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14627us (15067us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.783340:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4570 00002000:00100000:3.0:1746144662.783352:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c5180 x1830964746716288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.783362:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5180 with x1830964746716288 ext(3145728->4194303) 00002000:00010000:3.0:1746144662.783368:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c5180 00000100:00100000:3.0:1746144662.787634:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746716544:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 17841us (19214us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.787653:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4571 00002000:00100000:3.0:1746144662.787665:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d5500 x1830964746716544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.787675:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5500 with x1830964746716544 ext(3145728->4194303) 00002000:00010000:3.0:1746144662.787681:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d5500 00000100:00100000:2.0:1746144662.792277:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746716032:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25370us (25606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144662.792290:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4569 00002000:00100000:2.0:1746144662.792302:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c7800 x1830964746716032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.792311:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7800 with x1830964746716032 ext(3145728->4194303) 00002000:00010000:2.0:1746144662.792317:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c7800 00000100:00100000:1.0:1746144662.798478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.798589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.800459:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746716928 00000100:00100000:3.0:1746144662.800473:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746716928 00000100:00100000:3.0:1746144662.800549:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11890 00000100:00100000:3.0:1746144662.800557:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:29211:x1830964746716928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144662.800578:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.800597:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f0fa expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.800624:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.800626:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.800635:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.800653:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.800664:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f070200, rc 0) 00000100:00100000:3.0:1746144662.800730:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:29211:x1830964746716928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 172us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.800737:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11890 00000100:00100000:2.0:1746144662.801414:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746716800 00000100:00100000:2.0:1746144662.801421:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746716800 00002000:00100000:2.0:1746144662.801454:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012dbb7b80 x1830964746716800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.801464:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb7b80 with x1830964746716800 ext(4194304->4935679) 00002000:00010000:2.0:1746144662.801468:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb7b80 00000100:00100000:2.0:1746144662.801496:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4572 00000100:00100000:2.0:1746144662.801502:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746716800:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144662.809418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.810271:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746717184 00000100:00100000:3.0:1746144662.810285:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746717184 00002000:00100000:3.0:1746144662.810345:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d7100 x1830964746717184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.810356:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d7100 with x1830964746717184 ext(3145728->4194303) 00002000:00010000:3.0:1746144662.810363:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d7100 00000100:00100000:3.0:1746144662.810397:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4573 00000100:00100000:3.0:1746144662.810405:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746717184:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144662.821020:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746716800:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19507us (22542us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144662.821033:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4572 00002000:00100000:2.0:1746144662.821054:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012dbb7b80 x1830964746716800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.821071:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbb7b80 with x1830964746716800 ext(4194304->4935679) 00002000:00010000:2.0:1746144662.821077:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbb7b80 00000100:00100000:3.0:1746144662.829742:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746717184:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19327us (20323us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144662.829753:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4573 00002000:00100000:3.0:1746144662.829765:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8801309d7100 x1830964746717184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.829775:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d7100 with x1830964746717184 ext(3145728->4194303) 00002000:00010000:3.0:1746144662.829781:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801309d7100 00000100:00100000:0.0:1746144662.843822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.843923:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746717440 00000100:00100000:3.0:1746144662.843934:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746717440 00002000:00100000:3.0:1746144662.843979:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8801309d4000 x1830964746717440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.843989:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4000 with x1830964746717440 ext(4194304->4935679) 00002000:00010000:3.0:1746144662.843994:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d4000 00000100:00100000:3.0:1746144662.844025:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4574 00000100:00100000:3.0:1746144662.844032:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746717440:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144662.864174:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746717440:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20130us (20349us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144662.864188:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4574 00002000:00100000:3.0:1746144662.864202:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8801309d4000 x1830964746717440/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/440 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144662.864318:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4000 with x1830964746717440 ext(4194304->4935679) 00002000:00010000:3.0:1746144662.864325:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d4000 00000100:00100000:0.0:1746144662.881518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.881592:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746717568 00000100:00100000:2.0:1746144662.881602:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746717568 00000100:00100000:2.0:1746144662.881664:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10113 00000100:00100000:2.0:1746144662.881673:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29221:x1830964746717568:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144662.881701:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.881721:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114600/0xa7c849b16e01a8f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f101 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.881790:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881803:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881816:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881830:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881835:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881840:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881955:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.881971:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 34 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.881978:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 316 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.881984:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.882017:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 316 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.882028:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 316 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.882040:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747503616:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.882184:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 34 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.882192:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 34 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.882199:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747503744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.882474:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.886816:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747503616:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.886832:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747503744:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.886861:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144662.887062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.887333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.887404:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746717952 00000100:00100000:1.0:1746144662.887412:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746717952 00010000:00010000:1.0:1746144662.887446:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 35 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144662.887474:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5940 00000100:00100000:1.0:1746144662.887481:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746717952:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.887494:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.887500:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 35 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.887510:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 35 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.887532:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f024a00/0xa7c849b16e01a865 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f083 expref: 35 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.887550:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144662.887555:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.887563:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.887568:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144662.887573:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.887617:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746717952:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.887623:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5940 00000100:00100000:2.0:1746144662.887783:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746717824 00000100:00100000:2.0:1746144662.887787:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746717824 00000100:00100000:2.0:1746144662.887826:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4088 00000100:00100000:2.0:1746144662.887831:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:27208:x1830964746717824:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746144662.888030:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:27208:x1830964746717824:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 198us (969us total) trans 8589944006 rc 0/0 00000100:00100000:2.0:1746144662.888037:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4088 00000100:00100000:0.0:1746144662.889249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.889328:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718080 00000100:00100000:2.0:1746144662.889332:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718080 00010000:00010000:2.0:1746144662.889347:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.889370:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5941 00000100:00100000:2.0:1746144662.889375:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:1960:x1830964746718080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.889383:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.889386:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144662.889395:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144662.889408:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f025000/0xa7c849b16e01a8c7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0c9 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144662.889418:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.889423:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.889430:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.889436:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144662.889459:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.889798:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:1960:x1830964746718080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 421us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.889803:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5941 00010000:00010000:3.0:1746144662.890801:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890812:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144662.890854:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:3.0:1746144662.890859:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144662.890877:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890890:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890903:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890910:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890916:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890922:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5114800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144662.890926:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890932:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890944:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144662.890946:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144662.890950:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890955:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114800/0xa7c849b16e01a8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890980:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890984:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890989:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.890993:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5114a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144662.890996:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.891000:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.891005:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8700) 00010000:00010000:3.0:1746144662.891007:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144662.891009:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.891013:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114a00/0xa7c849b16e01a906 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.891056:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5114600/0xa7c849b16e01a8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.891068:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 15 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.891074:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144662.891076:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144662.891078:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5115400, rc 0) 00000100:00100000:3.0:1746144662.891128:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29221:x1830964746717568:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 9455us (9619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.891161:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10113 00000100:00100000:0.0:1746144662.898120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.898183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.898208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.898225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.898266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.898290:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718208 00000100:00100000:0.0:1746144662.898299:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718208 00000100:00100000:0.0:1746144662.898338:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718336 00000100:00100000:0.0:1746144662.898340:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718336 00000100:00100000:0.0:1746144662.898354:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718464 00000100:00100000:0.0:1746144662.898355:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718464 00000100:00100000:0.0:1746144662.898364:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718592 00000100:00100000:0.0:1746144662.898365:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718592 00000100:00100000:0.0:1746144662.898373:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718720 00000100:00100000:0.0:1746144662.898374:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718720 00000100:00100000:0.0:1746144662.898388:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11891 00000100:00100000:0.0:1746144662.898395:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746718208:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144662.898411:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.898429:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f108 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.898453:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.898455:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.898464:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.898485:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.898496:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323800, rc 0) 00000100:00100000:0.0:1746144662.898541:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746718208:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 146us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.898547:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11891 00000100:00100000:0.0:1746144662.898561:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11892 00000100:00100000:0.0:1746144662.898566:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746718336:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144662.898573:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144662.898582:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f10f expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.898593:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.898594:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.898599:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144662.898610:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11893 00010000:00010000:0.0:1746144662.898611:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.898617:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f322a00, rc 0) 00000100:00100000:2.0:1746144662.898621:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746718464:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144662.898632:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144662.898632:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746718336:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 66us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.898636:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11892 00010000:00010000:2.0:1746144662.898641:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f116 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144662.898647:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11894 00000100:00100000:0.0:1746144662.898652:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746718592:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144662.898654:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.898656:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.898657:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.898662:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.898663:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f11d expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.898672:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.898673:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 8 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.898674:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144662.898678:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.898680:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c600, rc 0) 00010000:00010000:0.0:1746144662.898686:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144662.898692:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323c00, rc 0) 00000100:00100000:2.0:1746144662.898700:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746718464:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 82us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.898706:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11893 00000100:00100000:0.0:1746144662.898706:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746718592:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 54us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.898711:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11894 00000100:00100000:2.0:1746144662.898718:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11895 00000100:00100000:2.0:1746144662.898723:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+19:29218:x1830964746718720:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144662.898730:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.898737:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f124 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.898753:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.898761:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.898768:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.898774:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.898775:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.898778:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3764224->4194303] (req 3764224->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.898806:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.898816:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.898833:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747503872:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.898899:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 7 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.898907:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144662.898915:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747504000:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.898942:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.898949:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 19 pid: 8388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.898956:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747504128:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.898971:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.903970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.904037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.904178:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747503872:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.904189:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747504000:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.904196:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747504128:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.904225:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3764224->4194303] (req 3764224->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.904248:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52dc00, rc 0) 00000100:00100000:2.0:1746144662.904295:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:29218:x1830964746718720:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5571us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.904303:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11895 00000100:00100000:3.0:1746144662.904355:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746719104 00000100:00100000:3.0:1746144662.904362:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746719104 00000100:00100000:3.0:1746144662.904403:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10114 00000100:00100000:3.0:1746144662.904411:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29221:x1830964746719104:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144662.904432:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.904448:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f070000/0xa7c849b16e01a937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f12b expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.904549:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.904563:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.904569:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.904601:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.904612:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 16 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144662.904623:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747504256:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144662.904660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.904683:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144662.904702:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746718848 00000100:00100000:3.0:1746144662.904704:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746718848 00010000:00010000:3.0:1746144662.904720:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 8 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144662.904734:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746719232 00000100:00100000:3.0:1746144662.904736:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746719232 00010000:00010000:3.0:1746144662.904742:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144662.904764:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5942 00000100:00100000:3.0:1746144662.904769:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746718848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.904777:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144662.904777:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5943 00000100:00100000:1.0:1746144662.904786:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746719232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.904794:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.904795:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 8 pid: 30345 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746144662.904803:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 8 pid: 30345 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144662.904894:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.904904:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.904921:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f070200/0xa7c849b16e01a8f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0fa expref: 20 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.904936:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.904972:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746719232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 187us (311us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144662.904975:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f323c00/0xa7c849b16e01a929 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f11d expref: 8 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144662.904978:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5943 00010000:00010000:3.0:1746144662.905069:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.905095:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746718848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 326us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.905101:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5942 00000100:00100000:0.0:1746144662.905700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.906341:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746719360 00000100:00100000:3.0:1746144662.906347:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746719360 00010000:00010000:3.0:1746144662.906421:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 20 pid: 8388 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144662.906491:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5944 00000100:00100000:3.0:1746144662.906497:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746719360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.906509:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.906521:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 20 pid: 8388 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144662.906530:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 20 pid: 8388 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144662.906543:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009418ec00/0xa7c849b16e01a8dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0e5 expref: 20 pid: 8388 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144662.906551:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.906553:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144662.906559:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.906566:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.906588:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144662.906596:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747504384:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.907258:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144662.907666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.907727:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747504256:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.907749:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144662.907820:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746719488 00000100:00100000:0.0:1746144662.907825:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746719488 00010000:00010000:0.0:1746144662.907844:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 17 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144662.907861:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5945 00000100:00100000:0.0:1746144662.907866:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1960:x1830964746719488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144662.907875:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144662.907879:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 17 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144662.907887:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 17 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144662.907906:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5115400/0xa7c849b16e01a90d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f101 expref: 17 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144662.907921:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144662.907926:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.907934:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.907939:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144662.907964:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.907989:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1960:x1830964746719488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 122us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.907995:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5945 00010000:00010000:3.0:1746144662.908184:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.908190:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144662.908209:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144662.908351:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f070000/0xa7c849b16e01a937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f12b expref: 17 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.908364:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f12b expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.908370:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144662.908373:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144662.908375:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f071800, rc 0) 00000100:00100000:3.0:1746144662.908398:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29221:x1830964746719104:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3988us (4440us total) trans 8589944007 rc 0/0 00000100:00100000:3.0:1746144662.908404:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10114 00000100:00100000:3.0:1746144662.909407:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747504384:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144662.909449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144662.909564:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144662.909596:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746719360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3098us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.909603:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5944 00000100:00100000:2.0:1746144662.909939:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746719744 00000100:00100000:2.0:1746144662.909945:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746719744 00002000:00100000:2.0:1746144662.909979:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3764224->3768319) req@ffff8800a4ebc700 x1830964746719744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.909988:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebc700 with x1830964746719744 ext(3764224->3768319) 00002000:00010000:2.0:1746144662.909993:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ebc700 00000100:00100000:2.0:1746144662.910018:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4575 00000100:00100000:2.0:1746144662.910025:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746719744:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144662.910626:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746719744:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 599us (1174us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144662.910636:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4575 00002000:00100000:2.0:1746144662.910642:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3764224->3768319) req@ffff8800a4ebc700 x1830964746719744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.910649:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebc700 with x1830964746719744 ext(3764224->3768319) 00002000:00010000:2.0:1746144662.910652:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ebc700 00000100:00100000:1.0:1746144662.910748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.910913:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746720000 00000100:00100000:3.0:1746144662.910916:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746720000 00000100:00100000:3.0:1746144662.910947:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10115 00000100:00100000:3.0:1746144662.910952:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29221:x1830964746720000:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144662.910970:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144662.910972:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746144662.910991:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071800/0xa7c849b16e01a93e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f12b expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.911002:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144662.911006:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144662.911016:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c200/0xa7c849b16e01a94c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f132 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.911112:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911124:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911131:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911155:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911161:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911166:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911171:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b51c400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144662.911174:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911179:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911184:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144662.911186:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144662.911188:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911192:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01a953 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144662.911210:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c200/0xa7c849b16e01a94c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f132 expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.911216:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c200/0xa7c849b16e01a94c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f132 expref: 16 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144662.911221:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51c200, rc 0) 00000100:00100000:3.0:1746144662.911251:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29221:x1830964746720000:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 298us (503us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144662.911255:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10115 00000100:00100000:0.0:1746144662.912736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144662.912814:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746720256 00000100:00100000:3.0:1746144662.912819:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746720256 00000100:00100000:3.0:1746144662.912929:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4089 00000100:00100000:3.0:1746144662.912935:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29221:x1830964746720256:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:3.0:1746144662.913112:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29221:x1830964746720256:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 175us (378us total) trans 8589944008 rc 0/0 00000100:00100000:3.0:1746144662.913118:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4089 00000100:00100000:0.0:1746144662.915922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.916098:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746720384 00000100:00100000:2.0:1746144662.916108:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746720384 00000100:00100000:2.0:1746144662.916233:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11896 00000100:00100000:2.0:1746144662.916241:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+22:29218:x1830964746720384:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144662.916259:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.916277:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f139 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.916307:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.916315:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 7 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.916321:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.916327:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.916329:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.916332:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->4403199] (req 4194304->4403199) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.916362:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 38 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.916374:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 38 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.916391:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747504512:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.916476:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 7 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.916488:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 7 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144662.916496:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747504640:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.916522:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.916529:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.916537:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747504768:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.916552:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.920273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.920316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144662.920417:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746720640 00000100:00100000:1.0:1746144662.920426:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746720640 00010000:00010000:1.0:1746144662.920464:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 39 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144662.920489:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746720512 00000100:00100000:1.0:1746144662.920492:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746720512 00010000:00010000:1.0:1746144662.920502:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 8 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144662.920517:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5946 00000100:00100000:1.0:1746144662.920524:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746720640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.920537:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.920559:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 39 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.920570:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 39 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.920594:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.920632:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746720640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.920638:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5946 00000100:00100000:1.0:1746144662.920653:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5947 00000100:00100000:1.0:1746144662.920658:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746720512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.920664:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.920670:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 8 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144662.920678:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 8 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144662.920688:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.920703:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746720512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 45us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.920708:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5947 00010000:00010000:2.0:1746144662.920823:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f070a00/0xa7c849b16e01a8ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0f3 expref: 38 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.920848:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747504512:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.920860:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52c600/0xa7c849b16e01a922 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f116 expref: 7 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144662.920873:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747504640:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.920882:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747504768:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.920909:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4403199] (req 4194304->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.920920:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52de00, rc 0) 00000100:00100000:2.0:1746144662.920943:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+23:29218:x1830964746720384:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4704us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.920950:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11896 00000100:00100000:0.0:1746144662.922200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.922823:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746720768 00000100:00100000:2.0:1746144662.922830:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746720768 00010000:00010000:2.0:1746144662.922856:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.922887:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5948 00000100:00100000:2.0:1746144662.922894:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746720768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.922904:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.922922:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144662.922933:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144662.922952:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af6000/0xa7c849b16e01a8e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0ec expref: 23 pid: 4758 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144662.922965:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.922967:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.922973:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.922982:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.923011:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144662.923024:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747504896:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144662.923109:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144662.927478:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747504896:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144662.927500:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144662.927556:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746720768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4661us (5424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144662.927567:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5948 00000100:00100000:0.0:1746144662.928528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.928591:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746721024 00000100:00100000:2.0:1746144662.928599:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746721024 00002000:00100000:2.0:1746144662.928640:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4399104->4403199) req@ffff8800a4ebc000 x1830964746721024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/0 e 0 to 0 dl 1746144673 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.928650:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebc000 with x1830964746721024 ext(4399104->4403199) 00002000:00010000:2.0:1746144662.928655:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebc000 00000100:00100000:2.0:1746144662.928668:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4576 00000100:00100000:2.0:1746144662.928675:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746721024:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144662.929898:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746721024:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1219us (1368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144662.929905:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4576 00002000:00100000:2.0:1746144662.929914:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4399104->4403199) req@ffff8800a4ebc000 x1830964746721024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:303/0 lens 488/4536 e 0 to 0 dl 1746144673 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144662.929921:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebc000 with x1830964746721024 ext(4399104->4403199) 00002000:00010000:2.0:1746144662.929925:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebc000 00000100:00100000:2.0:1746144662.932940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.933017:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746721280 00000100:00100000:0.0:1746144662.933026:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746721280 00000100:00100000:3.0:1746144662.933209:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4090 00000100:00100000:3.0:1746144662.933218:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+34:29218:x1830964746721280:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144662.933448:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+35:29218:x1830964746721280:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 231us (517us total) trans 8589944009 rc 0/0 00000100:00100000:3.0:1746144662.933456:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4090 00000100:00100000:0.0:1746144662.936882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.936937:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746721536 00000100:00100000:2.0:1746144662.936947:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746721536 00000100:00100000:2.0:1746144662.937832:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10116 00000100:00100000:2.0:1746144662.937841:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29224:x1830964746721536:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144662.937865:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.937885:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d400/0xa7c849b16e01a961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f140 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.938017:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.938035:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144662.938052:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144662.938063:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144662.938184:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d400/0xa7c849b16e01a961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 320 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.938295:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 319 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.938303:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144662.938307:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144662.938310:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52d200, rc 0) 00000100:00100000:2.0:1746144662.939026:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:29224:x1830964746721536:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1184us (2152us total) trans 8589944010 rc 0/0 00000100:00100000:2.0:1746144662.939033:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10116 00000100:00100000:0.0:1746144662.985262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.985358:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746721664 00000100:00100000:2.0:1746144662.985369:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746721664 00000100:00100000:2.0:1746144662.985429:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11897 00000100:00100000:2.0:1746144662.985437:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:29224:x1830964746721664:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144662.985458:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.985478:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f147 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.985509:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.985518:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 6 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.985524:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.985530:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.985531:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.985534:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1089536->1658879] (req 1089536->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 39 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.985566:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.985579:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 21 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144662.985590:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505024:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.985688:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 6 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144662.985697:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 6 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144662.985704:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505152:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.985728:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.985735:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144662.985742:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505280:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.985758:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.992750:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505024:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.992765:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505152:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144662.992774:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505280:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.992809:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1089536->1658879] (req 1089536->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 39 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.992827:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52ce00, rc 0) 00000100:00100000:2.0:1746144662.993512:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:29224:x1830964746721664:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8073us (8258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.993522:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11897 00000100:00100000:0.0:1746144662.993813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.993832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.994219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144662.994250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144662.994772:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746721792 00000100:00100000:2.0:1746144662.994781:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746721792 00010000:00010000:2.0:1746144662.994815:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 22 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144662.995126:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746722048 00000100:00100000:2.0:1746144662.995126:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746721920 00000100:00100000:3.0:1746144662.995130:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746722048 00000100:00100000:2.0:1746144662.995130:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746721920 00010000:00010000:3.0:1746144662.995156:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144662.995178:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5949 00000100:00100000:3.0:1746144662.995184:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746721792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144662.995196:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144662.995219:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 22 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746144662.995230:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 22 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746144662.995249:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f62dc00/0xa7c849b16e01a88f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f0a6 expref: 22 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144662.995387:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5950 00000100:00100000:1.0:1746144662.995394:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746722048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144662.995400:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144662.995407:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.995415:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.995425:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52d800/0xa7c849b16e01a857 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f07c expref: 39 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144662.995443:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144662.995474:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746722048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 81us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144662.995479:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5950 00010000:00010000:2.0:1746144662.995593:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144662.995607:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5951 00000100:00100000:2.0:1746144662.995612:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746721920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144662.995618:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144662.995625:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144662.995629:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746722176 00000100:00100000:0.0:1746144662.995632:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746722176 00010000:00010000:2.0:1746144662.995634:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746144662.995645:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f322a00/0xa7c849b16e01a91b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f10f expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144662.995653:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11898 00000100:00100000:0.0:1746144662.995657:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+22:29228:x1830964746722176:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144662.995658:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.995660:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144662.995666:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.995670:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144662.995673:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.995681:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f14e expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.995696:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.995701:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.995702:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144662.995704:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1818624->2097151] (req 1818624->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.995711:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.995717:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144662.995725:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144662.995737:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505536:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144662.995786:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00010000:00010000:2.0:1746144662.996305:0:7309:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 37 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144662.996315:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144662.996318:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747505408:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144662.996341:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746721792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1156us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144662.996347:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5949 00000100:00100000:2.0:1746144662.996356:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144662.998750:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747505536:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144662.998783:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1818624->2097151] (req 1818624->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144662.998800:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f323e00, rc 0) 00000100:00100000:2.0:1746144662.998845:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+22:29228:x1830964746722176:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3185us (4625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144662.998858:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11898 00000100:00100000:2.0:1746144663.000495:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747505408:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144663.000496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144663.000510:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.000555:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746721920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4941us (6303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.000564:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5951 00000100:00100000:3.0:1746144663.000753:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746722432 00000100:00100000:3.0:1746144663.000761:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746722432 00002000:00100000:3.0:1746144663.000802:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1089536->1093631) req@ffff880092934380 x1830964746722432/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.000811:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934380 with x1830964746722432 ext(1089536->1093631) 00010000:00010000:3.0:1746144663.000819:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.000837:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.000843:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092934380 00000100:00100000:3.0:1746144663.000943:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 906 00000100:00100000:3.0:1746144663.000951:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746722432:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144663.001156:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746722432:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 184us (642us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144663.001162:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 906 00002000:00100000:3.0:1746144663.001167:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1089536->1093631) req@ffff880092934380 x1830964746722432/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.001174:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934380 with x1830964746722432 ext(1089536->1093631) 00010000:00010000:3.0:1746144663.001179:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.001188:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.001375:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092934380 00000100:00100000:0.0:1746144663.005530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.005628:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746722688 00000100:00100000:3.0:1746144663.005639:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746722688 00002000:00100000:3.0:1746144663.005689:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1654784->1658879) req@ffff880092936300 x1830964746722688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.005698:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936300 with x1830964746722688 ext(1654784->1658879) 00010000:00010000:3.0:1746144663.005707:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.005725:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.005732:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092936300 00000100:00100000:3.0:1746144663.005752:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 907 00000100:00100000:3.0:1746144663.005760:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746722688:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144663.005995:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746722688:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 234us (474us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144663.006002:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 907 00002000:00100000:3.0:1746144663.006008:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1654784->1658879) req@ffff880092936300 x1830964746722688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.006015:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936300 with x1830964746722688 ext(1654784->1658879) 00010000:00010000:3.0:1746144663.006020:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.006030:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.006035:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092936300 00000100:00100000:0.0:1746144663.010977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.011212:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746722944 00000100:00100000:3.0:1746144663.011222:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746722944 00002000:00100000:3.0:1746144663.011268:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1089536->1658879) req@ffff880093988380 x1830964746722944/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.011284:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988380 with x1830964746722944 ext(1089536->1658879) 00010000:00010000:3.0:1746144663.011293:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.011308:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 38 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.011315:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093988380 00000100:00100000:0.0:1746144663.011841:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 908 00000100:00100000:0.0:1746144663.011852:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746722944:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144663.025651:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746722944:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 13790us (14673us total) trans 17179873268 rc 0/0 00000100:00100000:1.0:1746144663.025663:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 908 00002000:00100000:1.0:1746144663.025676:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1089536->1658879) req@ffff880093988380 x1830964746722944/t17179873268(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.025840:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988380 with x1830964746722944 ext(1089536->1658879) 00010000:00010000:1.0:1746144663.025850:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.025866:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746144663.025873:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093988380 00000100:00100000:0.0:1746144663.029848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.029909:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746723072 00000100:00100000:2.0:1746144663.029919:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746723072 00010000:00010000:2.0:1746144663.029960:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.030438:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5952 00000100:00100000:2.0:1746144663.030446:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746723072:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.030460:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.030482:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.030494:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.030515:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52ce00/0xa7c849b16e01a976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1089536->1658879) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f147 expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.030536:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.030538:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.030546:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.030564:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.030599:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.030613:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747505664:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.030711:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.032879:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747505664:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.032898:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.032932:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1962:x1830964746723072:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2485us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.032941:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5952 00000100:00100000:0.0:1746144663.034463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.034538:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746723328 00000100:00100000:1.0:1746144663.034547:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746723328 00002000:00100000:1.0:1746144663.034597:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1818624->2097151) req@ffff88009398b100 x1830964746723328/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.034606:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398b100 with x1830964746723328 ext(1818624->2097151) 00002000:00010000:1.0:1746144663.034611:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398b100 00000100:00100000:1.0:1746144663.034642:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4577 00000100:00100000:1.0:1746144663.034649:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746723328:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.038249:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746723328:12345-192.168.204.23@tcp:3:cat.0 Request processed in 3587us (3779us total) trans 0 rc 278528/278528 00000100:00100000:1.0:1746144663.038261:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4577 00002000:00100000:1.0:1746144663.038272:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3ea:0x0] (1818624->2097151) req@ffff88009398b100 x1830964746723328/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 278528/278528 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.038281:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398b100 with x1830964746723328 ext(1818624->2097151) 00002000:00010000:1.0:1746144663.038287:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398b100 00000100:00100000:0.0:1746144663.054796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.054840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.054866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.054882:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746723584 00000100:00100000:0.0:1746144663.054892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.054893:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746723584 00000100:00100000:0.0:1746144663.054917:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746723840 00000100:00100000:0.0:1746144663.054920:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746723840 00002000:00100000:1.0:1746144663.054941:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009398bb80 x1830964746723584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.054941:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009398ad80 x1830964746723840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.054951:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ad80 with x1830964746723840 ext(3145728->4194303) 00002000:00100000:1.0:1746144663.054956:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398bb80 with x1830964746723584 ext(2097152->3145727) 00002000:00010000:0.0:1746144663.054957:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398ad80 00002000:00010000:1.0:1746144663.054958:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398bb80 00000100:00100000:2.0:1746144663.056121:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746724096 00000100:00100000:2.0:1746144663.056127:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746724096 00002000:00100000:2.0:1746144663.056175:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093988a80 x1830964746724096/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.056183:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988a80 with x1830964746724096 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.056186:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988a80 00000100:00100000:2.0:1746144663.056205:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746724352 00000100:00100000:2.0:1746144663.056207:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746724352 00002000:00100000:2.0:1746144663.056216:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3764223) req@ffff880093988700 x1830964746724352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.056221:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988700 with x1830964746724352 ext(3145728->3764223) 00002000:00010000:2.0:1746144663.056225:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988700 00000100:00100000:2.0:1746144663.056235:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4578 00000100:00100000:2.0:1746144663.056241:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746723584:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144663.056812:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4579 00000100:00100000:0.0:1746144663.056822:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746723840:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.056865:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4580 00000100:00100000:1.0:1746144663.056872:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746724096:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.058917:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4581 00000100:00100000:3.0:1746144663.058944:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746724352:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.071178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.071234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.071257:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746724736 00000100:00100000:2.0:1746144663.071267:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746724736 00000100:00100000:2.0:1746144663.071319:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10117 00000100:00100000:2.0:1746144663.071328:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+35:29232:x1830964746724736:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144663.071355:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.071375:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f070c00/0xa7c849b16e01a984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f15c expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.071385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.071413:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746724480 00000100:00100000:0.0:1746144663.071420:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746724480 00010000:00010000:2.0:1746144663.071488:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144663.071509:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:2.0:1746144663.071520:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:2.0:1746144663.071531:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144663.071646:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f070c00/0xa7c849b16e01a984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 38 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.071685:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 37 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.071698:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.071701:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144663.071704:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f071c00, rc 0) 00000100:00100000:2.0:1746144663.071747:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:29232:x1830964746724736:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 421us (513us total) trans 8589944011 rc 0/0 00000100:00100000:2.0:1746144663.071754:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10117 00000100:00100000:1.0:1746144663.072265:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746724864 00000100:00100000:1.0:1746144663.072269:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746724864 00000100:00100000:1.0:1746144663.072290:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11899 00000100:00100000:1.0:1746144663.072296:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746724480:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144663.072303:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11900 00010000:00010000:1.0:1746144663.072305:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144663.072311:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746724864:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.072317:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f155 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.072318:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.072326:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01a9a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f163 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.072334:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.072336:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.072344:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 42 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.072355:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 42 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.072363:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304ac00, rc 0) 00000100:00100000:0.0:1746144663.072370:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747505792:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144663.072385:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746724480:12345-192.168.204.23@tcp:101:cat.0 Request processed in 90us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.072397:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11899 00000100:00100000:0.0:1746144663.072430:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.074026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.074172:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747505792:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144663.074200:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01a9a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f163 expref: 41 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.074211:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01a9a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f163 expref: 41 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.074224:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1c00, rc 0) 00000100:00100000:0.0:1746144663.074248:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746724864:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1939us (2864us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144663.074254:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11900 00000100:00100000:0.0:1746144663.074267:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746724992 00000100:00100000:0.0:1746144663.074270:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746724992 00000100:00100000:0.0:1746144663.074289:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11901 00000100:00100000:0.0:1746144663.074294:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746724992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144663.074303:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.074313:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01a9a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f16a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.074349:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130928a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747505920:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144663.074408:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746723840:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17588us (19566us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.074416:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4579 00002000:00100000:1.0:1746144663.074426:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009398ad80 x1830964746723840/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.074433:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ad80 with x1830964746723840 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.074437:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398ad80 00000100:00100000:0.0:1746144663.076707:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144663.082622:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746724096:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25737us (27740us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.082636:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4580 00002000:00100000:1.0:1746144663.082651:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093988a80 x1830964746724096/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.082660:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988a80 with x1830964746724096 ext(2097152->3145727) 00002000:00010000:1.0:1746144663.082666:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988a80 00000100:00100000:0.0:1746144663.082841:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130928a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747505920:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144663.082873:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01a9a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f16a expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.082887:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01a9a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f16a expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.082897:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f000, rc 0) 00000100:00100000:0.0:1746144663.082926:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746724992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8632us (8906us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144663.082933:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11901 00000100:00100000:3.0:1746144663.086258:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746724352:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27320us (31353us total) trans 0 rc 618496/618496 00000100:00100000:3.0:1746144663.086269:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4581 00002000:00100000:3.0:1746144663.086281:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->3764223) req@ffff880093988700 x1830964746724352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.086289:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988700 with x1830964746724352 ext(3145728->3764223) 00002000:00010000:3.0:1746144663.086295:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988700 00000100:00100000:2.0:1746144663.089346:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746723584:12345-192.168.204.23@tcp:3:cat.0 Request processed in 33093us (34550us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.089359:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4578 00002000:00100000:2.0:1746144663.089370:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009398bb80 x1830964746723584/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.089380:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398bb80 with x1830964746723584 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.089386:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398bb80 00000100:00100000:0.0:1746144663.099570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.099712:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746725248 00000100:00100000:2.0:1746144663.099723:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746725248 00002000:00100000:2.0:1746144663.099772:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130928a80 x1830964746725248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.099782:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928a80 with x1830964746725248 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.099788:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928a80 00000100:00100000:2.0:1746144663.099823:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4582 00000100:00100000:2.0:1746144663.099832:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746725248:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144663.105566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.106688:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746725504 00000100:00100000:3.0:1746144663.106699:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746725504 00002000:00100000:3.0:1746144663.106746:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4403200->4935679) req@ffff880130929f80 x1830964746725504/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.106756:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929f80 with x1830964746725504 ext(4403200->4935679) 00002000:00010000:3.0:1746144663.106763:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130929f80 00000100:00100000:3.0:1746144663.106794:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4583 00000100:00100000:3.0:1746144663.106802:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746725504:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.110372:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746725248:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10530us (10802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.110387:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4582 00002000:00100000:2.0:1746144663.110397:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880130928a80 x1830964746725248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.110406:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130928a80 with x1830964746725248 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.110411:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130928a80 00000100:00100000:3.0:1746144663.119296:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746725504:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11214us (12460us total) trans 0 rc 532480/532480 00000100:00100000:3.0:1746144663.119311:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4583 00002000:00100000:3.0:1746144663.119326:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4403200->4935679) req@ffff880130929f80 x1830964746725504/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 532480/532480 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.119337:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929f80 with x1830964746725504 ext(4403200->4935679) 00002000:00010000:3.0:1746144663.119343:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130929f80 00000100:00100000:0.0:1746144663.121316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.124368:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746725632 00000100:00100000:2.0:1746144663.124383:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746725632 00000100:00100000:2.0:1746144663.124449:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11902 00000100:00100000:2.0:1746144663.124461:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746725632:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.124481:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.124502:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f070e00/0xa7c849b16e01a9ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f171 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.124560:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747506048:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144663.124652:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.124897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.124935:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746725760 00000100:00100000:3.0:1746144663.124939:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746725760 00000100:00100000:3.0:1746144663.126254:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11903 00000100:00100000:3.0:1746144663.126266:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746725760:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.126281:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.126295:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01a9b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f178 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.126336:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747506176:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144663.127303:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.129032:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747506048:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144663.129076:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f070e00/0xa7c849b16e01a9ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f171 expref: 41 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.129094:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f070e00/0xa7c849b16e01a9ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f171 expref: 41 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.129120:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f070e00, rc 0) 00000100:00100000:2.0:1746144663.129297:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746725632:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4834us (7985us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.129307:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11902 00000100:00100000:3.0:1746144663.130887:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747506176:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144663.130920:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01a9b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f178 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.130933:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01a9b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f178 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.131278:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764600, rc 0) 00000100:00100000:3.0:1746144663.131325:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746725760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5061us (6428us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144663.131332:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11903 00000100:00100000:0.0:1746144663.135841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.135941:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746725888 00000100:00100000:3.0:1746144663.135951:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746725888 00000100:00100000:3.0:1746144663.136005:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11904 00000100:00100000:3.0:1746144663.136013:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29234:x1830964746725888:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.136033:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.136062:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f17f expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.136097:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.136104:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.136106:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.136110:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.136169:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.136181:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.136197:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747506304:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.136281:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.139911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.140195:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726016 00000100:00100000:2.0:1746144663.140206:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726016 00000100:00100000:3.0:1746144663.140232:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747506304:192.168.204.23@tcp:104: 00002000:00100000:2.0:1746144663.140250:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4403199) req@ffff880130929500 x1830964746726016/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.140259:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929500 with x1830964746726016 ext(4194304->4403199) 00010000:00010000:3.0:1746144663.140267:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.140267:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 22 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.140280:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 22 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.140282:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764c00, rc 0) 00002000:00010000:2.0:1746144663.140287:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130929500 00000100:00100000:2.0:1746144663.140307:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 909 00000100:00100000:2.0:1746144663.140314:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746726016:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144663.140926:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29234:x1830964746725888:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4912us (5093us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.140934:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11904 00000100:00100000:2.0:1746144663.144384:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746726016:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4059us (4472us total) trans 17179873269 rc 0/0 00000100:00100000:2.0:1746144663.144395:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 909 00002000:00100000:2.0:1746144663.144407:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4403199) req@ffff880130929500 x1830964746726016/t17179873269(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.144417:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130929500 with x1830964746726016 ext(4194304->4403199) 00010000:00010000:2.0:1746144663.144427:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.144448:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746144663.144455:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130929500 00000100:00100000:0.0:1746144663.149620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.149728:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726144 00000100:00100000:2.0:1746144663.149738:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726144 00010000:00010000:2.0:1746144663.149776:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.149868:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5953 00000100:00100000:2.0:1746144663.149875:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746726144:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.149889:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.149912:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.149924:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.149945:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52de00/0xa7c849b16e01a95a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f139 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.149963:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.149965:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.149972:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 40 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.149984:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 40 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.150019:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 40 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.150031:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747506432:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.151003:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.156169:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747506432:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.156190:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.156235:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746726144:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6359us (6626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.156246:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5953 00000100:00100000:0.0:1746144663.157240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.157887:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726400 00000100:00100000:2.0:1746144663.157895:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726400 00002000:00100000:2.0:1746144663.157938:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88013092aa00 x1830964746726400/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.157947:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092aa00 with x1830964746726400 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.157952:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092aa00 00000100:00100000:2.0:1746144663.157970:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4584 00000100:00100000:2.0:1746144663.157976:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1963:x1830964746726400:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.172561:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013092aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1963:x1830964746726400:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14569us (15309us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.172578:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4584 00002000:00100000:2.0:1746144663.172591:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88013092aa00 x1830964746726400/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.172600:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013092aa00 with x1830964746726400 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.172606:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013092aa00 00000100:00100000:0.0:1746144663.178199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.178267:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726528 00000100:00100000:3.0:1746144663.178279:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726528 00000100:00100000:3.0:1746144663.178339:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11905 00000100:00100000:3.0:1746144663.178348:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29234:x1830964746726528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.178368:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.178388:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f186 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.178420:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.178427:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.178429:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.178433:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.178670:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.178683:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 18 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.178696:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747506560:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.179066:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.180075:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747506560:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.180107:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.180120:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b765200, rc 0) 00000100:00100000:3.0:1746144663.180178:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:29234:x1830964746726528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1830us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.180185:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11905 00000100:00100000:0.0:1746144663.182095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.182563:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726656 00000100:00100000:2.0:1746144663.182572:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726656 00002000:00100000:2.0:1746144663.182618:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3764224->4194303) req@ffff88012c946a00 x1830964746726656/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.182627:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946a00 with x1830964746726656 ext(3764224->4194303) 00010000:00010000:2.0:1746144663.182636:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.182656:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746144663.182662:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c946a00 00000100:00100000:2.0:1746144663.182682:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 910 00000100:00100000:2.0:1746144663.182690:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746726656:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144663.190684:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746726656:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6254us (6856us total) trans 21474840509 rc 0/0 00000100:00100000:2.0:1746144663.190698:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 910 00002000:00100000:2.0:1746144663.190712:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3764224->4194303) req@ffff88012c946a00 x1830964746726656/t21474840509(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.190725:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946a00 with x1830964746726656 ext(3764224->4194303) 00010000:00010000:2.0:1746144663.190735:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.190748:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746144663.190753:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c946a00 00000100:00100000:0.0:1746144663.195220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.195347:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726784 00000100:00100000:2.0:1746144663.195357:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726784 00010000:00010000:2.0:1746144663.195396:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.195486:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5954 00000100:00100000:2.0:1746144663.195494:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746726784:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.195509:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.195532:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.195543:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.195565:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b52dc00/0xa7c849b16e01a930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f124 expref: 21 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.195776:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.195778:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.195785:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.195793:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.195825:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.195837:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747506688:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.195969:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.198008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.198246:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746726912 00000100:00100000:3.0:1746144663.198255:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746726912 00000100:00100000:3.0:1746144663.198300:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11906 00000100:00100000:3.0:1746144663.198308:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+23:29232:x1830964746726912:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144663.198328:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.198347:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f18d expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.198383:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.198392:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 40 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.198398:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.198400:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.198403:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1519616->2097151] (req 1519616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.198430:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 40 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.198442:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 40 pid: 8388 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144663.198453:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747506816:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.198546:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.198555:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.198563:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747506944:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.198587:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.198637:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747506688:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.198653:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.198675:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746726784:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3181us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.198685:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5954 00000100:00100000:0.0:1746144663.202300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.202382:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746727040 00000100:00100000:2.0:1746144663.202391:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746727040 00000100:00100000:3.0:1746144663.202416:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747506816:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.202427:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747506944:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.202428:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 25 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.202461:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1519616->2097151] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.202470:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5955 00010000:00010000:3.0:1746144663.202477:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764600, rc 0) 00000100:00100000:2.0:1746144663.202477:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746727040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.202492:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.202514:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 25 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.202524:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 25 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.202534:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+25:29232:x1830964746726912:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4227us (4535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.202542:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11906 00010000:00010000:2.0:1746144663.202546:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f323e00/0xa7c849b16e01a97d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1818624->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f14e expref: 25 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.202562:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.202580:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746727040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.202591:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5955 00000100:00100000:0.0:1746144663.203689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.203732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.203999:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746727424 00000100:00100000:3.0:1746144663.204005:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746727424 00002000:00100000:3.0:1746144663.204049:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c945500 x1830964746727424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.204058:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945500 with x1830964746727424 ext(2097152->3145727) 00002000:00010000:3.0:1746144663.204062:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c945500 00000100:00100000:3.0:1746144663.204079:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4585 00000100:00100000:3.0:1746144663.204085:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746727424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.204130:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746727168 00000100:00100000:2.0:1746144663.204156:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746727168 00010000:00010000:2.0:1746144663.204173:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 41 pid: 8388 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144663.204192:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5956 00000100:00100000:2.0:1746144663.204197:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746727168:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.204205:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.204221:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 41 pid: 8388 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746144663.204232:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 41 pid: 8388 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746144663.204248:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304ac00/0xa7c849b16e01a999 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f155 expref: 41 pid: 8388 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746144663.204259:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.204261:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.204268:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.204276:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.204305:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.204329:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507072:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.204401:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144663.204681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.204750:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746727680 00000100:00100000:0.0:1746144663.204754:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746727680 00002000:00100000:0.0:1746144663.204775:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b571f80 x1830964746727680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.204782:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571f80 with x1830964746727680 ext(3145728->4194303) 00002000:00010000:0.0:1746144663.204785:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b571f80 00000100:00100000:0.0:1746144663.204810:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4586 00000100:00100000:0.0:1746144663.204815:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746727680:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.206490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.206511:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746727936 00000100:00100000:1.0:1746144663.206516:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746727936 00002000:00100000:1.0:1746144663.206541:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b572a00 x1830964746727936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.206549:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572a00 with x1830964746727936 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.206553:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572a00 00000100:00100000:1.0:1746144663.206565:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4587 00000100:00100000:1.0:1746144663.206570:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746727936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.207093:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507072:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.207112:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.207160:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746727168:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2961us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.207636:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5956 00000100:00100000:0.0:1746144663.212817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.212883:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746728064 00000100:00100000:3.0:1746144663.212893:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746728064 00000100:00100000:3.0:1746144663.212954:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11907 00000100:00100000:3.0:1746144663.212962:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+23:29232:x1830964746728064:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144663.212981:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.213000:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f194 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.213033:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.213050:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.213051:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.213054:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2293759] (req 2097152->2293759) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.213084:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.213096:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.213108:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747507200:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.213203:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.216925:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747507200:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.216961:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2293759] (req 2097152->2293759) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.216981:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764000, rc 0) 00000100:00100000:3.0:1746144663.217048:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+24:29232:x1830964746728064:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4078us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.217057:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11907 00000100:00100000:2.0:1746144663.219159:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746727680:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14316us (14451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.219170:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4586 00002000:00100000:2.0:1746144663.219181:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b571f80 x1830964746727680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.219192:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571f80 with x1830964746727680 ext(3145728->4194303) 00002000:00010000:2.0:1746144663.219197:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b571f80 00000100:00100000:3.0:1746144663.223771:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746727424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19673us (20026us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144663.223783:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4585 00002000:00100000:3.0:1746144663.223795:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c945500 x1830964746727424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.223804:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945500 with x1830964746727424 ext(2097152->3145727) 00002000:00010000:3.0:1746144663.223810:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c945500 00000100:00100000:1.0:1746144663.230652:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746727936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24067us (24153us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.230665:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4587 00002000:00100000:1.0:1746144663.230678:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b572a00 x1830964746727936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.230687:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572a00 with x1830964746727936 ext(3145728->4194303) 00010000:00010000:1.0:1746144663.230699:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.230714:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 40 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746144663.230721:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b572a00 00000100:00100000:0.0:1746144663.232387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.232585:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746728192 00000100:00100000:3.0:1746144663.232594:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746728192 00000100:00100000:3.0:1746144663.232641:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11908 00000100:00100000:3.0:1746144663.232648:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29234:x1830964746728192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.232667:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.232685:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f19b expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.232710:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.232712:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.232719:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.232733:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.232743:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764200, rc 0) 00000100:00100000:3.0:1746144663.232789:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29234:x1830964746728192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 141us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.232794:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11908 00000100:00100000:2.0:1746144663.243073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.243125:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746728320 00000100:00100000:0.0:1746144663.243165:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746728320 00010000:00010000:0.0:1746144663.243207:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.243246:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5957 00000100:00100000:0.0:1746144663.243254:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746728320:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.243269:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.243293:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.243305:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.243334:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764c00/0xa7c849b16e01a9bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f17f expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.243365:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.243367:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.243375:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.243382:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.243416:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.243429:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c945c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507328:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144663.243520:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.245264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.245302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.245424:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746728576 00000100:00100000:1.0:1746144663.245430:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746728576 00002000:00100000:1.0:1746144663.245467:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880099663c50 x1830964746728576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.245476:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099663c50 with x1830964746728576 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.245480:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099663c50 00000100:00100000:1.0:1746144663.245511:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4588 00000100:00100000:1.0:1746144663.245517:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746728576:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.246966:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746728704 00000100:00100000:2.0:1746144663.246973:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746728704 00000100:00100000:2.0:1746144663.247003:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11909 00000100:00100000:2.0:1746144663.247009:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746728704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.247020:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.247047:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6a00/0xa7c849b16e01a9df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1a2 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.247077:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6a00/0xa7c849b16e01a9df lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a2 expref: 25 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.247087:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0a6a00/0xa7c849b16e01a9df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a2 expref: 25 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.247101:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a6a00, rc 0) 00000100:00100000:2.0:1746144663.247127:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746728704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 118us (1824us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.247151:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11909 00000100:00100000:0.0:1746144663.249036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.249159:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c945c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507328:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144663.249187:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.249224:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746728320:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5969us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.249232:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5957 00000100:00100000:1.0:1746144663.249435:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746728832 00000100:00100000:1.0:1746144663.249441:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746728832 00000100:00100000:1.0:1746144663.250375:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11910 00000100:00100000:1.0:1746144663.250384:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746728832:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.250581:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.250599:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1a9 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.250622:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.250624:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.250633:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.250649:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.250659:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e200, rc 0) 00000100:00100000:1.0:1746144663.250707:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746728832:12345-192.168.204.23@tcp:101:cat.0 Request processed in 324us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.250712:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11910 00000100:00100000:0.0:1746144663.254734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.255262:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729088 00000100:00100000:3.0:1746144663.255272:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729088 00002000:00100000:3.0:1746144663.255316:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2289664->2293759) req@ffff88012c945c00 x1830964746729088/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746144663.255321:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746728576:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9802us (10059us total) trans 0 rc 1048576/1048576 00002000:00100000:3.0:1746144663.255325:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945c00 with x1830964746729088 ext(2289664->2293759) 00002000:00010000:3.0:1746144663.255331:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c945c00 00000100:00100000:1.0:1746144663.255331:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4588 00002000:00100000:1.0:1746144663.255337:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880099663c50 x1830964746728576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.255344:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099663c50 with x1830964746728576 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.255348:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099663c50 00000100:00100000:3.0:1746144663.255360:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4589 00000100:00100000:3.0:1746144663.255368:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746729088:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144663.255519:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746729088:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 150us (793us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144663.255525:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4589 00002000:00100000:3.0:1746144663.255530:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2289664->2293759) req@ffff88012c945c00 x1830964746729088/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.255536:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945c00 with x1830964746729088 ext(2289664->2293759) 00002000:00010000:3.0:1746144663.255539:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c945c00 00000100:00100000:0.0:1746144663.262057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.262127:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729344 00000100:00100000:1.0:1746144663.262173:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729344 00002000:00100000:1.0:1746144663.262222:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1519615) req@ffff88012c944000 x1830964746729344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.262237:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944000 with x1830964746729344 ext(1048576->1519615) 00002000:00010000:1.0:1746144663.262243:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944000 00000100:00100000:1.0:1746144663.262278:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4590 00000100:00100000:1.0:1746144663.262286:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746729344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144663.264007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.264165:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729728 00000100:00100000:1.0:1746144663.264171:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729728 00000100:00100000:1.0:1746144663.264222:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11911 00000100:00100000:1.0:1746144663.264228:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29240:x1830964746729728:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144663.264244:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.264263:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1be expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.264291:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.264298:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144663.264300:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144663.264303:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->4063231] (req 3809280->4063231) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.264332:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.264343:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.264360:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747507456:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.264427:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.264453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.264805:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729472 00000100:00100000:3.0:1746144663.264809:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729472 00000100:00100000:3.0:1746144663.264832:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11912 00000100:00100000:3.0:1746144663.264837:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746729472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.264844:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.264853:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e01a9f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1b0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.264883:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747507584:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144663.264995:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.266454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.266514:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729600 00000100:00100000:2.0:1746144663.266519:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729600 00000100:00100000:2.0:1746144663.266560:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11913 00000100:00100000:2.0:1746144663.266567:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1960:x1830964746729600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.266582:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.266593:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1000/0xa7c849b16e01a9fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1b7 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.266616:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1000/0xa7c849b16e01a9fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1b7 expref: 45 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.266625:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1000/0xa7c849b16e01a9fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1b7 expref: 45 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.266647:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1000, rc 0) 00000100:00100000:2.0:1746144663.266688:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1960:x1830964746729600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 122us (237us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.266694:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11913 00000100:00100000:2.0:1746144663.269817:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747507456:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.269842:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->4063231] (req 3809280->4063231) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.269855:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e400, rc 0) 00000100:00100000:2.0:1746144663.269887:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29240:x1830964746729728:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5660us (5888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.269893:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11911 00000100:00100000:1.0:1746144663.270165:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746729344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7878us (8129us total) trans 0 rc 471040/471040 00000100:00100000:1.0:1746144663.270175:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4590 00002000:00100000:1.0:1746144663.270184:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1519615) req@ffff88012c944000 x1830964746729344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 471040/471040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.270193:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944000 with x1830964746729344 ext(1048576->1519615) 00002000:00010000:1.0:1746144663.270198:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944000 00000100:00100000:3.0:1746144663.270321:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747507584:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144663.270347:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e01a9f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1b0 expref: 42 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.270358:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51ca00/0xa7c849b16e01a9f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1b0 expref: 42 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.270379:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51ca00, rc 0) 00000100:00100000:3.0:1746144663.270399:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1960:x1830964746729472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5561us (5947us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144663.270405:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11912 00000100:00100000:0.0:1746144663.271207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.271288:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729856 00000100:00100000:2.0:1746144663.271294:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729856 00010000:00010000:2.0:1746144663.271320:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.271345:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5958 00000100:00100000:2.0:1746144663.271350:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1960:x1830964746729856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.271361:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.271374:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.271384:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.271402:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764200/0xa7c849b16e01a9d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f19b expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.271417:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.271419:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.271425:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 40 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.271433:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 40 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.271459:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 40 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.271468:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507712:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.272441:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.273168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.273401:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746729984 00000100:00100000:3.0:1746144663.273408:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746729984 00000100:00100000:3.0:1746144663.273456:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11914 00000100:00100000:3.0:1746144663.273463:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29234:x1830964746729984:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.273479:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.273495:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1c5 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.273727:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 42 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.273735:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.273737:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.273740:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->4935679] (req 4194304->4935679) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.273771:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 42 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.273782:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 42 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.273792:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747507840:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.273948:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.276078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.276187:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746730240 00000100:00100000:1.0:1746144663.276195:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746730240 00002000:00100000:1.0:1746144663.276236:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3809280->3813375) req@ffff88012c946a00 x1830964746730240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.276246:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946a00 with x1830964746730240 ext(3809280->3813375) 00000100:00100000:2.0:1746144663.276253:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507712:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144663.276255:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.276269:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.276269:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746144663.276276:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c946a00 00000100:00100000:1.0:1746144663.276300:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 911 00000100:00100000:1.0:1746144663.276308:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746730240:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.276767:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746729856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5415us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.276777:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5958 00000100:00100000:3.0:1746144663.276946:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747507840:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.276969:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4935679] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.276984:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51c200, rc 0) 00000100:00100000:1.0:1746144663.277007:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746730240:12345-192.168.204.23@tcp:3:cat.0 Request processed in 699us (937us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144663.277009:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29234:x1830964746729984:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3547us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.277014:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 911 00000100:00100000:3.0:1746144663.277015:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11914 00002000:00100000:1.0:1746144663.277019:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3809280->3813375) req@ffff88012c946a00 x1830964746730240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.277026:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946a00 with x1830964746730240 ext(3809280->3813375) 00010000:00010000:1.0:1746144663.277031:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.277051:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746144663.277056:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c946a00 00000100:00100000:0.0:1746144663.280008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.280071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.280113:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746730496 00000100:00100000:3.0:1746144663.280122:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746730496 00002000:00100000:3.0:1746144663.280181:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2293760->3145727) req@ffff88012c945500 x1830964746730496/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.280194:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945500 with x1830964746730496 ext(2293760->3145727) 00002000:00010000:3.0:1746144663.280199:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c945500 00000100:00100000:3.0:1746144663.280223:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746730752 00000100:00100000:3.0:1746144663.280226:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746730752 00000100:00100000:1.0:1746144663.280231:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4591 00002000:00100000:3.0:1746144663.280241:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c947b80 x1830964746730752/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144663.280241:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746730496:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:3.0:1746144663.280247:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947b80 with x1830964746730752 ext(2097152->3145727) 00002000:00010000:3.0:1746144663.280251:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c947b80 00000100:00100000:3.0:1746144663.280274:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4592 00000100:00100000:3.0:1746144663.280279:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746730752:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.283987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.284159:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746731008 00000100:00100000:3.0:1746144663.284168:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746731008 00002000:00100000:3.0:1746144663.284215:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4059136->4063231) req@ffff880092879c00 x1830964746731008/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.284226:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879c00 with x1830964746731008 ext(4059136->4063231) 00010000:00010000:3.0:1746144663.284236:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.284251:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.284258:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092879c00 00000100:00100000:3.0:1746144663.284279:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 912 00000100:00100000:3.0:1746144663.284286:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746731008:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.284437:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746731008:12345-192.168.204.23@tcp:3:cat.0 Request processed in 150us (458us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144663.284443:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 912 00002000:00100000:3.0:1746144663.284448:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4059136->4063231) req@ffff880092879c00 x1830964746731008/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.284462:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879c00 with x1830964746731008 ext(4059136->4063231) 00010000:00010000:3.0:1746144663.284466:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.284475:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.284480:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092879c00 00000100:00100000:1.0:1746144663.288985:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746730496:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8732us (8975us total) trans 0 rc 851968/851968 00000100:00100000:1.0:1746144663.288997:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4591 00002000:00100000:1.0:1746144663.289010:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2293760->3145727) req@ffff88012c945500 x1830964746730496/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 851968/851968 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.289020:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945500 with x1830964746730496 ext(2293760->3145727) 00002000:00010000:1.0:1746144663.289025:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c945500 00000100:00100000:3.0:1746144663.292607:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746730752:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12315us (12523us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144663.292620:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4592 00002000:00100000:3.0:1746144663.292633:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012c947b80 x1830964746730752/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.292642:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947b80 with x1830964746730752 ext(2097152->3145727) 00002000:00010000:3.0:1746144663.292648:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c947b80 00000100:00100000:0.0:1746144663.292905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.293210:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746731264 00000100:00100000:3.0:1746144663.293218:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746731264 00002000:00100000:3.0:1746144663.293250:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3809280->4063231) req@ffff88012b5f6300 x1830964746731264/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.293258:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6300 with x1830964746731264 ext(3809280->4063231) 00010000:00010000:3.0:1746144663.293265:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.293279:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 41 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.293287:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f6300 00000100:00100000:3.0:1746144663.293309:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 913 00000100:00100000:3.0:1746144663.293317:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746731264:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144663.298670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.299070:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746731392 00000100:00100000:3.0:1746144663.299080:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746731392 00000100:00100000:3.0:1746144663.299127:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11915 00000100:00100000:3.0:1746144663.299160:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:29242:x1830964746731392:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.299180:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.299199:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1cc expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.299226:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.299228:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.299232:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.299243:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.299253:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51d200, rc 0) 00000100:00100000:3.0:1746144663.299652:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:29242:x1830964746731392:12345-192.168.204.23@tcp:101:cat.0 Request processed in 516us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.299658:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11915 00000100:00100000:2.0:1746144663.301278:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1961:x1830964746731264:12345-192.168.204.23@tcp:4:cat.0 Request processed in 7953us (8365us total) trans 17179873270 rc 0/0 00000100:00100000:2.0:1746144663.301289:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 913 00002000:00100000:2.0:1746144663.301301:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3809280->4063231) req@ffff88012b5f6300 x1830964746731264/t17179873270(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.301310:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6300 with x1830964746731264 ext(3809280->4063231) 00010000:00010000:2.0:1746144663.301320:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.301336:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746144663.301342:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b5f6300 00000100:00100000:0.0:1746144663.307577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.307690:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746731520 00000100:00100000:2.0:1746144663.307700:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746731520 00010000:00010000:2.0:1746144663.307740:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.307784:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5959 00000100:00100000:2.0:1746144663.307792:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746731520:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.307808:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144663.307828:0:7101:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144663 -> 1746144664 00002000:00010000:2.0:1746144663.307831:0:7101:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144663 -> 1746144664 00010000:00010000:2.0:1746144663.307836:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.307847:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.307870:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e400/0xa7c849b16e01a9ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3809280->18446744073709551615] (req 3809280->4063231) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1be expref: 43 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.307901:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.307903:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.307911:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.307920:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.307929:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.307930:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.307933:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.307940:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.307971:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.307984:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507968:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.308084:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.308092:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747508096:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.308937:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.311641:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747507968:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.311655:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747508096:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.311674:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.311716:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746731520:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3924us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.311728:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5959 00000100:00100000:0.0:1746144663.313614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.313800:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746731776 00000100:00100000:2.0:1746144663.313809:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746731776 00002000:00100000:2.0:1746144663.313851:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f5f80 x1830964746731776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.313861:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5f80 with x1830964746731776 ext(4194304->4935679) 00002000:00010000:2.0:1746144663.313868:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f5f80 00000100:00100000:2.0:1746144663.313902:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4593 00000100:00100000:2.0:1746144663.313910:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746731776:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144663.318913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.318956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.319157:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732288 00000100:00100000:1.0:1746144663.319157:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732160 00000100:00100000:2.0:1746144663.319166:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732288 00000100:00100000:1.0:1746144663.319166:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732160 00002000:00100000:2.0:1746144663.319210:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b5f7800 x1830964746732288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.319210:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b5f6d80 x1830964746732160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.319220:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7800 with x1830964746732288 ext(3145728->4194303) 00002000:00100000:1.0:1746144663.319220:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6d80 with x1830964746732160 ext(3145728->4194303) 00002000:00010000:2.0:1746144663.319225:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f7800 00002000:00010000:1.0:1746144663.319225:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6d80 00000100:00100000:2.0:1746144663.319302:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4594 00000100:00100000:2.0:1746144663.319310:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746732288:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.319738:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4595 00000100:00100000:1.0:1746144663.319786:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746732160:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.320353:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746731776:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6442us (6744us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144663.320366:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4593 00002000:00100000:3.0:1746144663.320373:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f5f80 x1830964746731776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.320381:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5f80 with x1830964746731776 ext(4194304->4935679) 00002000:00010000:3.0:1746144663.320386:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f5f80 00000100:00100000:0.0:1746144663.325456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.326251:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732416 00000100:00100000:3.0:1746144663.326262:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732416 00000100:00100000:3.0:1746144663.326319:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11916 00000100:00100000:3.0:1746144663.326328:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1963:x1830964746732416:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.326349:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.326370:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01aa10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1d3 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.326422:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747508224:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144663.327254:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.328192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.328256:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732544 00000100:00100000:2.0:1746144663.328263:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732544 00000100:00100000:2.0:1746144663.328298:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11917 00000100:00100000:2.0:1746144663.328304:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746732544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.328316:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.328328:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff0600/0xa7c849b16e01aa17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1da expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.328354:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0600/0xa7c849b16e01aa17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1da expref: 45 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.328364:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0600/0xa7c849b16e01aa17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1da expref: 45 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.328389:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0600, rc 0) 00000100:00100000:2.0:1746144663.329124:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746732544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 817us (931us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.329131:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11917 00000100:00100000:2.0:1746144663.329872:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746732288:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10561us (10913us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.329881:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4594 00002000:00100000:2.0:1746144663.329892:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b5f7800 x1830964746732288/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.329901:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7800 with x1830964746732288 ext(3145728->4194303) 00002000:00010000:2.0:1746144663.329906:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f7800 00002000:00010000:3.0:1746144663.330509:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746144663 -> 1746144664 00000100:00100000:3.0:1746144663.330529:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747508224:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144663.330563:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01aa10 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1d3 expref: 43 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.330576:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01aa10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1d3 expref: 43 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.330599:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51d000, rc 0) 00000100:00100000:3.0:1746144663.331210:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1963:x1830964746732416:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4881us (5763us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144663.331217:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11916 00000100:00100000:1.0:1746144663.331539:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746732160:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11793us (12635us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.331546:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4595 00002000:00100000:1.0:1746144663.331553:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b5f6d80 x1830964746732160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.331560:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6d80 with x1830964746732160 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.331563:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6d80 00000100:00100000:0.0:1746144663.334065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.334513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.334861:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732672 00000100:00100000:2.0:1746144663.334871:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732672 00000100:00100000:2.0:1746144663.334908:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732800 00000100:00100000:2.0:1746144663.334910:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732800 00000100:00100000:3.0:1746144663.334932:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11918 00000100:00100000:2.0:1746144663.334939:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11919 00000100:00100000:3.0:1746144663.334941:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746732672:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144663.334943:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746732800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.334969:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.334990:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51de00/0xa7c849b16e01aa1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1e1 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.335058:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747508352:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144663.335154:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144663.335487:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.335497:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff0e00/0xa7c849b16e01aa25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1e8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.335517:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0e00/0xa7c849b16e01aa25 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1e8 expref: 45 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.335527:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0e00/0xa7c849b16e01aa25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1e8 expref: 45 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.335541:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0e00, rc 0) 00000100:00100000:2.0:1746144663.336093:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746732800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1136us (1568us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.336102:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11919 00000100:00100000:2.0:1746144663.336485:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747508352:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144663.336510:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51de00/0xa7c849b16e01aa1e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1e1 expref: 43 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.336520:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51de00/0xa7c849b16e01aa1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1e1 expref: 43 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.336527:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51de00, rc 0) 00000100:00100000:2.0:1746144663.336905:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746732672:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1964us (2848us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.336912:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11918 00000100:00100000:0.0:1746144663.337290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.337409:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746732928 00000100:00100000:2.0:1746144663.337414:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746732928 00000100:00100000:2.0:1746144663.337443:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11920 00000100:00100000:2.0:1746144663.337448:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746732928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.337461:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.337471:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1200/0xa7c849b16e01aa2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1ef expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.337493:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1200/0xa7c849b16e01aa2c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1ef expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.337501:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1200/0xa7c849b16e01aa2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1ef expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.337508:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1200, rc 0) 00000100:00100000:2.0:1746144663.337625:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746732928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 175us (334us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.337630:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11920 00000100:00100000:0.0:1746144663.340326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.340382:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746733184 00000100:00100000:1.0:1746144663.340391:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746733184 00002000:00100000:1.0:1746144663.340430:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f4700 x1830964746733184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.340439:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4700 with x1830964746733184 ext(4194304->4935679) 00002000:00010000:1.0:1746144663.340444:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f4700 00000100:00100000:1.0:1746144663.340468:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4596 00000100:00100000:1.0:1746144663.340474:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746733184:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.348109:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746733184:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7622us (7779us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746144663.348122:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4596 00002000:00100000:1.0:1746144663.348153:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012b5f4700 x1830964746733184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.348162:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4700 with x1830964746733184 ext(4194304->4935679) 00002000:00010000:1.0:1746144663.348169:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f4700 00000100:00100000:0.0:1746144663.351507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.351569:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747508480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746144663.351639:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746733312 00000100:00100000:2.0:1746144663.351649:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746733312 00000100:00100000:2.0:1746144663.351692:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11921 00000100:00100000:2.0:1746144663.351700:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746733312:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.351720:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144663.351735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746144663.351739:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01aa33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1f6 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.351770:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01aa33 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1f6 expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144663.351771:0:13589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747508480 00000100:00100000:1.0:1746144663.351774:0:13589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747508480 00010000:00010000:2.0:1746144663.351780:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01aa33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1f6 expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.351793:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1a00, rc 0) 00000100:00100000:2.0:1746144663.351831:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746733312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 132us (336us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.351837:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11921 00000100:00100000:1.0:1746144663.351879:0:13589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1746144663.351884:0:13589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830964747508480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746144663.351900:0:13589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 447807488 pending 13631488 free 3853516800 avail 3851419648 00000100:00100000:1.0:1746144663.351926:0:13589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830964747508480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.351930:0:13589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1746144663.351977:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840496 gen 2 00000100:00080000:3.0:1746144663.352257:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746144663.352300:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33d180, transno 21474840432 00000004:00080000:1.0:1746144663.352307:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33df80, transno 21474840433 00000004:00080000:1.0:1746144663.352309:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f480, transno 21474840434 00000004:00080000:1.0:1746144663.352312:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33e680, transno 21474840435 00000004:00080000:1.0:1746144663.352314:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f800, transno 21474840436 00000004:00080000:1.0:1746144663.352316:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33fb80, transno 21474840437 00000004:00080000:1.0:1746144663.352319:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33c000, transno 21474840438 00000004:00080000:1.0:1746144663.352321:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ca80, transno 21474840439 00000004:00080000:1.0:1746144663.352323:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01dc00, transno 21474840440 00000004:00080000:1.0:1746144663.352326:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01ca80, transno 21474840441 00000004:00080000:1.0:1746144663.352328:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01d500, transno 21474840442 00000004:00080000:1.0:1746144663.352330:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01d880, transno 21474840443 00000004:00080000:1.0:1746144663.352333:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01f800, transno 21474840444 00000004:00080000:1.0:1746144663.352336:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01ea00, transno 21474840445 00000004:00080000:1.0:1746144663.352338:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01f100, transno 21474840446 00000004:00080000:1.0:1746144663.352340:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01d180, transno 21474840447 00000004:00080000:1.0:1746144663.352343:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8d180, transno 21474840451 00000004:00080000:1.0:1746144663.352345:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b810a80, transno 21474840452 00000004:00080000:1.0:1746144663.352347:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8dc00, transno 21474840453 00000004:00080000:1.0:1746144663.352349:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b812d80, transno 21474840454 00000004:00080000:1.0:1746144663.352352:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8ca80, transno 21474840455 00000004:00080000:1.0:1746144663.352354:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b811f80, transno 21474840456 00000004:00080000:1.0:1746144663.352356:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8ea00, transno 21474840457 00000004:00080000:1.0:1746144663.352358:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b811c00, transno 21474840458 00000004:00080000:1.0:1746144663.352361:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb5180, transno 21474840459 00000004:00080000:1.0:1746144663.352363:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb7100, transno 21474840460 00000004:00080000:1.0:1746144663.352365:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb5f80, transno 21474840461 00000004:00080000:1.0:1746144663.352367:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb6a00, transno 21474840462 00000004:00080000:1.0:1746144663.352370:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb4380, transno 21474840463 00000004:00080000:1.0:1746144663.352373:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb5500, transno 21474840464 00000004:00080000:1.0:1746144663.352375:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb4700, transno 21474840465 00000004:00080000:1.0:1746144663.352378:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb7800, transno 21474840466 00000004:00080000:1.0:1746144663.352380:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cd500, transno 21474840481 00000004:00080000:1.0:1746144663.352383:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cf100, transno 21474840482 00000004:00080000:1.0:1746144663.352385:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cce00, transno 21474840483 00000004:00080000:1.0:1746144663.352387:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cea00, transno 21474840484 00000004:00080000:1.0:1746144663.352389:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1ced80, transno 21474840485 00000004:00080000:1.0:1746144663.352391:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e32300, transno 21474840486 00000004:00080000:1.0:1746144663.352394:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1cca80, transno 21474840487 00000004:00080000:1.0:1746144663.352396:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e31500, transno 21474840488 00000004:00080000:1.0:1746144663.352398:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f447b80, transno 21474840489 00000004:00080000:1.0:1746144663.352400:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f446a00, transno 21474840490 00000004:00080000:1.0:1746144663.352403:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013129ed80, transno 21474840491 00000004:00080000:1.0:1746144663.352405:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f444000, transno 21474840492 00000004:00080000:1.0:1746144663.352407:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f447100, transno 21474840493 00000004:00080000:1.0:1746144663.352409:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f444a80, transno 21474840494 00000004:00080000:1.0:1746144663.352411:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f446680, transno 21474840495 00000004:00080000:1.0:1746144663.352413:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f447800, transno 21474840496 00000100:00100000:1.0:1746144663.352422:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747508480:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1746144663.352685:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 33 in progress, 0 in flight, 15 done 00000004:00080000:2.0:1746144663.352889:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 33 done 00000100:00100000:0.0:1746144663.353827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.353906:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746733440 00000100:00100000:2.0:1746144663.353911:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746733440 00000100:00100000:2.0:1746144663.353941:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11922 00000100:00100000:2.0:1746144663.353948:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746733440:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.353961:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.353975:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01aa3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f1fd expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.354000:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01aa3a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1fd expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.354010:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01aa3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1fd expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.354020:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1800, rc 0) 00000100:00100000:2.0:1746144663.354080:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746733440:12345-192.168.204.23@tcp:101:cat.0 Request processed in 131us (255us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.354086:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11922 00000100:00100000:0.0:1746144663.364218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.364382:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746733568 00000100:00100000:2.0:1746144663.364394:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746733568 00000100:00100000:2.0:1746144663.364466:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10118 00000100:00100000:2.0:1746144663.364475:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29247:x1830964746733568:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.364502:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.364521:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0000/0xa7c849b16e01aa41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f204 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.364588:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364601:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364612:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364625:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364630:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364635:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364747:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364759:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 318 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.364766:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 36 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.364772:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.364804:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 36 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.364819:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 36 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.364830:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747508608:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.364915:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 318 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.364923:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.364931:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747508736:192.168.204.23@tcp:104: 00000100:00080000:3.0:1746144663.364934:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144663.364950:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.367366:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830964747509120:0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.367419:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.367445:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746144663.367450:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747509248:0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.367470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.367496:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747509248 00000100:00100000:3.0:1746144663.367515:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747509248 00000100:00100000:3.0:1746144663.367569:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1746144663.367576:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1830964747509248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.367619:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1830964747509248:12345-0@lo:400:kworker.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.367623:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830964747508992:0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.367625:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1746144663.367656:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873249 gen 2 00000004:00080000:3.0:1746144663.367662:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33c700, transno 17179873174 00000004:00080000:3.0:1746144663.367669:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ea00, transno 17179873175 00000004:00080000:3.0:1746144663.367671:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ed80, transno 17179873176 00000004:00080000:3.0:1746144663.367673:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33d880, transno 17179873177 00000004:00080000:3.0:1746144663.367675:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33c380, transno 17179873178 00000004:00080000:3.0:1746144663.367677:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33d500, transno 17179873179 00000004:00080000:3.0:1746144663.367680:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33f100, transno 17179873180 00000004:00080000:3.0:1746144663.367682:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f33ce00, transno 17179873181 00000004:00080000:3.0:1746144663.367684:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920adc00, transno 17179873182 00000004:00080000:3.0:1746144663.367686:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d2d80, transno 17179873187 00000004:00080000:3.0:1746144663.367688:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d3b80, transno 17179873188 00000100:00100000:1.0:1746144663.367689:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746144663.367690:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d3800, transno 17179873189 00000004:00080000:3.0:1746144663.367692:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d1f80, transno 17179873190 00000004:00080000:3.0:1746144663.367694:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d3100, transno 17179873191 00000004:00080000:3.0:1746144663.367697:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d0e00, transno 17179873192 00000004:00080000:3.0:1746144663.367699:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d0380, transno 17179873193 00000004:00080000:3.0:1746144663.367701:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d1180, transno 17179873194 00000004:00080000:3.0:1746144663.367703:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c7d2a00, transno 17179873195 00000004:00080000:3.0:1746144663.367706:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01fb80, transno 17179873196 00000004:00080000:3.0:1746144663.367708:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01c000, transno 17179873197 00000004:00080000:3.0:1746144663.367710:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01ed80, transno 17179873198 00000004:00080000:3.0:1746144663.367713:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01df80, transno 17179873199 00000004:00080000:3.0:1746144663.367715:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01c380, transno 17179873200 00000004:00080000:3.0:1746144663.367717:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01ce00, transno 17179873201 00000004:00080000:3.0:1746144663.367719:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01e680, transno 17179873202 00000100:00100000:1.0:1746144663.367720:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000004:00080000:3.0:1746144663.367722:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01f480, transno 17179873203 00000004:00080000:3.0:1746144663.367724:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44700, transno 17179873204 00000100:00100000:1.0:1746144663.367726:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3294:1830964747508864:0@lo:400:kworker.0 00000004:00080000:3.0:1746144663.367727:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb45500, transno 17179873208 00000004:00080000:3.0:1746144663.367729:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb47b80, transno 17179873209 00000004:00080000:3.0:1746144663.367732:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb45c00, transno 17179873210 00000004:00080000:3.0:1746144663.367735:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44e00, transno 17179873211 00000004:00080000:3.0:1746144663.367737:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb46680, transno 17179873212 00000004:00080000:3.0:1746144663.367739:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44380, transno 17179873213 00000004:00080000:3.0:1746144663.367741:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb45880, transno 17179873214 00000004:00080000:3.0:1746144663.367743:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb46300, transno 17179873215 00000004:00080000:3.0:1746144663.367746:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51edc00, transno 17179873216 00000004:00080000:3.0:1746144663.367748:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ec700, transno 17179873217 00000004:00080000:3.0:1746144663.367751:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b813b80, transno 17179873218 00000004:00080000:3.0:1746144663.367753:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b811880, transno 17179873219 00000004:00080000:3.0:1746144663.367755:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebd500, transno 17179873220 00000004:00080000:3.0:1746144663.367758:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b813480, transno 17179873221 00000004:00080000:3.0:1746144663.367760:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebf100, transno 17179873222 00000004:00080000:3.0:1746144663.367762:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b813800, transno 17179873223 00000004:00080000:3.0:1746144663.367764:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebed80, transno 17179873224 00000004:00080000:3.0:1746144663.367766:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebc380, transno 17179873225 00000004:00080000:3.0:1746144663.367768:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd91180, transno 17179873232 00000004:00080000:3.0:1746144663.367770:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd90e00, transno 17179873233 00000004:00080000:3.0:1746144663.367772:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd90a80, transno 17179873234 00000004:00080000:3.0:1746144663.367774:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd90380, transno 17179873235 00000004:00080000:3.0:1746144663.367777:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd92a00, transno 17179873236 00000004:00080000:3.0:1746144663.367779:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16ad80, transno 17179873237 00000004:00080000:3.0:1746144663.367782:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093760a80, transno 17179873238 00000004:00080000:3.0:1746144663.367784:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd93100, transno 17179873239 00000004:00080000:3.0:1746144663.367786:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd93800, transno 17179873240 00000004:00080000:3.0:1746144663.367789:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39b800, transno 17179873241 00000004:00080000:3.0:1746144663.367792:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f399f80, transno 17179873242 00000004:00080000:3.0:1746144663.367794:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eed80, transno 17179873243 00000004:00080000:3.0:1746144663.367796:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f398e00, transno 17179873244 00000004:00080000:3.0:1746144663.367799:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4dd4a80, transno 17179873245 00000004:00080000:3.0:1746144663.367803:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51edf80, transno 17179873246 00000004:00080000:3.0:1746144663.367805:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f399180, transno 17179873247 00000004:00080000:3.0:1746144663.367807:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ee300, transno 17179873248 00000004:00080000:3.0:1746144663.367809:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ebf480, transno 17179873249 00000100:00100000:3.0:1746144663.367820:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747509248:0@lo:400:kworker.0 00000100:00080000:3.0:1746144663.367841:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144663.367869:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747509120 00000100:00100000:3.0:1746144663.367872:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747509120 00000100:00100000:3.0:1746144663.367893:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747508992 00000100:00100000:3.0:1746144663.367895:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747508992 00000100:00100000:3.0:1746144663.367909:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1746144663.367914:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830964747509120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144663.367928:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.367946:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830964747509120:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.367951:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1746144663.367960:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1746144663.367962:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830964747509376:0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.367965:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830964747508992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144663.367982:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.367988:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830964747508992:12345-0@lo:400:kworker.0 Request processed in 23us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.367993:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1746144663.368000:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747509376 00000100:00100000:3.0:1746144663.368002:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747509376 00000100:00100000:1.0:1746144663.368010:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830964747508992:0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.368012:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1746144663.368016:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830964747509376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.368053:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830964747509376:12345-0@lo:400:kworker.0 Request processed in 37us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.368059:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1746144663.368072:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746144663.368083:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830964747509120:0@lo:400:kworker.0 00000100:00100000:1.0:1746144663.368093:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746144663.368095:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144663.368111:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830964747509376:0@lo:400:kworker.0 00000100:00100000:3.0:1746144663.368118:0:14707:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747508864 00000100:00100000:3.0:1746144663.368121:0:14707:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747508864 00000100:00100000:1.0:1746144663.368129:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747509504 00000100:00100000:1.0:1746144663.368147:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747509504 00000100:00100000:3.0:1746144663.368161:0:14707:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1746144663.368166:0:14707:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3294:x1830964747508864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144663.368173:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1746144663.368178:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1830964747509504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746144663.368195:0:14707:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3294:x1830964747508864:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00002000:00000024:1.0:1746144663.368196:0:8455:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 3407872 granted 490274816 pending 32374784 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746144663.368200:0:14707:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1746144663.368224:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1830964747509504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000004:00080000:2.0:1746144663.368231:0:14755:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 62 done 00000100:00100000:1.0:1746144663.368232:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1746144663.368235:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746144663.368243:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3294:1830964747508864:0@lo:400:kworker.0 00000100:00100000:0.0:1746144663.369692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.369754:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746733824 00000100:00100000:1.0:1746144663.369762:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746733824 00000100:00100000:2.0:1746144663.369792:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747508608:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.369803:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747508736:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.369839:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144663.369897:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4091 00000100:00100000:1.0:1746144663.369903:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+37:29068:x1830964746733824:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746144663.369982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.370018:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734080 00000100:00100000:3.0:1746144663.370022:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734080 00000100:00100000:3.0:1746144663.370060:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4092 00000100:00100000:3.0:1746144663.370065:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:27209:x1830964746734080:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144663.370109:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+38:29068:x1830964746733824:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 206us (422us total) trans 8589944012 rc 0/0 00000100:00100000:1.0:1746144663.370116:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4091 00000100:00100000:3.0:1746144663.370156:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:27209:x1830964746734080:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 69us (153us total) trans 8589944013 rc 0/0 00000100:00100000:3.0:1746144663.370161:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4092 00000100:00100000:0.0:1746144663.371295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.371358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.371482:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734208 00000100:00100000:1.0:1746144663.371487:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734208 00010000:00010000:1.0:1746144663.371509:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 38 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.371540:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734336 00000100:00100000:1.0:1746144663.371542:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734336 00010000:00010000:1.0:1746144663.371550:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 320 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.371562:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5960 00000100:00100000:1.0:1746144663.371567:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+38:1962:x1830964746734208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.371577:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.371581:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 38 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.371590:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 38 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.371611:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f071c00/0xa7c849b16e01a98b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f15c expref: 38 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.371626:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.371630:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.371638:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.371643:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.371647:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.371661:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5961 00000100:00100000:0.0:1746144663.371673:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:1961:x1830964746734336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144663.371678:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:1962:x1830964746734208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.371684:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5960 00010000:00010000:0.0:1746144663.371686:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.371692:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 320 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.371704:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 320 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.371721:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01a968 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f140 expref: 320 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.374231:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.374241:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.374254:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.374261:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.374293:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144663.374310:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374317:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144663.374344:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:1961:x1830964746734336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2671us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.374353:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5961 00000004:00200000:2.0:1746144663.374361:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:2.0:1746144663.374365:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144663.374383:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374392:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374400:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374406:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374411:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374416:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff0800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.374420:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374425:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374435:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144663.374437:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.374440:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374444:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374477:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374482:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374490:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374493:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff1000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.374495:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374500:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374506:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8200) 00010000:00010000:2.0:1746144663.374509:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.374510:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374514:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.374552:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0000/0xa7c849b16e01aa41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.374564:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 17 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.374570:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.374571:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144663.374573:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1c00, rc 0) 00000100:00100000:2.0:1746144663.374602:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+17:29247:x1830964746733568:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 10129us (10397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.374609:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10118 00000100:00100000:0.0:1746144663.376549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.376642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.376683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.376711:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734592 00000100:00100000:2.0:1746144663.376720:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734592 00000100:00100000:3.0:1746144663.376725:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734464 00000100:00100000:3.0:1746144663.376728:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734464 00000100:00080000:3.0:1746144663.376773:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144663.376783:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734720 00000100:00100000:3.0:1746144663.376785:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734720 00000100:00100000:1.0:1746144663.376797:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11923 00000100:00100000:1.0:1746144663.376806:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746734592:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:3.0:1746144663.376807:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11924 00000100:00100000:3.0:1746144663.376811:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746734464:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:2.0:1746144663.376844:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11925 00000100:00100000:2.0:1746144663.376850:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746734720:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.376861:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.376877:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f219 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.376899:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.376901:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.376910:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.376923:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.376933:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62f400, rc 0) 00010000:00010000:3.0:1746144663.376964:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144663.376968:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746734720:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.376973:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11925 00010000:00010000:3.0:1746144663.376975:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51de00/0xa7c849b16e01aa64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f20b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.377014:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747509632:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144663.377046:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.377054:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e01aa6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f212 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.377070:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e01aa6b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f212 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.377078:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7fc00/0xa7c849b16e01aa6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f212 expref: 9 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.377087:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7fc00, rc 0) 00000100:00100000:1.0:1746144663.377104:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746734592:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 300us (563us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144663.377109:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11923 00000100:00100000:3.0:1746144663.377336:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b29c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746144663.377347:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1746144663.378967:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746144663 -> 1746144664 00002000:00010000:3.0:1746144663.378973:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime: 1746144663 -> 1746144664 00000100:00100000:3.0:1746144663.378994:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747509632:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144663.379022:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b51de00/0xa7c849b16e01aa64 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f20b expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.379033:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51de00/0xa7c849b16e01aa64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f20b expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.379053:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51de00, rc 0) 00000100:00100000:3.0:1746144663.379090:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1960:x1830964746734464:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2276us (2446us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144663.379097:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11924 00000100:00100000:0.0:1746144663.381335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.383520:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746734976 00000100:00100000:2.0:1746144663.383534:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746734976 00000100:00100000:2.0:1746144663.383609:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10119 00000100:00100000:2.0:1746144663.383617:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+17:29247:x1830964746734976:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.383640:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.383659:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f220 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.383764:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.383778:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.383784:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.383815:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.383826:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 18 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.383839:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747509760:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.383938:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.387323:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747509760:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.387365:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144663.387604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.387668:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746735104 00000100:00100000:2.0:1746144663.387676:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746735104 00010000:00010000:2.0:1746144663.387712:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 19 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.387737:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5962 00000100:00100000:2.0:1746144663.387743:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+19:1961:x1830964746735104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.387756:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.387761:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 19 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.387776:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 19 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.387796:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1c00/0xa7c849b16e01aa56 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f204 expref: 19 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.387826:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.387831:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.387841:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.387847:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.387877:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.387919:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+18:1961:x1830964746735104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 175us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.387925:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5962 00010000:00010000:3.0:1746144663.388005:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.388011:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144663.388043:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144663.388212:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1000/0xa7c849b16e01aa72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 19 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.388227:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.388233:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.388236:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144663.388238:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0800, rc 0) 00000100:00100000:3.0:1746144663.388276:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+18:29247:x1830964746734976:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4660us (6951us total) trans 8589944014 rc 0/0 00000100:00100000:3.0:1746144663.388283:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10119 00000100:00100000:0.0:1746144663.390944:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.391023:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746735232 00000100:00100000:3.0:1746144663.391045:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746735232 00000100:00100000:3.0:1746144663.391098:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10120 00000100:00100000:3.0:1746144663.391105:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+18:29247:x1830964746735232:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.391127:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.391162:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51d000/0xa7c849b16e01aa87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f227 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.391246:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.391259:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 19 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.391265:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.391295:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 19 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.391307:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 19 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.391318:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747509888:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.392830:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.396896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.397011:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747509888:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.397053:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144663.398026:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746735360 00000100:00100000:1.0:1746144663.398042:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746735360 00010000:00010000:1.0:1746144663.398075:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 20 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.398112:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5963 00000100:00100000:1.0:1746144663.398120:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+20:1961:x1830964746735360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.398148:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.398155:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 20 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.398167:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 20 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.398189:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff0800/0xa7c849b16e01aa79 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f220 expref: 20 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.398217:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.398222:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.398231:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.398238:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.398264:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144663.398310:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+19:1961:x1830964746735360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 190us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.398317:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5963 00010000:00010000:3.0:1746144663.398480:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.398487:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144663.398532:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:3.0:1746144663.398536:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144663.398552:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.398582:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51d000/0xa7c849b16e01aa87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f227 expref: 19 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.398595:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f227 expref: 18 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.398606:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.398608:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144663.398611:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51ca00, rc 0) 00000100:00100000:3.0:1746144663.398636:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+18:29247:x1830964746735232:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7532us (7703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.398643:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10120 00000100:00100000:0.0:1746144663.401213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.401257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.401376:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746735488 00000100:00100000:3.0:1746144663.401385:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746735488 00000100:00100000:3.0:1746144663.401430:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746735616 00000100:00100000:3.0:1746144663.401433:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746735616 00000100:00100000:3.0:1746144663.401448:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11926 00000100:00100000:3.0:1746144663.401454:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746735488:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.401472:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.401489:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01aa95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f22e expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.401549:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747510016:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144663.401620:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.401679:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11927 00000100:00100000:2.0:1746144663.401686:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746735616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.401693:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.401701:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01aa9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f235 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.401718:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01aa9c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f235 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.401862:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01aa9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f235 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.401877:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1a00, rc 0) 00000100:00100000:2.0:1746144663.401901:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746735616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 215us (643us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.401913:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11927 00000100:00100000:3.0:1746144663.403874:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747510016:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144663.403911:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01aa95 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f22e expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.403925:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53be800/0xa7c849b16e01aa95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f22e expref: 7 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.403940:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53be800, rc 0) 00000100:00100000:3.0:1746144663.403980:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746735488:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2524us (2775us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144663.403987:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11926 00000100:00100000:0.0:1746144663.406899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.406988:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746735872 00000100:00100000:3.0:1746144663.406995:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746735872 00000100:00100000:3.0:1746144663.407056:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10121 00000100:00100000:3.0:1746144663.407063:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+18:29247:x1830964746735872:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.407081:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.407097:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51de00/0xa7c849b16e01aaa3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f23c expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.407199:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01aaaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.407211:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01aaaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.407219:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01aaaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144663.407228:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144663.408824:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51de00/0xa7c849b16e01aaa3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f23c expref: 21 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.408843:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01aaaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f23c expref: 20 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.408856:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.408859:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144663.408862:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51c400, rc 0) 00000100:00100000:3.0:1746144663.408908:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+20:29247:x1830964746735872:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1846us (2017us total) trans 8589944015 rc 0/0 00000100:00100000:3.0:1746144663.408915:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10121 00000100:00100000:0.0:1746144663.414182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.414218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.414243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.414257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.414266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.414267:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736128 00000100:00100000:2.0:1746144663.414275:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736128 00000100:00100000:0.0:1746144663.414295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.414309:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736384 00000100:00100000:2.0:1746144663.414311:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736384 00000100:00100000:2.0:1746144663.414324:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736000 00000100:00100000:1.0:1746144663.414324:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736640 00000100:00100000:2.0:1746144663.414325:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736000 00000100:00100000:0.0:1746144663.414326:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736256 00000100:00100000:0.0:1746144663.414328:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736256 00000100:00100000:2.0:1746144663.414334:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736512 00000100:00100000:1.0:1746144663.414334:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736640 00000100:00100000:2.0:1746144663.414336:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736512 00000100:00100000:0.0:1746144663.414344:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11928 00000100:00100000:0.0:1746144663.414350:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746736128:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:2.0:1746144663.414355:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11929 00000100:00100000:2.0:1746144663.414360:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746736384:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:1.0:1746144663.414378:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11930 00010000:00010000:2.0:1746144663.414385:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414385:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.414386:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746736000:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144663.414400:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414400:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414406:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144663.414407:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.414408:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144663.414411:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414413:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.414418:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.414420:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.414421:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.414425:0:8388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414438:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414438:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.414439:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 41 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.414447:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 24 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.414448:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.414448:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 10 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.414454:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144663.414460:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747510272:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.414460:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747510144:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.414461:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.414463:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.414465:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.414495:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.414505:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 8 pid: 7257 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144663.414517:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747510400:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.414526:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.414534:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 20 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.414541:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747510528:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.414575:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.414595:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11931 00010000:00010000:1.0:1746144663.414600:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 24 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144663.414602:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746736256:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:1.0:1746144663.414609:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 24 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746144663.414616:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.414618:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747510656:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.414622:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414625:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414630:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.414632:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 10 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.414638:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 20 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144663.414638:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747510784:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.414643:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.414643:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 41 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414644:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.414646:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.414651:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 41 pid: 8450 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.414657:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a81f8240 going to sleep for 11 seconds 00010000:00010000:2.0:1746144663.414659:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 20 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144663.414659:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747510912:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.414667:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 20 pid: 8453 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.414671:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11932 00000100:00100000:2.0:1746144663.414674:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747511040:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.414676:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746736512:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:1.0:1746144663.414678:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c4180 going to sleep for 11 seconds 00010000:00010000:0.0:1746144663.414689:0:8389:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414697:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414698:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 10 pid: 30345 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144663.414699:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11933 00010000:00010000:2.0:1746144663.414705:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 10 pid: 30345 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.414705:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.414706:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746736640:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144663.414711:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 41 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.414712:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747511168:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.414715:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746144663.414716:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746144663.414718:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.414725:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414727:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414731:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 41 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.414733:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 19 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.414736:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414739:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 41 pid: 22208 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.414740:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747511296:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.414744:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144663.414747:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f270e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747511424:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.414749:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00010000:00010000:1.0:1746144663.414752:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.414757:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.414758:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.414761:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414764:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414771:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 24 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.414778:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144663.414779:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f271880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747511552:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.414786:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144663.414795:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747511680:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.414797:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.414804:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 24 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.414811:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f273480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747511808:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.414822:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144663.414825:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db34240 going to sleep for 11 seconds 00010000:00010000:1.0:1746144663.414835:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144663.414842:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747511936:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.414865:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.415092:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.415101:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747512064:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.415124:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a50c46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.417875:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747510144:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.417942:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b573b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747510400:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.418019:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747510272:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.418057:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.418479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.418511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.418528:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736768 00000100:00100000:0.0:1746144663.418533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.418535:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736768 00000100:00100000:1.0:1746144663.418549:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737024 00000100:00100000:1.0:1746144663.418551:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737024 00000100:00100000:3.0:1746144663.418555:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746736896 00000100:00100000:3.0:1746144663.418558:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746736896 00010000:00010000:3.0:1746144663.418576:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 9 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.418576:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 11 pid: 7257 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.418583:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747511680:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.418598:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5964 00000100:00100000:3.0:1746144663.418603:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5965 00000100:00100000:1.0:1746144663.418604:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746737024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144663.418608:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746736896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.418613:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.418613:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.418630:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 9 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.418630:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 11 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746144663.418638:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 9 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.418639:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 11 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746144663.418655:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01a651 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eef4 expref: 9 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.418655:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01a658 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eefb expref: 11 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:3.0:1746144663.418669:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.418677:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.418701:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746736896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.418701:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746737024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.418707:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5965 00000100:00100000:1.0:1746144663.418709:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5964 00000100:00100000:2.0:1746144663.418730:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f270e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747511424:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.418737:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f271880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747511552:192.168.204.23@tcp:104: 00002000:00100000:1.0:1746144663.418746:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1519616->2097151) req@ffff88009f271500 x1830964746736768/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.418754:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271500 with x1830964746736768 ext(1519616->2097151) 00010000:00010000:1.0:1746144663.418759:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 25 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.418767:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 25 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746144663.418773:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f271500 00000100:00100000:1.0:1746144663.418799:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 914 00000100:00100000:1.0:1746144663.418804:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746736768:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144663.419628:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747511936:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.424371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.424565:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737152 00000100:00100000:3.0:1746144663.424573:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737152 00010000:00010000:3.0:1746144663.424604:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.424628:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5966 00000100:00100000:3.0:1746144663.424634:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746737152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.424645:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.424663:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.424673:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.424691:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51c200/0xa7c849b16e01aa02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1c5 expref: 42 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.424704:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.424737:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746737152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.424743:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5966 00000100:00100000:0.0:1746144663.424991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.425004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.425029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.425096:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737280 00000100:00100000:1.0:1746144663.425100:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737280 00010000:00010000:1.0:1746144663.425117:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144663.425152:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737536 00000100:00100000:1.0:1746144663.425154:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737536 00010000:00010000:1.0:1746144663.425164:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 20 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.425177:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5967 00000100:00100000:1.0:1746144663.425182:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746737280:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.425190:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.425202:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.425210:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.425221:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f62f400/0xa7c849b16e01aa5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f219 expref: 10 pid: 8450 timeout: 742 lvb_type: 1 00010000:00010000:1.0:1746144663.425230:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144663.425249:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746737280:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.425255:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5967 00000100:00100000:1.0:1746144663.425265:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5968 00000100:00100000:1.0:1746144663.425269:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746737536:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.425277:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.425284:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 20 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.425291:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 20 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.425301:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144663.425313:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746737536:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 43us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.425318:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5968 00010000:00010000:1.0:1746144663.425349:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b765200/0xa7c849b16e01a9c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f186 expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.425357:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747512064:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.425379:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.425436:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737408 00000100:00100000:2.0:1746144663.425440:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737408 00002000:00100000:2.0:1746144663.425464:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2293759) req@ffff88009f271f80 x1830964746737408/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.425472:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271f80 with x1830964746737408 ext(2097152->2293759) 00010000:00010000:2.0:1746144663.425477:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.425485:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:2.0:1746144663.425491:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f271f80 00000100:00100000:2.0:1746144663.425502:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 915 00000100:00100000:2.0:1746144663.425507:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746737408:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144663.426026:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f273480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747511808:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.426055:0:8389:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.439447:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746736768:12345-192.168.204.23@tcp:4:cat.0 Request processed in 20634us (20961us total) trans 17179873271 rc 0/0 00000100:00100000:1.0:1746144663.439457:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 914 00002000:00100000:1.0:1746144663.439466:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1519616->2097151) req@ffff88009f271500 x1830964746736768/t17179873271(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.439474:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271500 with x1830964746736768 ext(1519616->2097151) 00010000:00010000:1.0:1746144663.439484:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 29 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.439496:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 29 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:1.0:1746144663.439502:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f271500 00000100:00100000:0.0:1746144663.440235:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747510528:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.440274:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cef9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747510784:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.440297:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.440348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.440360:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738432 00000100:00100000:0.0:1746144663.440365:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738432 00010000:00010000:0.0:1746144663.440386:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.440402:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5969 00000100:00100000:0.0:1746144663.440408:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746738432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.440417:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.440431:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.440438:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.440454:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e486200/0xa7c849b16e01a627 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eedf expref: 19 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.440469:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.440484:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746738432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.440490:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5969 00000100:00100000:0.0:1746144663.440546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.440557:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737792 00000100:00100000:0.0:1746144663.440559:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737792 00010000:00010000:0.0:1746144663.440569:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 29 pid: 22208 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.440582:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5970 00000100:00100000:0.0:1746144663.440586:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746737792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.440592:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.440601:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 29 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.440608:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 29 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.440620:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d200/0xa7c849b16e01aa09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1cc expref: 29 pid: 22208 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.440629:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.440644:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746737792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 57us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.440650:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5970 00000100:00100000:0.0:1746144663.440680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.440690:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737920 00000100:00100000:0.0:1746144663.440693:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737920 00010000:00010000:0.0:1746144663.440701:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 28 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.440715:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5971 00000100:00100000:0.0:1746144663.440719:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746737920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.440724:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.440733:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 28 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440740:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 28 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440748:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.440762:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746737920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 42us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.440767:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5971 00000100:00100000:0.0:1746144663.440794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.440802:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738176 00000100:00100000:0.0:1746144663.440804:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738176 00010000:00010000:0.0:1746144663.440813:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 21 pid: 8453 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.440825:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5972 00000100:00100000:0.0:1746144663.440829:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746738176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.440834:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.440841:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 21 pid: 8453 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440848:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 21 pid: 8453 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440862:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.440873:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746738176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 44us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.440878:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5972 00000100:00100000:0.0:1746144663.440903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.440912:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746737664 00000100:00100000:0.0:1746144663.440915:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746737664 00010000:00010000:0.0:1746144663.440923:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 21 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.440936:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5973 00000100:00100000:0.0:1746144663.440940:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746737664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.440945:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.440951:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 21 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440959:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 21 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440968:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f800/0xa7c849b16e01a6c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef48 expref: 21 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.440977:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.440978:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.440981:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.440993:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441009:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.441024:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746737664:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 83us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.441030:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5973 00010000:00010000:0.0:1746144663.441055:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441062:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441076:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441081:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441087:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441092:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1253e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144663.441095:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441104:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441112:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441117:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1253e00/0xa7c849b16e01aab8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.441172:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746736128:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 26821us (26997us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.441179:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11928 00000100:00100000:0.0:1746144663.441389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.441400:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738048 00000100:00100000:0.0:1746144663.441403:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738048 00010000:00010000:0.0:1746144663.441414:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.441424:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5974 00000100:00100000:0.0:1746144663.441428:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746738048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.441433:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.441442:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.441449:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.441459:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01a9e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f1a9 expref: 20 pid: 29370 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.441467:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.441468:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.441470:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441476:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441489:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.441503:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746738048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.441508:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5974 00010000:00010000:0.0:1746144663.441523:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441529:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441540:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441545:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441554:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441558:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e7f400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144663.441561:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441566:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441573:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441578:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f400/0xa7c849b16e01aadb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.441603:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746736640:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 26897us (27358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.441607:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11933 00000100:00100000:0.0:1746144663.441638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.441646:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738304 00000100:00100000:0.0:1746144663.441649:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738304 00010000:00010000:0.0:1746144663.441658:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:0.0:1746144663.441669:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5975 00000100:00100000:0.0:1746144663.441673:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746738304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.441679:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.441685:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.441692:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 7 pid: 30345 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.441702:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.441713:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746738304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.441717:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5975 00000100:00100000:0.0:1746144663.441749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.441756:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738560 00000100:00100000:0.0:1746144663.441759:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738560 00010000:00010000:0.0:1746144663.441766:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 41 pid: 8450 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.441776:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5976 00000100:00100000:0.0:1746144663.441779:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746738560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.441784:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.441790:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 41 pid: 8450 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.441798:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 41 pid: 8450 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.441811:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.441812:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.441815:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441821:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.441830:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.441843:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746738560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 63us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.441848:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5976 00010000:00010000:2.0:1746144663.441980:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c400/0xa7c849b16e01a86c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f08a expref: 18 pid: 8453 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144663.441996:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747511040:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.442010:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f323800/0xa7c849b16e01a914 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f108 expref: 6 pid: 30345 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144663.442018:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747511168:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.442027:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747511296:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.442068:0:30345:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.442108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.442121:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738688 00000100:00100000:2.0:1746144663.442124:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738688 00010000:00010000:2.0:1746144663.442152:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 18 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.443617:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01a6c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ef41 expref: 27 pid: 29370 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144663.443635:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b573800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747510656:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.443645:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094625200/0xa7c849b16e01a619 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eed1 expref: 40 pid: 8450 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.443652:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b573480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747510912:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.443678:0:8388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443688:0:8388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443693:0:8388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443715:0:8388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443722:0:8388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443728:0:8388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443733:0:8388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e7ec00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144663.443735:0:8388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443741:0:8388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443751:0:8388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.443756:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01aac6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.443802:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746736000:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 29417us (29543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.443808:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11930 00000100:00100000:2.0:1746144663.444318:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5977 00000100:00100000:2.0:1746144663.444327:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746738688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.444337:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.444354:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 18 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.444364:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 18 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.444376:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01a850 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f075 expref: 18 pid: 8453 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.444386:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.444387:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.444395:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444402:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444423:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.444440:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746738688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 115us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.444445:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5977 00010000:00010000:2.0:1746144663.444541:0:30345:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444548:0:30345:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444562:0:30345:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444567:0:30345:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444572:0:30345:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444576:0:30345:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53be800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144663.444583:0:30345:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444589:0:30345:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444597:0:30345:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.444601:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53be800/0xa7c849b16e01aacd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.444633:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746736256:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 30031us (30364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.444638:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11931 00000100:00100000:3.0:1746144663.445310:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746737408:12345-192.168.204.23@tcp:4:cat.0 Request processed in 19801us (20318us total) trans 17179873272 rc 0/0 00000100:00100000:3.0:1746144663.445318:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 915 00002000:00100000:3.0:1746144663.445325:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2293759) req@ffff88009f271f80 x1830964746737408/t17179873272(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.445333:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f271f80 with x1830964746737408 ext(2097152->2293759) 00010000:00010000:3.0:1746144663.445340:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.445349:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00002000:00010000:3.0:1746144663.445354:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f271f80 00000100:00100000:0.0:1746144663.448030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.448229:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738816 00000100:00100000:2.0:1746144663.448237:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738816 00010000:00010000:2.0:1746144663.448262:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.448284:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5978 00000100:00100000:2.0:1746144663.448290:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746738816:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.448300:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.448318:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.448328:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.448350:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764600/0xa7c849b16e01a9ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f18d expref: 27 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.448365:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.448366:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.448370:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.448377:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.448416:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.448441:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448450:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.448458:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746738816:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 167us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.448463:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5978 00010000:00010000:3.0:1746144663.448466:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448473:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448485:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448491:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff0000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144663.448494:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448501:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448510:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.448516:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff0000/0xa7c849b16e01aabf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.448568:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1961:x1830964746736384:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 34207us (34348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.448575:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11929 00000100:00100000:0.0:1746144663.454493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.454517:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746738944 00000100:00100000:0.0:1746144663.454523:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746738944 00010000:00010000:0.0:1746144663.454548:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 26 pid: 29370 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.454571:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5979 00000100:00100000:0.0:1746144663.454578:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746738944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.454589:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144663.454605:0:7100:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144663 -> 1746144664 00010000:00010000:0.0:1746144663.454610:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 26 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.454624:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 26 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.454643:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764000/0xa7c849b16e01a9d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2293759) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f194 expref: 26 pid: 29370 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.454669:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.454670:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.454674:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454681:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454698:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.454729:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746738944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 151us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.454735:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5979 00010000:00010000:0.0:1746144663.454832:0:8389:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454838:0:8389:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454854:0:8389:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454863:0:8389:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454870:0:8389:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454875:0:8389:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4efac00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144663.454879:0:8389:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454885:0:8389:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454894:0:8389:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.454899:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4efac00/0xa7c849b16e01aad4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.454940:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1961:x1830964746736512:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 40263us (40643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.454948:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11932 00000100:00100000:0.0:1746144663.457423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.457533:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746739200 00000100:00100000:2.0:1746144663.457540:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746739200 00000100:00100000:2.0:1746144663.457571:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10122 00000100:00100000:2.0:1746144663.457576:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+20:29247:x1830964746739200:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746144663.457614:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.457630:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51ca00/0xa7c849b16e01aa8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f227 expref: 20 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457652:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.457655:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144663.457681:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.457691:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 318 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457698:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 36 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457704:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457709:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 318 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457714:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 36 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457718:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.457741:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 36 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457749:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 36 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.457759:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512192:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.457825:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 318 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457835:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.457842:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512320:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.457858:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457864:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.457870:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512448:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.457883:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 36 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457888:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.457894:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512576:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.457906:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 318 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.457912:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 318 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.457918:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512704:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.457930:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40f8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.460833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.460862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.460885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.460904:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746739840 00000100:00100000:0.0:1746144663.460910:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746739840 00010000:00010000:0.0:1746144663.460936:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 37 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.460956:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746739456 00000100:00100000:0.0:1746144663.460957:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746739456 00010000:00010000:0.0:1746144663.460967:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 319 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.460981:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5980 00000100:00100000:0.0:1746144663.460988:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+37:1962:x1830964746739840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.460998:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.461003:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 37 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461012:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 37 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461029:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.461043:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.461052:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.461081:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+37:1962:x1830964746739840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.461087:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5980 00000100:00100000:0.0:1746144663.461100:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5981 00000100:00100000:0.0:1746144663.461105:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:1961:x1830964746739456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.461111:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.461115:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 319 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461122:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 319 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461132:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.461154:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.461159:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.461171:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:1961:x1830964746739456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 66us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.461176:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5981 00000100:00100000:0.0:1746144663.461200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.461212:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746739328 00000100:00100000:0.0:1746144663.461214:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746739328 00010000:00010000:0.0:1746144663.461223:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 37 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.461234:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5982 00000100:00100000:0.0:1746144663.461238:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+37:1961:x1830964746739328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.461244:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.461247:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 37 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461254:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 37 pid: 15388 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461263:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.461266:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.461271:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.461281:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+37:1961:x1830964746739328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 43us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.461287:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5982 00000100:00100000:0.0:1746144663.461337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.461346:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746739968 00000100:00100000:0.0:1746144663.461348:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746739968 00010000:00010000:0.0:1746144663.461357:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 319 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.461368:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5983 00000100:00100000:0.0:1746144663.461372:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:1961:x1830964746739968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.461377:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.461380:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 319 pid: 14710 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461387:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 319 pid: 14710 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.461395:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.461398:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.461403:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.461414:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+319:1961:x1830964746739968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 41us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.461419:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5983 00000100:00100000:1.0:1746144663.461568:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746739712 00000100:00100000:1.0:1746144663.461572:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746739712 00000100:00100000:1.0:1746144663.461593:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4093 00000100:00100000:1.0:1746144663.461598:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+37:12354:x1830964746739712:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144663.461757:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+38:12354:x1830964746739712:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 159us (931us total) trans 8589944016 rc 0/0 00000100:00100000:1.0:1746144663.461766:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4093 00010000:00010000:2.0:1746144663.461844:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e46ec00/0xa7c849b16e01a364 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ed0a expref: 37 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.461855:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512192:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.461865:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf5e400/0xa7c849b16e01a253 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ec69 expref: 318 pid: 15388 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.461873:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512320:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.461881:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512448:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.461888:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f70b200/0xa7c849b16e01a05b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb2e expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.461895:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512576:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.461906:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ca3b800/0xa7c849b16e01a054 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152eb27 expref: 317 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.461915:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747512704:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.461948:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144663.465670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.465762:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740096 00000100:00100000:3.0:1746144663.465772:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740096 00010000:00010000:3.0:1746144663.465810:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.465858:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5984 00000100:00100000:3.0:1746144663.465865:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+36:1961:x1830964746740096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.465878:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.465883:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.465894:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.465911:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bbc00/0xa7c849b16e01a19d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ebf2 expref: 36 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.465944:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.465949:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.465957:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.465963:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.465982:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.466489:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746740096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 624us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.466496:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5984 00010000:00010000:2.0:1746144663.466584:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.466590:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000040:00080000:2.0:1746144663.467124:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2921, 88 off243992 00000004:00080000:2.0:1746144663.467131:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642675996034ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467204:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2840, 88 off236856 00000004:00080000:2.0:1746144663.467209:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676074127ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467239:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2841, 88 off236944 00000004:00080000:2.0:1746144663.467242:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676107362ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467252:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2922, 88 off244080 00000004:00080000:2.0:1746144663.467255:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676120099ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467263:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2923, 88 off244168 00000004:00080000:2.0:1746144663.467266:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676131307ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467274:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2842, 88 off237032 00000004:00080000:2.0:1746144663.467276:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676141995ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467285:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2843, 88 off237120 00000004:00080000:2.0:1746144663.467287:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676153004ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467296:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2844, 88 off237208 00000004:00080000:2.0:1746144663.467299:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676164259ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467307:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2924, 88 off244256 00000004:00080000:2.0:1746144663.467310:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676175230ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467318:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2845, 88 off237296 00000004:00080000:2.0:1746144663.467321:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676186217ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467329:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2925, 88 off244344 00000004:00080000:2.0:1746144663.467331:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676196989ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467340:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2846, 88 off237384 00000004:00080000:2.0:1746144663.467342:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676207637ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.467350:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2926, 88 off244432 00000004:00080000:2.0:1746144663.467353:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676218182ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467361:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2927, 88 off244520 00000004:00080000:2.0:1746144663.467364:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676229335ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467373:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2928, 88 off244608 00000004:00080000:2.0:1746144663.467375:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676240759ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467384:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2929, 88 off244696 00000004:00080000:2.0:1746144663.467386:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642676251655ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.467395:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2847, 88 off237472 00000004:00080000:2.0:1746144663.467397:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642676262329ns, next at 593480289301ns, rc = 0 00000004:00010000:3.0:1746144663.494065:0:14709:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f272680 reply state ffff88009f284400 transno 8589944017 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144663.494081:0:14709:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746144663.494230:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+21:29247:x1830964746739200:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 36647us (36807us total) trans 8589944017 rc 0/0 00000100:00100000:3.0:1746144663.494243:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10122 00000001:00080000:1.0:1746144663.496917:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943981 is committed 00000001:00080000:1.0:1746144663.496934:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943980 is committed 00000001:00080000:1.0:1746144663.496947:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944016 is committed 00000001:00080000:1.0:1746144663.496959:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943994 is committed 00000001:00080000:1.0:1746144663.496995:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944017 is committed 00000004:00080000:1.0:1746144663.496999:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746144663.497004:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2111 committed 00000004:00080000:1.0:1746144663.497010:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2110 committed 00000004:00080000:1.0:1746144663.497012:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2109 committed 00000004:00080000:1.0:1746144663.497014:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2108 committed 00000004:00080000:1.0:1746144663.497015:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2032 committed 00000004:00080000:1.0:1746144663.497016:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2107 committed 00000004:00080000:1.0:1746144663.497018:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2031 committed 00000004:00080000:1.0:1746144663.497019:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2106 committed 00000004:00080000:1.0:1746144663.497020:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746144663.497022:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746144663.497163:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746144663.497165:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2105 committed 00000004:00080000:1.0:1746144663.497166:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2104 committed 00000004:00080000:1.0:1746144663.497168:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746144663.497169:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746144663.497171:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2103 committed 00000001:00080000:1.0:1746144663.497188:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944010 is committed 00000001:00080000:1.0:1746144663.497249:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944013 is committed 00010000:00010000:2.0:1746144663.501271:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.501286:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.501294:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.501300:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eef1c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.501305:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.501312:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.501330:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.501333:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.501337:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.501342:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eef1c00/0xa7c849b16e01aae2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144663.502188:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747512960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502243:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502278:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746144663.502283:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747512832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.502302:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502326:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747512960 00000100:00100000:1.0:1746144663.502332:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747512960 00000100:00100000:1.0:1746144663.502367:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747512832 00000100:00100000:1.0:1746144663.502369:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747512832 00000100:00100000:1.0:1746144663.502385:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11934 00000100:00100000:1.0:1746144663.502393:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3296:x1830964747512960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.502556:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11935 00000100:00100000:3.0:1746144663.502560:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502562:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3296:x1830964747512832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.502584:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502599:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3296:x1830964747512960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (355us total) trans 17179873273 rc 0/0 00000100:00100000:3.0:1746144663.502603:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502606:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11934 00000100:00100000:3.0:1746144663.502617:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502618:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513344 00000100:00100000:1.0:1746144663.502620:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513344 00000100:00100000:3.0:1746144663.502627:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747514368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502632:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513856 00000100:00100000:1.0:1746144663.502634:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513856 00000100:00100000:3.0:1746144663.502639:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502645:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514368 00000100:00100000:1.0:1746144663.502646:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514368 00000100:00100000:3.0:1746144663.502651:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1746144663.502655:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502657:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11936 00000100:00100000:1.0:1746144663.502662:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3295:x1830964747513344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.502669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.502677:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3296:x1830964747512832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (374us total) trans 21474840510 rc 0/0 00000100:00100000:3.0:1746144663.502680:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502683:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11935 00000100:00100000:3.0:1746144663.502694:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.502695:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513472 00000100:00100000:2.0:1746144663.502697:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513472 00000100:00100000:3.0:1746144663.502705:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747514496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502706:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513984 00000100:00100000:2.0:1746144663.502708:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513984 00000100:00100000:2.0:1746144663.502715:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11937 00000100:00100000:2.0:1746144663.502718:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3295:x1830964747513856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502743:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3295:x1830964747513344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (158us total) trans 21474840511 rc 0/0 00000100:00100000:1.0:1746144663.502748:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11936 00000100:00100000:1.0:1746144663.502756:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11938 00000100:00100000:1.0:1746144663.502760:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3295:x1830964747514368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.502776:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502784:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514496 00000100:00100000:1.0:1746144663.502787:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514496 00000100:00100000:1.0:1746144663.502797:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11939 00000004:00080000:3.0:1746144663.502801:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287a680/2, rc 0, transno 21474840511 00000100:00100000:1.0:1746144663.502802:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747513472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.502805:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.502819:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502829:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747513856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (211us total) trans 17179873274 rc 0/0 00000100:00100000:2.0:1746144663.502834:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11937 00000100:00100000:3.0:1746144663.502838:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.502842:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513216 00000100:00100000:3.0:1746144663.502845:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502845:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513216 00000100:00100000:2.0:1746144663.502855:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11940 00000100:00100000:3.0:1746144663.502857:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.502859:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747513984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.502863:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.502878:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502881:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3295:x1830964747513472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (210us total) trans 17179873275 rc 0/0 00000100:00100000:3.0:1746144663.502884:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502887:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11939 00000100:00100000:1.0:1746144663.502899:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513728 00000100:00100000:3.0:1746144663.502900:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502901:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513728 00000100:00100000:3.0:1746144663.502908:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746144663.502909:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514240 00000100:00100000:1.0:1746144663.502911:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514240 00000100:00100000:3.0:1746144663.502912:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.502917:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514752 00000100:00100000:1.0:1746144663.502918:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514752 00000100:00100000:1.0:1746144663.502925:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11941 00000100:00100000:3.0:1746144663.502928:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.502929:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747514496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502934:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747513984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (239us total) trans 21474840512 rc 0/0 00000100:00100000:3.0:1746144663.502936:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.502939:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11940 00000100:00100000:2.0:1746144663.502947:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513088 00000100:00100000:3.0:1746144663.502949:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.502949:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513088 00000100:00100000:3.0:1746144663.502956:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.502956:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747513600 00000100:00100000:2.0:1746144663.502957:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747513600 00000100:00100000:2.0:1746144663.502964:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11942 00000100:00100000:2.0:1746144663.502968:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747513216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.502969:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.502975:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.502987:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.503001:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514112 00000100:00100000:1.0:1746144663.503003:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747514496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (226us total) trans 21474840513 rc 0/0 00000100:00100000:3.0:1746144663.503004:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514112 00000100:00100000:1.0:1746144663.503007:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11941 00000100:00100000:1.0:1746144663.503015:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514624 00000100:00100000:1.0:1746144663.503017:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514624 00000100:00100000:3.0:1746144663.503018:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11943 00000100:00100000:3.0:1746144663.503023:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747513728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.503027:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11944 00000100:00100000:1.0:1746144663.503031:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747514240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.503053:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747513216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (215us total) trans 21474840514 rc 0/0 00000100:00100000:2.0:1746144663.503060:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11942 00000100:00100000:2.0:1746144663.503069:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11945 00000100:00100000:2.0:1746144663.503073:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747514752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.503105:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11946 00000100:00100000:1.0:1746144663.503110:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747513088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.503131:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747513728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (272us total) trans 21474840515 rc 0/0 00000100:00100000:3.0:1746144663.503150:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11943 00000100:00100000:3.0:1746144663.503160:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11947 00000100:00100000:3.0:1746144663.503163:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747513600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.503165:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11948 00000100:00100000:1.0:1746144663.503171:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747514112:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.503210:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287b800/2, rc 0, transno 21474840510 00000100:00100000:1.0:1746144663.503214:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747512832:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144663.503225:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1746144663.503226:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32c000/2, rc 0, transno 17179873273 00002000:00010000:3.0:1746144663.503227:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144663.503230:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144663.503231:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00000100:00100000:1.0:1746144663.503232:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747512960:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746144663.503233:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144663.503247:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747513600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (298us total) trans 21474840517 rc 0/0 00000100:00100000:3.0:1746144663.503252:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11947 00000100:00100000:3.0:1746144663.503261:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11949 00000100:00100000:3.0:1746144663.503265:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747514624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.503271:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747514240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (391us total) trans 21474840516 rc 0/0 00000100:00100000:1.0:1746144663.503276:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11944 00000004:00080000:3.0:1746144663.503311:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092878700/2, rc 0, transno 21474840517 00000100:00100000:1.0:1746144663.503314:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746144663.503315:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.503320:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747514880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144663.503321:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092879f80/2, rc 0, transno 21474840514 00000100:00100000:3.0:1746144663.503323:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.503328:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092878e00/2, rc 0, transno 21474840515 00000100:00100000:3.0:1746144663.503331:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.503335:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287bb80/2, rc 0, transno 21474840516 00000100:00100000:3.0:1746144663.503338:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.503338:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746144663.503348:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32d880/2, rc 0, transno 17179873275 00000100:00100000:3.0:1746144663.503350:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.503354:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747514880 00000004:00080000:3.0:1746144663.503355:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287b480/2, rc 0, transno 21474840512 00000100:00100000:1.0:1746144663.503356:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747514880 00000100:00100000:3.0:1746144663.503357:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.503361:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287ad80/2, rc 0, transno 21474840513 00000100:00100000:3.0:1746144663.503364:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747514496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.503368:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32ed80/2, rc 0, transno 17179873274 00000100:00100000:3.0:1746144663.503371:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747513856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.503371:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11950 00000100:00100000:1.0:1746144663.503375:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3296:x1830964747514880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.504027:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3294:x1830964747514752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 952us (1124us total) trans 17179873276 rc 0/0 00000100:00100000:1.0:1746144663.504027:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3294:x1830964747513088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 916us (1097us total) trans 17179873277 rc 0/0 00000100:00100000:1.0:1746144663.504044:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11946 00000100:00100000:2.0:1746144663.504050:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11945 00000004:00080000:3.0:1746144663.504057:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32f800/2, rc 0, transno 17179873277 00000100:00100000:3.0:1746144663.504061:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747513088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144663.504069:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32dc00/2, rc 0, transno 17179873276 00000100:00100000:3.0:1746144663.504072:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.504120:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747514112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 949us (1149us total) trans 17179873278 rc 0/0 00000100:00100000:1.0:1746144663.504124:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11948 00000004:00080000:2.0:1746144663.504131:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32c700/2, rc 0, transno 17179873278 00000100:00100000:2.0:1746144663.504147:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.504174:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747514624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 908us (1186us total) trans 17179873279 rc 0/0 00000100:00100000:3.0:1746144663.504179:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11949 00000004:00080000:2.0:1746144663.504182:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32f100/2, rc 0, transno 17179873279 00000100:00100000:2.0:1746144663.504185:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747514624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.504227:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747514368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1466us (1586us total) trans 17179873280 rc 0/0 00000100:00100000:1.0:1746144663.504232:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11938 00000004:00080000:3.0:1746144663.504253:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32c380/2, rc 0, transno 17179873280 00000100:00100000:3.0:1746144663.504257:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747514368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.504309:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830964747514880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 933us (970us total) trans 17179873281 rc 0/0 00000100:00100000:1.0:1746144663.504315:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11950 00000100:00100000:1.0:1746144663.504684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.504723:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740224 00000100:00100000:3.0:1746144663.504727:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740224 00000100:00100000:3.0:1746144663.504751:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10123 00000100:00100000:3.0:1746144663.504756:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29247:x1830964746740224:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.504771:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.504786:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f243 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.504832:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.504843:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.504857:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.504860:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144663.504862:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b765200, rc 0) 00000100:00100000:3.0:1746144663.504892:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29247:x1830964746740224:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 136us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.504898:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10123 00000004:00080000:2.0:1746144663.504903:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b573b80/2, rc 0, transno 17179873281 00000100:00100000:2.0:1746144663.504907:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747514880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.507587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.508023:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740352 00000100:00100000:3.0:1746144663.508042:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740352 00000100:00100000:3.0:1746144663.508089:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10124 00000100:00100000:3.0:1746144663.508096:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29247:x1830964746740352:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.508113:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.508131:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aaf0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f24a expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.508236:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01aaf7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.508249:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01aaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.508260:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01aaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144663.508287:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:3.0:1746144663.508291:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144663.508304:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01aaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.508325:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aaf0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f24a expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.508353:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01aaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f24a expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.508360:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.508362:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144663.508365:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344000, rc 0) 00000100:00100000:3.0:1746144663.508409:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29247:x1830964746740352:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 312us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.508416:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10124 00000100:00100000:0.0:1746144663.510877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.510913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.510939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.510951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.510962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.511048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.511105:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740608 00000100:00100000:2.0:1746144663.511112:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740608 00000100:00100000:1.0:1746144663.511163:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740864 00000100:00100000:1.0:1746144663.511167:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740864 00000100:00100000:1.0:1746144663.511198:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746741120 00000100:00100000:2.0:1746144663.511200:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740480 00000100:00100000:1.0:1746144663.511200:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746741120 00000100:00100000:2.0:1746144663.511202:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740480 00000100:00100000:1.0:1746144663.511211:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740736 00000100:00100000:1.0:1746144663.511212:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740736 00000100:00100000:2.0:1746144663.511215:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746740992 00000100:00100000:2.0:1746144663.511216:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746740992 00000100:00100000:1.0:1746144663.511227:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11951 00000100:00100000:1.0:1746144663.511233:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746740608:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144663.511247:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.511266:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f258 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144663.511292:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d96, atime: 0x68140d96, ctime: 0x68140d95, blocks: 0x821 00010000:00010000:1.0:1746144663.511310:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.511312:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.511326:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.511342:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.511351:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864600, rc 0) 00000100:00100000:1.0:1746144663.511388:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746740608:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 155us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.511498:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11952 00000100:00100000:2.0:1746144663.511505:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746740864:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.511511:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.511523:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f266 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144663.511538:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d97, blocks: 0x81d 00010000:00010000:2.0:1746144663.511547:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511548:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511553:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 8 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511562:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 8 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511567:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1a00, rc 0) 00000100:00100000:2.0:1746144663.511582:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746740864:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 79us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.511587:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11952 00000100:00100000:2.0:1746144663.511600:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11953 00000100:00100000:2.0:1746144663.511603:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746741120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.511608:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.511616:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f274 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144663.511626:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d97, atime: 0x68140d97, ctime: 0x68140d97, blocks: 0x1029 00010000:00010000:2.0:1746144663.511634:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511635:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511638:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511646:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511656:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0600, rc 0) 00000100:00100000:2.0:1746144663.511665:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746741120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 62us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.511670:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11953 00000100:00100000:2.0:1746144663.511677:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11954 00000100:00100000:2.0:1746144663.511680:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746740480:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.511684:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.511690:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f251 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144663.511698:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d96, atime: 0x68140d96, ctime: 0x68140d95, blocks: 0x805 00010000:00010000:2.0:1746144663.511704:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511705:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511708:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 8 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511715:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 8 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511720:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1800, rc 0) 00000100:00100000:2.0:1746144663.511728:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746740480:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 48us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.511732:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11954 00000100:00100000:2.0:1746144663.511744:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11955 00000100:00100000:2.0:1746144663.511747:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746740736:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.511752:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.511758:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f25f expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144663.511767:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d97, atime: 0x68140d95, ctime: 0x68140d97, blocks: 0x821 00010000:00010000:2.0:1746144663.511772:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.511773:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144663.511775:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11956 00010000:00010000:2.0:1746144663.511776:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.511783:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144663.511784:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746740992:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.511788:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff0800, rc 0) 00010000:00010000:3.0:1746144663.511790:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144663.511798:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746740736:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 51us (835us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144663.511800:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f26d expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.511803:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11955 00002000:00010000:3.0:1746144663.511813:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x15ef 00010000:00010000:3.0:1746144663.511821:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.511823:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.511828:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.511837:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 8 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.511844:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5345600, rc 0) 00000100:00100000:1.0:1746144663.511844:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11951 00000100:00100000:3.0:1746144663.511863:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746740992:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 82us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.511868:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11956 00000100:00100000:0.0:1746144663.518407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.518482:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746741376 00000100:00100000:3.0:1746144663.518492:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746741376 00000100:00100000:3.0:1746144663.518561:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4597 00000100:00100000:3.0:1746144663.518568:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746741376:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144663.518607:0:31508:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.518622:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.518624:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.518629:0:31508:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.518643:0:31508:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.524093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.524164:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746741632 00000100:00100000:1.0:1746144663.524174:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746741632 00000100:00100000:0.0:1746144663.524194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.524243:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746741888 00000100:00100000:1.0:1746144663.524246:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746741888 00000100:00100000:1.0:1746144663.524282:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4598 00000100:00100000:1.0:1746144663.524291:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746741632:12345-192.168.204.23@tcp:3:lfs.0 00000100:00100000:2.0:1746144663.524318:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4599 00000100:00100000:2.0:1746144663.524327:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746741888:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144663.524332:0:1570:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.524346:0:31506:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.524354:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.524355:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.524356:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.524357:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.524361:0:31506:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.524361:0:1570:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.524374:0:1570:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.524375:0:31506:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.529955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.529992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.530015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.530028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.530052:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746742144 00000100:00100000:1.0:1746144663.530061:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746742144 00000100:00100000:2.0:1746144663.530086:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746742400 00000100:00100000:2.0:1746144663.530089:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746742400 00000100:00100000:2.0:1746144663.530116:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746742656 00000100:00100000:2.0:1746144663.530117:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746742656 00000100:00100000:1.0:1746144663.530125:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746742912 00000100:00100000:1.0:1746144663.530128:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746742912 00000100:00100000:2.0:1746144663.530148:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4600 00000100:00100000:2.0:1746144663.530155:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746742400:12345-192.168.204.23@tcp:3:lfs.0 00000100:00100000:1.0:1746144663.530163:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4601 00000100:00100000:1.0:1746144663.530169:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746742144:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:2.0:1746144663.530191:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.530191:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.530204:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.530204:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.530205:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.530205:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.530210:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.530210:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.530221:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.530221:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.530762:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4602 00000100:00100000:0.0:1746144663.530770:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746742656:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144663.530789:0:31505:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.530797:0:31505:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.530798:0:31505:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.530801:0:31505:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.530810:0:31505:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.531417:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4603 00000100:00100000:1.0:1746144663.531423:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746742912:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144663.531440:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.531446:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.531447:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.531450:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.531457:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532080:0:31508:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532089:0:31508:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532099:0:31508:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532105:0:31508:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b765e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144663.532109:0:31508:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532116:0:31508:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532130:0:31508:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532150:0:31508:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01ab28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.532192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.532200:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746741376:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 13632us (13802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.532206:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4597 00000100:00100000:2.0:1746144663.532229:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746743168 00000100:00100000:2.0:1746144663.532233:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746743168 00000100:00100000:2.0:1746144663.532259:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4604 00000100:00100000:2.0:1746144663.532264:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746743168:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:2.0:1746144663.532279:0:31508:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532286:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.532288:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.532291:0:31508:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.532301:0:31508:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534050:0:1570:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534063:0:1570:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534070:0:1570:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534075:0:1570:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f025000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144663.534078:0:1570:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534083:0:1570:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534095:0:1570:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.534105:0:1570:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f025000/0xa7c849b16e01ab2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.534177:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746741632:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 9885us (10095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.534184:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4598 00010000:00010000:3.0:1746144663.536227:0:31506:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.536249:0:31506:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.536258:0:31506:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.536266:0:31506:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff1000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144663.536270:0:31506:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.536278:0:31506:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.536296:0:31506:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.536301:0:31506:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff1000/0xa7c849b16e01ab36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.536928:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746741888:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 12595us (12727us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144663.536939:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4599 00010000:00010000:1.0:1746144663.541294:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.541314:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.541323:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.541330:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed69400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144663.541335:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.541343:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.541363:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.541370:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed69400/0xa7c849b16e01ab44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.541471:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746742144:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 11294us (11521us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.541482:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4601 00010000:00010000:3.0:1746144663.546565:0:8457:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.546587:0:8457:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.546596:0:8457:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.546604:0:8457:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff1c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144663.546609:0:8457:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.546617:0:8457:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.546639:0:8457:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.546646:0:8457:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1c00/0xa7c849b16e01ab3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.546741:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746742400:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 16579us (16740us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144663.546756:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4600 00010000:00010000:2.0:1746144663.549522:0:31505:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.549542:0:31505:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.549551:0:31505:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.549557:0:31505:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7f8400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144663.549562:0:31505:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.549569:0:31505:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.549586:0:31505:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.549592:0:31505:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01ab4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.550337:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746742656:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 19562us (20315us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.550350:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4602 00010000:00010000:1.0:1746144663.555007:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.555027:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.555045:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.555053:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed69c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144663.555057:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.555064:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.555082:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.555087:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xa7c849b16e01ab52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.556407:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746742912:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 24977us (26369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.556422:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4603 00010000:00010000:2.0:1746144663.556701:0:31508:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.556711:0:31508:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.556718:0:31508:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.556724:0:31508:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c320800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144663.556727:0:31508:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.556734:0:31508:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.556747:0:31508:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.556752:0:31508:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c320800/0xa7c849b16e01ab59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.557001:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746743168:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 24735us (24809us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.557007:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4604 00000100:00100000:0.0:1746144663.560916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.561022:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746743424 00000100:00100000:3.0:1746144663.561039:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746743424 00000100:00100000:3.0:1746144663.561088:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10125 00000100:00100000:3.0:1746144663.561096:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29247:x1830964746743424:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:3.0:1746144663.561187:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.561218:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01aaf7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f24a expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.561245:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.561250:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.561295:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.561307:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.561316:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00010000:3.0:1746144663.561506:0:14709:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012cefbb80 reply state ffff88009fbfd000 transno 8589944018 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144663.561512:0:14709:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746144663.561599:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29247:x1830964746743424:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 502us (692us total) trans 8589944018 rc 0/0 00000100:00100000:3.0:1746144663.561606:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10125 00010000:00010000:2.0:1746144663.562539:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.562549:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.562555:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.562561:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b765e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.562565:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.562571:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.562580:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.562583:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.562585:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.562590:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765e00/0xa7c849b16e01ab60 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144663.562912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.562939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.562967:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746743552 00000100:00100000:0.0:1746144663.562970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.562973:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746743552 00000100:00100000:0.0:1746144663.562994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.563002:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746743808 00000100:00100000:3.0:1746144663.563004:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746743808 00000100:00100000:0.0:1746144663.563009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.563028:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.563318:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746744064 00000100:00100000:3.0:1746144663.563321:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746744064 00000100:00100000:2.0:1746144663.563325:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746743680 00000100:00100000:2.0:1746144663.563328:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746743680 00000100:00100000:0.0:1746144663.563330:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746743936 00000100:00100000:3.0:1746144663.563334:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746744192 00000100:00100000:0.0:1746144663.563335:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746743936 00000100:00100000:3.0:1746144663.563336:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746744192 00000100:00100000:2.0:1746144663.563347:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11957 00000100:00100000:3.0:1746144663.563351:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11958 00000100:00100000:2.0:1746144663.563352:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746743552:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:3.0:1746144663.563355:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746743808:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:0.0:1746144663.563365:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11959 00000100:00100000:0.0:1746144663.563371:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746744064:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:2.0:1746144663.563422:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11960 00000100:00100000:2.0:1746144663.563427:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746743680:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:2.0:1746144663.563486:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11961 00000100:00100000:2.0:1746144663.563490:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746744192:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:3.0:1746144663.563498:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144663.563498:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:3.0:1746144663.563501:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144663 -> 1746144664 00002000:00010000:0.0:1746144663.563501:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.563503:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144661 -> 1746144664 00002000:00010000:0.0:1746144663.563503:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.563505:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144663 -> 1746144664 00002000:00010000:0.0:1746144663.563505:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.563506:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746144663.563507:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:3.0:1746144663.563536:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746743808:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 180us (596us total) trans 21474840518 rc 0/0 00000100:00100000:3.0:1746144663.563542:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11958 00000100:00100000:3.0:1746144663.563555:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11962 00000100:00100000:3.0:1746144663.563559:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746743936:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:0.0:1746144663.563602:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746744064:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 230us (630us total) trans 17179873282 rc 0/0 00000100:00100000:0.0:1746144663.563609:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11959 00002000:00010000:3.0:1746144663.563618:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144663.563621:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.563623:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.563624:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144663 -> 1746144664 00002000:00010000:3.0:1746144663.563626:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:2.0:1746144663.563626:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746144663.563628:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144663 -> 1746144664 00002000:00010000:2.0:1746144663.563630:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144663 -> 1746144664 00002000:00010000:2.0:1746144663.563632:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144663 -> 1746144664 00002000:00010000:2.0:1746144663.563633:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746144663.563643:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746743936:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 83us (632us total) trans 17179873283 rc 0/0 00000100:00100000:3.0:1746144663.563650:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11962 00000100:00100000:2.0:1746144663.563651:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746744192:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 161us (622us total) trans 21474840520 rc 0/0 00000100:00100000:2.0:1746144663.563656:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11961 00002000:00010000:2.0:1746144663.563674:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144663.563676:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144662 -> 1746144664 00002000:00010000:2.0:1746144663.563678:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144662 -> 1746144664 00002000:00010000:2.0:1746144663.563680:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144661 -> 1746144664 00002000:00010000:2.0:1746144663.563681:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144663.563695:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746743680:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 268us (700us total) trans 21474840519 rc 0/0 00000100:00100000:2.0:1746144663.563700:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11960 00002000:00010000:2.0:1746144663.563745:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746144663.563747:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144662 -> 1746144664 00002000:00010000:2.0:1746144663.563748:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144662 -> 1746144664 00002000:00010000:2.0:1746144663.563750:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144661 -> 1746144664 00002000:00010000:2.0:1746144663.563751:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:2.0:1746144663.563765:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746743552:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 414us (857us total) trans 17179873284 rc 0/0 00000100:00100000:2.0:1746144663.563768:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11957 00000100:00100000:0.0:1746144663.565619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.565696:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746744448 00000100:00100000:3.0:1746144663.565703:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746744448 00000100:00100000:3.0:1746144663.565911:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4094 00000100:00100000:3.0:1746144663.565918:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29247:x1830964746744448:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:3.0:1746144663.565979:0:16907:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01aaaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f23c expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.566017:0:16907:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16907 initiator: MDT0 00010000:00010000:3.0:1746144663.566028:0:16907:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.566044:0:16907:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16907 initiator: MDT0 00010000:00010000:3.0:1746144663.566072:0:16907:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.566084:0:16907:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 9 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.566096:0:16907:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16907:1830964747515008:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.566504:0:16907:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.568905:0:16907:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:16907:1830964747515008:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.568937:0:16907:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16907 initiator: MDT0 00000100:00100000:0.0:1746144663.569406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.569568:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746744576 00000100:00100000:2.0:1746144663.569576:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746744576 00010000:00010000:2.0:1746144663.569611:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.569647:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5985 00000100:00100000:2.0:1746144663.569655:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746744576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.569670:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.569675:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.569686:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.569706:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01aae9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f243 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.569724:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.569729:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16907 initiator: MDT0 00010000:00010000:2.0:1746144663.569737:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16907 initiator: MDT0 00010000:00010000:2.0:1746144663.569744:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16907 initiator: MDT0 00010000:00010000:2.0:1746144663.569773:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.569829:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746744576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 175us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.569836:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5985 00010000:00010000:0.0:1746144663.569896:0:16907:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16907 initiator: MDT0 00010000:00010000:0.0:1746144663.569902:0:16907:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16907 initiator: MDT0 00000040:00080000:0.0:1746144663.570568:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2930, 88 off244784 00000004:00080000:0.0:1746144663.570575:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779439940ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570651:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2849, 88 off237656 00000004:00080000:0.0:1746144663.570655:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779520097ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570674:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2850, 88 off237744 00000004:00080000:0.0:1746144663.570677:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779542662ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570683:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2931, 88 off244872 00000004:00080000:0.0:1746144663.570686:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779551227ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570691:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2932, 88 off244960 00000004:00080000:0.0:1746144663.570693:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779558724ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570698:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2851, 88 off237832 00000004:00080000:0.0:1746144663.570700:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779565677ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570705:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2852, 88 off237920 00000004:00080000:0.0:1746144663.570707:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779572220ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570711:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2853, 88 off238008 00000004:00080000:0.0:1746144663.570713:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779578632ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570718:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2933, 88 off245048 00000004:00080000:0.0:1746144663.570720:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779585742ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570725:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2854, 88 off238096 00000004:00080000:0.0:1746144663.570728:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779593919ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570733:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2934, 88 off245136 00000004:00080000:0.0:1746144663.570735:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779600847ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570740:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2855, 88 off238184 00000004:00080000:0.0:1746144663.570742:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779607530ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.570747:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2935, 88 off245224 00000004:00080000:0.0:1746144663.570749:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779614635ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570754:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2936, 88 off245312 00000004:00080000:0.0:1746144663.570756:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779621869ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570762:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2937, 88 off245400 00000004:00080000:0.0:1746144663.570764:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779629342ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570768:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2938, 88 off245488 00000004:00080000:0.0:1746144663.570770:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642779635667ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.570775:0:16907:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2856, 88 off238272 00000004:00080000:0.0:1746144663.570777:0:16907:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642779642540ns, next at 593480289301ns, rc = 0 00000004:00010000:1.0:1746144663.593313:0:16907:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012cef8380 reply state ffff88012ba4d800 transno 8589944019 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16907 initiator: MDT0 00000100:00100000:1.0:1746144663.593330:0:16907:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746144663.593341:0:16907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.593344:0:16907:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144663.593353:0:16907:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b51c400/0xa7c849b16e01aaaa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f23c expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.593469:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29247:x1830964746744448:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 27550us (27855us total) trans 8589944019 rc 0/0 00000100:00100000:1.0:1746144663.593480:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4094 00000001:00080000:1.0:1746144663.593520:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944019 is committed 00000004:00080000:1.0:1746144663.593528:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2041 committed 00000004:00080000:1.0:1746144663.593534:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2120 committed 00000004:00080000:1.0:1746144663.593538:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2119 committed 00000004:00080000:1.0:1746144663.593540:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2118 committed 00000004:00080000:1.0:1746144663.593542:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2117 committed 00000004:00080000:1.0:1746144663.593543:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2040 committed 00000004:00080000:1.0:1746144663.593545:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2116 committed 00000004:00080000:1.0:1746144663.593552:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746144663.593554:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2115 committed 00000004:00080000:1.0:1746144663.593556:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746144663.593558:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2037 committed 00000004:00080000:1.0:1746144663.593560:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746144663.593561:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2114 committed 00000004:00080000:1.0:1746144663.593562:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2113 committed 00000004:00080000:1.0:1746144663.593564:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746144663.593566:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746144663.593568:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2112 committed 00010000:00010000:1.0:1746144663.593589:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144663.593597:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144663.593604:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144663.593610:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5e200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144663.593614:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144663.593621:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144663.593634:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.593636:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144663.593639:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16907 initiator: MDT0 00010000:00010000:1.0:1746144663.593644:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01ab67 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16907 initiator: MDT0 00000100:00100000:2.0:1746144663.593678:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747515136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.593729:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.593753:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747515648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.593767:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.593767:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747515264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.593777:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.593795:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.593799:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.593809:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.593814:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747515776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.593821:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.593834:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746144663.593838:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747515520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.593842:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.593851:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.593853:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747516288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.593861:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.593866:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.593879:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747515392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.593880:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747516800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.593892:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.593912:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515136 00000100:00100000:0.0:1746144663.593913:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515648 00000100:00100000:2.0:1746144663.593918:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515136 00000100:00100000:0.0:1746144663.593918:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515648 00000100:00100000:2.0:1746144663.593943:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516160 00000100:00100000:2.0:1746144663.593945:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516160 00000100:00100000:0.0:1746144663.593950:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515264 00000100:00100000:0.0:1746144663.593952:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515264 00000100:00100000:2.0:1746144663.593957:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516672 00000100:00100000:2.0:1746144663.593959:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516672 00000100:00100000:0.0:1746144663.593959:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515776 00000100:00100000:0.0:1746144663.593961:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515776 00000100:00100000:2.0:1746144663.593965:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515520 00000100:00100000:2.0:1746144663.593967:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515520 00000100:00100000:0.0:1746144663.593967:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516288 00000100:00100000:0.0:1746144663.593968:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516288 00000100:00100000:2.0:1746144663.593973:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516800 00000100:00100000:2.0:1746144663.593975:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516800 00000100:00100000:0.0:1746144663.593975:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11963 00000100:00100000:0.0:1746144663.593981:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830964747515136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.593983:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11964 00000100:00100000:2.0:1746144663.593988:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3296:x1830964747515648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.594039:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.594048:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594062:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.594068:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747517056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594079:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746144663.594178:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746144663.594181:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747515648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (412us total) trans 21474840521 rc 0/0 00002000:00010000:0.0:1746144663.594181:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.594184:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.594186:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.594188:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144663.594190:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11964 00000100:00100000:2.0:1746144663.594200:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516032 00000100:00100000:2.0:1746144663.594203:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516032 00000100:00100000:0.0:1746144663.594204:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1830964747515136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (475us total) trans 21474840522 rc 0/0 00000100:00100000:0.0:1746144663.594210:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11963 00000100:00100000:2.0:1746144663.594213:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516544 00000100:00100000:2.0:1746144663.594215:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516544 00000100:00100000:0.0:1746144663.594220:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747517056 00000100:00100000:2.0:1746144663.594222:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11965 00000100:00100000:0.0:1746144663.594222:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747517056 00000100:00100000:2.0:1746144663.594226:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747516160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594231:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11966 00000100:00100000:0.0:1746144663.594235:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3293:x1830964747515264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144663.594295:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144663.594298:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.594300:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.594302:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.594304:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144663.594320:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3293:x1830964747515264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (529us total) trans 21474840523 rc 0/0 00002000:00010000:2.0:1746144663.594321:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746144663.594324:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00000100:00100000:0.0:1746144663.594324:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11966 00002000:00010000:2.0:1746144663.594326:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.594327:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.594329:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:2.0:1746144663.594347:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747516160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (551us total) trans 17179873285 rc 0/0 00000100:00100000:2.0:1746144663.594352:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11965 00000100:00100000:2.0:1746144663.594362:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11967 00000100:00100000:2.0:1746144663.594366:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747516672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.594397:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11968 00000100:00100000:1.0:1746144663.594409:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3293:x1830964747515776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.594430:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11969 00000100:00100000:0.0:1746144663.594434:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3296:x1830964747515520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.594437:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747516672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (614us total) trans 17179873286 rc 0/0 00000100:00100000:2.0:1746144663.594443:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11967 00000100:00100000:2.0:1746144663.594451:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11970 00000100:00100000:2.0:1746144663.594455:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3293:x1830964747516288:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.594495:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092879180/2, rc 0, transno 21474840523 00000100:00100000:0.0:1746144663.594499:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747515264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.594506:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c944e00/2, rc 0, transno 21474840524 00000100:00100000:1.0:1746144663.594507:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747515776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (663us total) trans 21474840524 rc 0/0 00000100:00100000:0.0:1746144663.594509:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747515776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.594512:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11968 00002000:00010000:2.0:1746144663.594513:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144663.594516:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.594518:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.594520:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.594522:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746144663.594522:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11971 00000004:00080000:0.0:1746144663.594525:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b571880/2, rc 0, transno 17179873286 00000100:00100000:1.0:1746144663.594528:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747516800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594531:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.594537:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092879500/2, rc 0, transno 21474840522 00000100:00100000:0.0:1746144663.594539:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747515136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.594542:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747516288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (675us total) trans 17179873287 rc 0/0 00000004:00080000:0.0:1746144663.594544:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092878a80/2, rc 0, transno 21474840521 00000100:00100000:0.0:1746144663.594547:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747515648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.594548:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11970 00000004:00080000:0.0:1746144663.594552:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b571f80/2, rc 0, transno 17179873285 00000100:00100000:0.0:1746144663.594554:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.594557:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11972 00000100:00100000:2.0:1746144663.594561:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747516032:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.594579:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b570000/2, rc 0, transno 17179873287 00000100:00100000:0.0:1746144663.594582:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747516288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594589:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747517184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594605:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.594615:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747516800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (721us total) trans 17179873288 rc 0/0 00000100:00100000:1.0:1746144663.594621:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11971 00000004:00080000:0.0:1746144663.594621:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b572300/2, rc 0, transno 17179873288 00000100:00100000:0.0:1746144663.594624:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747516800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.594628:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747516032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (597us total) trans 21474840526 rc 0/0 00000100:00100000:1.0:1746144663.594629:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747517184 00000100:00100000:1.0:1746144663.594632:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747517184 00000100:00100000:2.0:1746144663.594634:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11972 00000004:00080000:0.0:1746144663.594634:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c946680/2, rc 0, transno 21474840526 00000100:00100000:0.0:1746144663.594636:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.594643:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11973 00000100:00100000:1.0:1746144663.594647:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747516544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144663.594659:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746144663.594661:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144663.594663:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144663.594665:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144663.594667:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144663.594683:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747515520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (831us total) trans 21474840525 rc 0/0 00000100:00100000:0.0:1746144663.594689:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11969 00000100:00100000:0.0:1746144663.594697:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11974 00000100:00100000:0.0:1746144663.594701:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747517056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.594715:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747516544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (651us total) trans 17179873289 rc 0/0 00000100:00100000:1.0:1746144663.594721:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11973 00000100:00100000:1.0:1746144663.594733:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11975 00000100:00100000:1.0:1746144663.594738:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747517184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.594766:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747517056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (686us total) trans 17179873290 rc 0/0 00000100:00100000:0.0:1746144663.594771:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11974 00000004:00080000:0.0:1746144663.594786:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287aa00/2, rc 0, transno 21474840525 00000100:00100000:0.0:1746144663.594790:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747515520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.594795:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b570e00/2, rc 0, transno 17179873289 00000100:00100000:0.0:1746144663.594798:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747516544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.594803:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b570a80/2, rc 0, transno 17179873290 00000100:00100000:0.0:1746144663.594805:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747517056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.594806:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747517184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (199us total) trans 17179873291 rc 0/0 00000004:00080000:0.0:1746144663.594811:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093988380/2, rc 0, transno 17179873291 00000100:00100000:1.0:1746144663.594812:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11975 00000100:00100000:0.0:1746144663.594814:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747517184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.597842:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.597893:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747515904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.597936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.597964:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747516416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.597981:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.597994:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747516928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.598008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.598045:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515392 00000100:00100000:2.0:1746144663.598052:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515392 00000100:00100000:2.0:1746144663.598082:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747515904 00000100:00100000:2.0:1746144663.598084:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747515904 00000100:00100000:2.0:1746144663.598092:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516416 00000100:00100000:2.0:1746144663.598093:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516416 00000100:00100000:2.0:1746144663.598102:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747516928 00000100:00100000:2.0:1746144663.598103:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747516928 00000100:00100000:2.0:1746144663.598124:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11976 00000100:00100000:2.0:1746144663.598130:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830964747515392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144663.598318:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746144663.598321:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.598322:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.598324:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.598326:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746144663.598349:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830964747515392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (515us total) trans 21474840527 rc 0/0 00000100:00100000:2.0:1746144663.598354:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11976 00000100:00100000:2.0:1746144663.598366:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11977 00000100:00100000:2.0:1746144663.598370:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3294:x1830964747515904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.598425:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11978 00000100:00100000:2.0:1746144663.598428:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3294:x1830964747515904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (491us total) trans 21474840528 rc 0/0 00000100:00100000:2.0:1746144663.598433:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11977 00000100:00100000:1.0:1746144663.598437:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3294:x1830964747516416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.598440:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11979 00000100:00100000:2.0:1746144663.598443:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3294:x1830964747516928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.598677:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747516928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (668us total) trans 17179873292 rc 0/0 00000100:00100000:2.0:1746144663.598682:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11979 00002000:00010000:1.0:1746144663.598702:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144663.598705:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.598707:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.598709:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.598711:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000004:00080000:2.0:1746144663.598714:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092879880/2, rc 0, transno 21474840527 00000100:00100000:2.0:1746144663.598718:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747515392:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144663.598724:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c947800/2, rc 0, transno 21474840528 00000100:00100000:2.0:1746144663.598726:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747515904:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144663.598733:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b570380/2, rc 0, transno 17179873293 00000100:00100000:1.0:1746144663.598735:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747516416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 303us (752us total) trans 17179873293 rc 0/0 00000100:00100000:2.0:1746144663.598736:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747516416:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144663.598741:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b571500/2, rc 0, transno 17179873292 00000100:00100000:2.0:1746144663.598743:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747516928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.598744:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11978 00000100:00100000:2.0:1746144663.600650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.600711:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746744704 00000100:00100000:3.0:1746144663.600719:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746744704 00000100:00100000:3.0:1746144663.600758:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10126 00000100:00100000:3.0:1746144663.600764:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29247:x1830964746744704:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.600786:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.600803:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f27b expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.600856:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.600869:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.600885:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.600888:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144663.600891:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52d200, rc 0) 00000100:00100000:3.0:1746144663.600941:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29247:x1830964746744704:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.600946:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10126 00000100:00100000:0.0:1746144663.609340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.609434:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746744960 00000100:00100000:1.0:1746144663.609446:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746744960 00000100:00100000:1.0:1746144663.609516:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4095 00000100:00100000:1.0:1746144663.609525:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29247:x1830964746744960:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1746144663.609815:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29247:x1830964746744960:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 290us (486us total) trans 8589944020 rc 0/0 00000100:00100000:1.0:1746144663.609822:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4095 00000100:00100000:0.0:1746144663.629373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.629480:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746745216 00000100:00100000:3.0:1746144663.629489:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746745216 00000100:00100000:3.0:1746144663.629550:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10127 00000100:00100000:3.0:1746144663.629559:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+6:29258:x1830964746745216:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.629584:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.629603:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c400/0xa7c849b16e01ab75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f282 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.629720:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629735:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629745:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629759:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629764:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629769:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629877:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629884:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629890:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:3.0:1746144663.629899:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144663.629990:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.629997:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630003:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630012:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b52c000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144663.630015:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630021:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630041:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144663.630044:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144663.630049:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630053:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ab7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630082:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630087:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630092:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630096:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c222800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144663.630098:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630103:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630110:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f204f00) 00010000:00010000:3.0:1746144663.630112:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144663.630114:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630118:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c222800/0xa7c849b16e01ab83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.630184:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52c400/0xa7c849b16e01ab75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.630195:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.630201:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.630202:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144663.630205:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e254e00, rc 0) 00000100:00100000:3.0:1746144663.630254:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29258:x1830964746745216:12345-192.168.204.23@tcp:101:cat.0 Request processed in 696us (893us total) trans 8589944021 rc 0/0 00000100:00100000:3.0:1746144663.630261:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10127 00000100:00100000:0.0:1746144663.632065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.632124:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746745472 00000100:00100000:2.0:1746144663.632131:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746745472 00000100:00100000:2.0:1746144663.632209:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10128 00000100:00100000:2.0:1746144663.632216:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:29259:x1830964746745472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.632235:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.632247:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01ab98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f289 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.632486:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632497:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632507:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632517:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632523:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632528:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632620:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632632:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632637:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000004:00200000:2.0:1746144663.632645:0:22257:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144663.632709:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632715:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632721:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632726:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b765c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.632729:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632735:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632744:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144663.632747:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.632750:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632755:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765c00/0xa7c849b16e01ab9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632780:0:22257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632789:0:22257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632794:0:22257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632798:0:22257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b764600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.632801:0:22257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.632805:0:22257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.633114:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8600) 00010000:00010000:2.0:1746144663.633118:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.633121:0:22257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.633127:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764600/0xa7c849b16e01aba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.633180:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b765200/0xa7c849b16e01ab98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 299 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.633190:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 298 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.633196:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.633198:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144663.633201:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764c00, rc 0) 00000100:00100000:2.0:1746144663.633253:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746745472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1037us (1194us total) trans 8589944022 rc 0/0 00000100:00100000:2.0:1746144663.633260:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10128 00000100:00100000:0.0:1746144663.634879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.634942:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746745600 00000100:00100000:2.0:1746144663.634951:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746745600 00000100:00100000:2.0:1746144663.635001:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11980 00000100:00100000:2.0:1746144663.635008:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:29258:x1830964746745600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.635023:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.635047:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f290 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.635070:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.635072:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.635080:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.635093:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 26 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.635101:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764800, rc 0) 00000100:00100000:2.0:1746144663.635250:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:29258:x1830964746745600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 241us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.635256:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11980 00000100:00100000:0.0:1746144663.636371:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.636451:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746745856 00000100:00100000:2.0:1746144663.636456:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746745856 00000100:00100000:2.0:1746144663.636495:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10129 00000100:00100000:2.0:1746144663.636501:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+8:29256:x1830964746745856:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144663.636519:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.636535:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01abc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f297 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.636627:0:22257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.636641:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.636649:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 297 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.636655:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.636686:0:22257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 297 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.636698:0:22257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 297 pid: 22257 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.636710:0:22257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747517312:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.636801:0:22257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.636809:0:22257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 9 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.637040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.637085:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746746112 00000100:00100000:3.0:1746144663.637089:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746746112 00000100:00100000:2.0:1746144663.637126:0:22257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747517440:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.637128:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4096 00000100:00100000:3.0:1746144663.637155:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746746112:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144663.637188:0:22257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.637321:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29259:x1830964746746112:12345-192.168.204.23@tcp:35:cat.0 Request processed in 186us (291us total) trans 8589944023 rc 0/0 00000100:00100000:3.0:1746144663.637327:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4096 00000100:00100000:0.0:1746144663.638409:0:22257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747517312:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.638435:0:22257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:22257:1830964747517440:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.638455:0:22257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00000100:00100000:0.0:1746144663.639125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.639170:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746746240 00000100:00100000:2.0:1746144663.639175:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746746240 00010000:00010000:2.0:1746144663.639201:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.639233:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5986 00000100:00100000:2.0:1746144663.639239:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746746240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.639250:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.639255:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.639265:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.639285:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ab8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f282 expref: 10 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.639296:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.639300:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.639308:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.639313:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.639347:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746746240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.639353:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5986 00000100:00100000:2.0:1746144663.640244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.640396:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746746496 00000100:00100000:3.0:1746144663.640401:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746746496 00010000:00010000:3.0:1746144663.640419:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 299 pid: 22257 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.640453:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5987 00000100:00100000:3.0:1746144663.640459:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1961:x1830964746746496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.640468:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.640472:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 299 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.640482:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 299 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.640497:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b764c00/0xa7c849b16e01abad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f289 expref: 299 pid: 22257 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.640506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144663.640513:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.640517:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22257 initiator: MDT0 00010000:00010000:3.0:1746144663.640525:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22257 initiator: MDT0 00010000:00010000:3.0:1746144663.640532:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22257 initiator: MDT0 00000100:00100000:0.0:1746144663.640545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.640584:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746746368 00000100:00100000:2.0:1746144663.640589:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746746368 00000100:00100000:2.0:1746144663.640620:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746746752 00000100:00100000:2.0:1746144663.640623:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746746752 00000100:00100000:2.0:1746144663.640638:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10130 00000100:00100000:2.0:1746144663.640644:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29259:x1830964746746368:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144663.640645:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10131 00000100:00100000:0.0:1746144663.640653:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29253:x1830964746746752:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144663.640663:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.640663:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.640674:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01abd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f29e expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.640675:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b000/0xa7c849b16e01abd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2a5 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.640728:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.640772:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.640781:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.640789:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.640800:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.640805:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.640810:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.640910:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.640942:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.640949:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.640959:0:20319:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 5/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 22257 initiator: MDT0 00010000:00010000:2.0:1746144663.640967:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.641045:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.641076:0:22257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22257 initiator: MDT0 00010000:00010000:1.0:1746144663.641082:0:22257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22257 initiator: MDT0 00000100:00100000:3.0:1746144663.641105:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1961:x1830964746746496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 646us (862us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144663.641110:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641117:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144663.641124:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144663.641230:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:3.0:1746144663.641275:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5987 00000004:00200000:1.0:1746144663.641337:0:22257:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:0.0:1746144663.641377:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641452:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.641509:0:22257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5344000/0xa7c849b16e01abc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.641706:0:22257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 9 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.641713:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 9 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.641718:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093022000, rc 0) 00010000:00010000:0.0:1746144663.641735:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304ac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144663.641738:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641746:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641754:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144663.641757:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144663.641760:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641765:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01abe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641777:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144663.641835:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+9:29256:x1830964746745856:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5333us (5465us total) trans 8589944025 rc 0/0 00000100:00100000:1.0:1746144663.641852:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10129 00010000:00010000:0.0:1746144663.641960:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641966:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641970:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304be00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144663.641972:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641978:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641985:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaf00) 00010000:00010000:0.0:1746144663.641987:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144663.641988:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.641993:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01abec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.642020:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b000/0xa7c849b16e01abd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 303 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.642027:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 302 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.642044:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.642046:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144663.642047:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.642056:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.642059:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a800, rc 0) 00000100:00100000:0.0:1746144663.642076:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29253:x1830964746746752:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1426us (1531us total) trans 8589944024 rc 0/0 00000100:00100000:0.0:1746144663.642082:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10131 00000100:00100000:0.0:1746144663.645727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.645943:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746747136 00000100:00100000:2.0:1746144663.645963:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746747136 00002000:00100000:2.0:1746144663.646017:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009b32d180 x1830964746747136/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.646027:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32d180 with x1830964746747136 ext(0->1048575) 00002000:00010000:2.0:1746144663.646041:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32d180 00000100:00100000:2.0:1746144663.646333:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4605 00000100:00100000:0.0:1746144663.646339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.646384:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746747136:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.646398:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746746880 00000100:00100000:3.0:1746144663.646403:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746746880 00010000:00010000:3.0:1746144663.646426:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 9 pid: 22257 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.646451:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5988 00000100:00100000:3.0:1746144663.646456:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746746880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.646466:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.646471:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 9 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.646483:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 9 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.646505:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093022000/0xa7c849b16e01abc9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f297 expref: 9 pid: 22257 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.646525:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.646529:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.646538:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.646544:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.646564:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.646624:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746746880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 166us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.646630:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5988 00010000:00010000:0.0:1746144663.647079:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.647086:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:0.0:1746144663.647130:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:0.0:1746144663.647154:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144663.647171:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.647182:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.647209:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01abd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 302 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.647224:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.647230:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.647233:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144663.647235:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e2800, rc 0) 00000100:00100000:0.0:1746144663.647259:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29259:x1830964746746368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6615us (6754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.647265:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10130 00000100:00100000:1.0:1746144663.652007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.653005:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746747264 00000100:00100000:2.0:1746144663.653017:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746747264 00000100:00100000:2.0:1746144663.653077:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11981 00000100:00100000:2.0:1746144663.653085:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29259:x1830964746747264:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.653107:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.653127:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2ac expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.653471:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.653472:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.653480:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 41 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.653496:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 41 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.653506:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e2600, rc 0) 00000100:00100000:2.0:1746144663.653685:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29259:x1830964746747264:12345-192.168.204.23@tcp:101:cat.0 Request processed in 599us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.653692:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11981 00000100:00100000:2.0:1746144663.657346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.658063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.658118:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746747648 00000100:00100000:2.0:1746144663.658127:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746747648 00000100:00100000:2.0:1746144663.658196:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10132 00000100:00100000:2.0:1746144663.658204:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:29256:x1830964746747648:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144663.658230:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.658249:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2b3 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.658319:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2b3 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.658332:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2b3 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.658353:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.658357:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.658360:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e3600, rc 0) 00000100:00100000:2.0:1746144663.658405:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:29256:x1830964746747648:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 201us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.658411:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10132 00000100:00100000:1.0:1746144663.658489:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746747520 00000100:00100000:1.0:1746144663.658493:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746747520 00002000:00100000:1.0:1746144663.658526:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b5f7b80 x1830964746747520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.658534:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7b80 with x1830964746747520 ext(0->1048575) 00002000:00010000:1.0:1746144663.658539:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7b80 00000100:00100000:1.0:1746144663.658550:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4606 00000100:00100000:1.0:1746144663.658554:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746747520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.659771:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746747136:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13427us (14054us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144663.659780:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4605 00002000:00100000:3.0:1746144663.659787:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009b32d180 x1830964746747136/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.659794:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32d180 with x1830964746747136 ext(0->1048575) 00002000:00010000:3.0:1746144663.659798:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32d180 00000100:00100000:0.0:1746144663.662467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.663721:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746747904 00000100:00100000:1.0:1746144663.663733:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746747904 00000100:00100000:1.0:1746144663.663789:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10133 00000100:00100000:1.0:1746144663.663799:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29256:x1830964746747904:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144663.663821:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.663825:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144663.663854:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2b3 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.663891:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.663896:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.663908:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90c200/0xa7c849b16e01ac16 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2ba expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.663958:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.663971:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.663978:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.663984:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.663990:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.664019:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.664040:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 300 pid: 20319 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.664051:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517568:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.664148:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.664156:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 300 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.664163:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517696:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.664192:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.664199:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 7 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:1.0:1746144663.664205:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517824:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.664219:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.667252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.667307:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748032 00000100:00100000:3.0:1746144663.667316:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748032 00000100:00100000:3.0:1746144663.667366:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11982 00000100:00100000:3.0:1746144663.667376:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:29258:x1830964746748032:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.667411:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.667430:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2c1 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.667458:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.667460:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.667468:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.667483:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.667492:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e254e00, rc 0) 00000100:00100000:3.0:1746144663.667544:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:29258:x1830964746748032:12345-192.168.204.23@tcp:101:cat.0 Request processed in 171us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.667550:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11982 00000100:00100000:1.0:1746144663.668748:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517568:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.668929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.668959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.669051:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517696:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.669059:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517824:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.669099:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748288 00000100:00100000:2.0:1746144663.669103:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748288 00010000:00010000:2.0:1746144663.669132:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 301 pid: 20319 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.669172:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748160 00000100:00100000:2.0:1746144663.669174:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748160 00010000:00010000:2.0:1746144663.669184:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 302 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.669198:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5989 00000100:00100000:2.0:1746144663.669203:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1960:x1830964746748288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.669214:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.669220:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 302 pid: 20319 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.669230:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 302 pid: 20319 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.669689:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2800/0xa7c849b16e01abde lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f29e expref: 302 pid: 20319 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.669700:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5990 00000100:00100000:3.0:1746144663.669708:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a44ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1960:x1830964746748160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.669715:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.669723:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 301 pid: 14710 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.669728:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.669731:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 301 pid: 14710 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.669742:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a800/0xa7c849b16e01abf3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2a5 expref: 301 pid: 14710 timeout: 742 lvb_type: 0 00010000:00010000:3.0:1746144663.669755:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.669760:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.669766:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.669770:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.669802:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a44ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1960:x1830964746748160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 95us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.669807:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5990 00000100:00100000:0.0:1746144663.669917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.669930:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748416 00000100:00100000:0.0:1746144663.669933:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748416 00010000:00010000:0.0:1746144663.669946:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 8 pid: 14709 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.669959:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5991 00000100:00100000:0.0:1746144663.669963:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746748416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.669968:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.669971:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 8 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.669979:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 8 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.669990:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b52d200/0xa7c849b16e01ab6e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f27b expref: 8 pid: 14709 timeout: 742 lvb_type: 0 00010000:00010000:0.0:1746144663.670004:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.670007:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.670013:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.670019:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.670046:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.670059:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746748416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 96us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.670064:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5991 00000100:00100000:0.0:1746144663.670116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144663.670588:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.670593:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.670614:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1960:x1830964746748288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1410us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.670620:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5989 00000100:00100000:2.0:1746144663.670670:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748544 00000100:00100000:2.0:1746144663.670673:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748544 00000100:00100000:2.0:1746144663.670702:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10134 00000100:00100000:2.0:1746144663.670708:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:29258:x1830964746748544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.670725:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.670747:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2c8 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.670798:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.670805:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.670818:0:20319:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.670832:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.670841:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.670844:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.670846:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.670852:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e3600, rc 0) 00000100:00100000:2.0:1746144663.670882:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:29258:x1830964746748544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 173us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.670887:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10134 00000100:00100000:1.0:1746144663.671036:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746747520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11664us (12884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.671046:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4606 00002000:00100000:1.0:1746144663.671055:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b5f7b80 x1830964746747520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.671065:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f7b80 with x1830964746747520 ext(0->1048575) 00002000:00010000:1.0:1746144663.671069:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f7b80 00010000:00010000:1.0:1746144663.671094:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.671101:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00000004:02000000:1.0:1746144663.671165:0:14710:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:0.0:1746144663.675910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.676016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.676086:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748800 00000100:00100000:2.0:1746144663.676093:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748672 00000100:00100000:3.0:1746144663.676097:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748800 00000100:00100000:2.0:1746144663.676097:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748672 00000100:00100000:3.0:1746144663.676160:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11983 00000100:00100000:2.0:1746144663.676161:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10135 00000100:00100000:3.0:1746144663.676168:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29259:x1830964746748800:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144663.676168:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29253:x1830964746748672:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144663.676185:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.676185:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.676202:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2d6 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.676202:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2cf expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.676228:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.676230:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.676237:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.676251:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.676256:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.676261:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c000, rc 0) 00010000:00010000:2.0:1746144663.676263:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.676272:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.676275:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.676279:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 10 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.676284:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e2c00, rc 0) 00000100:00100000:2.0:1746144663.676321:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29253:x1830964746748672:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 150us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.676328:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10135 00000100:00100000:3.0:1746144663.676434:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29259:x1830964746748800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 266us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.676440:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11983 00000040:00080000:0.0:1746144663.681493:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2939, 88 off245576 00000004:00080000:0.0:1746144663.681505:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890369692ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681565:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2857, 88 off238360 00000004:00080000:0.0:1746144663.681569:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890434884ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681597:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2858, 88 off238448 00000004:00080000:0.0:1746144663.681601:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890466377ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681608:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2940, 88 off245664 00000004:00080000:0.0:1746144663.681611:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890476797ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681654:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2942, 88 off245848 00000004:00080000:0.0:1746144663.681658:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890523519ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681668:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2859, 88 off238536 00000004:00080000:0.0:1746144663.681671:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890536745ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681689:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2860, 88 off238624 00000004:00080000:0.0:1746144663.681692:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890557619ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681698:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2861, 88 off238712 00000004:00080000:0.0:1746144663.681700:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890565934ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681708:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2943, 88 off245936 00000004:00080000:0.0:1746144663.681710:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890575384ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681718:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2862, 88 off238800 00000004:00080000:0.0:1746144663.681720:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890585387ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681725:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2944, 88 off246024 00000004:00080000:0.0:1746144663.681727:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890593037ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681735:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2863, 88 off238888 00000004:00080000:0.0:1746144663.681737:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890602809ns, next at 593480289301ns, rc = 0 00000040:00080000:0.0:1746144663.681743:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2945, 88 off246112 00000004:00080000:0.0:1746144663.681745:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890610502ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681751:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2946, 88 off246200 00000004:00080000:0.0:1746144663.681753:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890619067ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681760:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2947, 88 off246288 00000004:00080000:0.0:1746144663.681763:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890628045ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681769:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2948, 88 off246376 00000004:00080000:0.0:1746144663.681771:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642890636942ns, next at 593496143484ns, rc = 0 00000040:00080000:0.0:1746144663.681780:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2864, 88 off238976 00000004:00080000:0.0:1746144663.681782:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 642890647612ns, next at 593480289301ns, rc = 0 00000001:00080000:1.0:1746144663.703164:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944026 is committed 00000004:00080000:1.0:1746144663.703174:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2049 committed 00010000:00010000:2.0:1746144663.703358:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703372:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.703374:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746144663.703378:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703388:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703395:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703402:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703408:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703413:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.703455:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.703469:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517952:192.168.204.23@tcp:105: 00000004:00080000:1.0:1746144663.703525:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2129 committed 00000004:00080000:1.0:1746144663.703533:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2128 committed 00000004:00080000:1.0:1746144663.703534:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2127 committed 00000004:00080000:1.0:1746144663.703536:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2126 committed 00000004:00080000:1.0:1746144663.703537:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2048 committed 00000004:00080000:1.0:1746144663.703539:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2125 committed 00000004:00080000:1.0:1746144663.703540:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2047 committed 00000004:00080000:1.0:1746144663.703542:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2124 committed 00000004:00080000:1.0:1746144663.703543:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2046 committed 00000004:00080000:1.0:1746144663.703544:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2045 committed 00000004:00080000:1.0:1746144663.703545:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2044 committed 00000004:00080000:1.0:1746144663.703547:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2123 committed 00000004:00080000:1.0:1746144663.703548:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2122 committed 00000004:00080000:1.0:1746144663.703552:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2043 committed 00000004:00080000:1.0:1746144663.703553:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2042 committed 00000004:00080000:1.0:1746144663.703554:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2121 committed 00000001:00080000:1.0:1746144663.703562:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944024 is committed 00000001:00080000:1.0:1746144663.703571:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944020 is committed 00000100:00100000:3.0:1746144663.703762:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.703841:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703858:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.703875:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746144663.703879:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703891:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.703901:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703914:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.703930:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703945:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.703955:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703968:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.703978:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746144663.703981:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.703993:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.704002:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.704013:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746144663.704052:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.704154:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518208 00000100:00100000:2.0:1746144663.704155:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747519104:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144663.704161:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518208 00000100:00100000:2.0:1746144663.704188:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929e33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.704192:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518720 00000100:00100000:3.0:1746144663.704194:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518720 00000100:00100000:3.0:1746144663.704204:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518080 00000100:00100000:3.0:1746144663.704205:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518080 00000100:00100000:3.0:1746144663.704213:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518592 00000100:00100000:3.0:1746144663.704215:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518592 00000100:00100000:3.0:1746144663.704224:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518336 00000100:00100000:3.0:1746144663.704226:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518336 00000100:00100000:3.0:1746144663.704232:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518848 00000100:00100000:3.0:1746144663.704234:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518848 00000100:00100000:3.0:1746144663.704240:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518464 00000100:00100000:3.0:1746144663.704241:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518464 00000100:00100000:3.0:1746144663.704247:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747518976 00000100:00100000:3.0:1746144663.704248:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747518976 00000100:00100000:3.0:1746144663.704257:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11984 00000100:00100000:3.0:1746144663.704264:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747518208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144663.704442:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144663.704445:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.704447:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.704450:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.704452:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746144663.704477:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747518208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (673us total) trans 21474840529 rc 0/0 00000100:00100000:3.0:1746144663.704484:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11984 00000100:00100000:3.0:1746144663.704497:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11985 00000100:00100000:3.0:1746144663.704502:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747518720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144663.704576:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747518720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (716us total) trans 21474840530 rc 0/0 00000100:00100000:3.0:1746144663.704582:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11985 00000100:00100000:3.0:1746144663.704590:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11986 00000100:00100000:3.0:1746144663.704594:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747518080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.704640:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11987 00000100:00100000:1.0:1746144663.704649:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747518592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.704661:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11988 00000100:00100000:1.0:1746144663.704666:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747518336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144663.704672:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144663.704675:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.704677:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.704679:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144663.704680:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746144663.704697:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747518080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (805us total) trans 21474840531 rc 0/0 00000100:00100000:3.0:1746144663.704702:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11986 00000100:00100000:3.0:1746144663.704711:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11989 00000100:00100000:3.0:1746144663.704715:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830964747518848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144663.704774:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144663.704777:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.704779:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.704781:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.704783:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144663.704789:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747519232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.704809:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747518336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (863us total) trans 21474840532 rc 0/0 00000100:00100000:1.0:1746144663.704815:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11988 00000100:00100000:0.0:1746144663.704815:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.704824:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747519232 00000100:00100000:1.0:1746144663.704827:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747519232 00000100:00100000:0.0:1746144663.704827:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144663.704831:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747519360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.704840:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11990 00000100:00100000:1.0:1746144663.704844:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3295:x1830964747518464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.704846:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.704860:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747519360 00000100:00100000:0.0:1746144663.704863:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747519360 00000100:00100000:0.0:1746144663.704877:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11991 00000100:00100000:0.0:1746144663.704881:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3295:x1830964747518976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144663.704919:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144663.704922:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144663.704924:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144663.704925:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144663.704927:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144663.704945:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3295:x1830964747518464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (951us total) trans 21474840533 rc 0/0 00000100:00100000:1.0:1746144663.704951:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11990 00000100:00100000:1.0:1746144663.704960:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11992 00000100:00100000:1.0:1746144663.704964:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3293:x1830964747519232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.704969:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747518976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (953us total) trans 21474840534 rc 0/0 00000100:00100000:0.0:1746144663.704974:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11991 00000100:00100000:0.0:1746144663.704983:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11993 00000100:00100000:0.0:1746144663.704987:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3293:x1830964747519360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144663.705082:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144663.705084:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.705087:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.705088:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.705090:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746144663.705111:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3293:x1830964747519360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (264us total) trans 17179873294 rc 0/0 00000100:00100000:0.0:1746144663.705117:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11993 00000100:00100000:1.0:1746144663.705129:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747518592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 482us (1213us total) trans 21474840535 rc 0/0 00000100:00100000:1.0:1746144663.705152:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11987 00002000:00010000:1.0:1746144663.705192:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746144663.705194:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.705196:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.705198:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.705200:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000004:00080000:0.0:1746144663.705210:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4380/2, rc 0, transno 17179873294 00000100:00100000:0.0:1746144663.705215:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747519360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.705216:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3293:x1830964747519232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 252us (401us total) trans 17179873295 rc 0/0 00000100:00100000:1.0:1746144663.705222:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11992 00000004:00080000:0.0:1746144663.705222:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4e00/2, rc 0, transno 17179873295 00000100:00100000:0.0:1746144663.705224:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747519232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.705447:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747519872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.705469:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746144663.705488:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44380/2, rc 0, transno 21474840531 00000100:00100000:2.0:1746144663.705492:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144663.705500:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47480/2, rc 0, transno 21474840535 00000100:00100000:2.0:1746144663.705502:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518592:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144663.705508:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45880/2, rc 0, transno 21474840529 00000100:00100000:2.0:1746144663.705510:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144663.705515:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47800/2, rc 0, transno 21474840530 00000100:00100000:2.0:1746144663.705518:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747518720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.705524:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746144663.705528:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747519744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.705544:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.705555:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747520256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.705570:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.705585:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747519872 00000100:00100000:2.0:1746144663.705588:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747519872 00000100:00100000:2.0:1746144663.705602:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747519744 00000100:00100000:2.0:1746144663.705604:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747519744 00000100:00100000:2.0:1746144663.705612:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747520256 00000100:00100000:2.0:1746144663.705614:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747520256 00000100:00100000:2.0:1746144663.705623:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11994 00000100:00100000:2.0:1746144663.705627:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3294:x1830964747519872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.705673:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830964747518848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 956us (1703us total) trans 21474840536 rc 0/0 00000100:00100000:1.0:1746144663.705678:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11989 00000100:00100000:1.0:1746144663.705688:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11995 00000100:00100000:1.0:1746144663.705692:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747519744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.705716:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3294:x1830964747519872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (245us total) trans 17179873296 rc 0/0 00000100:00100000:2.0:1746144663.705721:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11994 00000100:00100000:2.0:1746144663.705731:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11996 00000100:00100000:2.0:1746144663.705735:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3294:x1830964747520256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.705746:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747519616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.705766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.705778:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747520128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.705791:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.705802:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144663.705810:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747519488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.705823:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.705832:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747520000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.705847:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.705857:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747519616 00000100:00100000:0.0:1746144663.705859:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747519616 00000100:00100000:0.0:1746144663.705867:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747520128 00000100:00100000:0.0:1746144663.705869:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747520128 00000100:00100000:0.0:1746144663.705874:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747519488 00000100:00100000:0.0:1746144663.705875:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747519488 00000100:00100000:0.0:1746144663.705880:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747520000 00000100:00100000:0.0:1746144663.705881:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747520000 00000100:00100000:0.0:1746144663.705886:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11997 00000100:00100000:0.0:1746144663.705889:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3296:x1830964747519616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.705981:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3294:x1830964747520256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 244us (408us total) trans 17179873298 rc 0/0 00000100:00100000:1.0:1746144663.705983:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3294:x1830964747519744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 290us (437us total) trans 17179873297 rc 0/0 00000100:00100000:2.0:1746144663.705987:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11996 00000100:00100000:1.0:1746144663.705990:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11995 00000100:00100000:2.0:1746144663.705999:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11998 00000100:00100000:1.0:1746144663.706002:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11999 00000100:00100000:2.0:1746144663.706003:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3296:x1830964747520128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.706007:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3296:x1830964747519488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.706093:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3296:x1830964747520128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (300us total) trans 17179873300 rc 0/0 00002000:00010000:1.0:1746144663.706096:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00000100:00100000:2.0:1746144663.706098:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11998 00002000:00010000:1.0:1746144663.706099:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.706101:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.706103:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.706104:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:2.0:1746144663.706107:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12000 00000100:00100000:2.0:1746144663.706111:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3296:x1830964747520000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.706126:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3296:x1830964747519488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (301us total) trans 17179873301 rc 0/0 00000100:00100000:1.0:1746144663.706131:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11999 00000100:00100000:2.0:1746144663.706202:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3296:x1830964747520000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (353us total) trans 17179873302 rc 0/0 00000100:00100000:2.0:1746144663.706210:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12000 00000004:00080000:2.0:1746144663.706235:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f7100/2, rc 0, transno 17179873297 00000100:00100000:2.0:1746144663.706239:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747519744:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144663.706245:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009398ad80/2, rc 0, transno 17179873298 00000100:00100000:2.0:1746144663.706247:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747520256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144663.706252:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f7480/2, rc 0, transno 17179873296 00000100:00100000:2.0:1746144663.706255:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747519872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.706847:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3296:x1830964747519616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 955us (1079us total) trans 17179873299 rc 0/0 00000100:00100000:0.0:1746144663.706853:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11997 00000004:00080000:0.0:1746144663.706876:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4000/2, rc 0, transno 17179873301 00000100:00100000:0.0:1746144663.706880:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747519488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.706886:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f6a00/2, rc 0, transno 17179873302 00000100:00100000:0.0:1746144663.706888:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747520000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.706894:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4a80/2, rc 0, transno 17179873299 00000100:00100000:0.0:1746144663.706896:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747519616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.706902:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f5880/2, rc 0, transno 17179873300 00000100:00100000:0.0:1746144663.706905:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747520128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.707426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.707679:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.707751:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746748928 00000100:00100000:2.0:1746144663.707757:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746748928 00000100:00100000:2.0:1746144663.707783:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10136 00000100:00100000:2.0:1746144663.707788:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29259:x1830964746748928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.707802:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.707819:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01ac40 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2dd expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.707867:0:22257:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01ac40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2dd expref: 298 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.707879:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01ac40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2dd expref: 298 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.707892:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.707895:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.707897:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bb800, rc 0) 00000100:00100000:2.0:1746144663.707935:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746748928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 146us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.707944:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10136 00000100:00100000:2.0:1746144663.707977:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747517952:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144663.707985:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747519104:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144663.708013:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90c200/0xa7c849b16e01ac16 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 9 pid: 14710 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746144663.708026:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.708043:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749056 00000100:00100000:3.0:1746144663.708048:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749056 00010000:00010000:2.0:1746144663.708048:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c90dc00, rc 0) 00000100:00100000:2.0:1746144663.708064:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29256:x1830964746747904:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 44268us (45608us total) trans 8589944026 rc 0/0 00000100:00100000:3.0:1746144663.708069:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4097 00000100:00100000:2.0:1746144663.708069:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10133 00000100:00100000:3.0:1746144663.708073:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29258:x1830964746749056:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:0.0:1746144663.708330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.708576:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749184 00000100:00100000:1.0:1746144663.708579:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749184 00000100:00100000:1.0:1746144663.708598:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4098 00000100:00100000:1.0:1746144663.708603:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29253:x1830964746749184:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:1.0:1746144663.708648:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29253:x1830964746749184:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.708653:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4098 00000100:00100000:3.0:1746144663.708772:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29258:x1830964746749056:12345-192.168.204.23@tcp:49:cat.0 Request processed in 697us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.708779:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4097 00000004:00080000:3.0:1746144663.708813:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45180/2, rc 0, transno 21474840534 00000100:00100000:3.0:1746144663.708818:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518976:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.708829:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb46300/2, rc 0, transno 21474840532 00000100:00100000:3.0:1746144663.708832:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.708840:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb46d80/2, rc 0, transno 21474840536 00000100:00100000:3.0:1746144663.708842:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144663.708851:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44a80/2, rc 0, transno 21474840533 00000100:00100000:3.0:1746144663.708853:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747518464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.713950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.714001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.714664:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749440 00000100:00100000:3.0:1746144663.714674:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749440 00000100:00100000:0.0:1746144663.714681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.715387:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749568 00000100:00100000:3.0:1746144663.715391:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749568 00000100:00100000:0.0:1746144663.715522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.715557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.715624:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4099 00000100:00100000:3.0:1746144663.715633:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29256:x1830964746749440:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:1.0:1746144663.715647:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4100 00000100:00100000:1.0:1746144663.715657:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746749568:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:3.0:1746144663.715757:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29256:x1830964746749440:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 126us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.715764:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4099 00000100:00100000:2.0:1746144663.715780:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749312 00000100:00100000:2.0:1746144663.715784:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749312 00000100:00100000:3.0:1746144663.715785:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749952 00000100:00100000:3.0:1746144663.715788:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749952 00000100:00100000:3.0:1746144663.715804:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12001 00000100:00100000:3.0:1746144663.715809:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29253:x1830964746749952:12345-192.168.204.23@tcp:101:multiop.0 00000100:00100000:2.0:1746144663.715814:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 640 00010000:00010000:3.0:1746144663.715819:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144663.715819:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1960:x1830964746749312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.715828:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.715836:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2e4 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.715849:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01ac40 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2dd expref: 299 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.715860:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.715864:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.715869:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.715869:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.715876:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.715883:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.715885:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.715888:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [110592->491519] (req 110592->491519) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 42 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.715914:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.715925:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 25 pid: 4760 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.715936:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747520384:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.716014:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746749568:12345-192.168.204.23@tcp:49:cat.0 Request processed in 359us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.716021:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4100 00000100:00100000:1.0:1746144663.716048:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746749824 00000100:00100000:1.0:1746144663.716051:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746749824 00002000:00100000:1.0:1746144663.716076:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012cef9180 x1830964746749824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.716085:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9180 with x1830964746749824 ext(1048576->2097151) 00002000:00010000:1.0:1746144663.716090:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef9180 00000100:00100000:1.0:1746144663.716105:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4607 00000100:00100000:1.0:1746144663.716110:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746749824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144663.716661:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:1960:x1830964746749312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 840us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.716670:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 640 00010000:00010000:3.0:1746144663.716686:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.716695:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 42 pid: 4760 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.716709:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747520512:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.716739:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.716747:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 10 pid: 22208 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144663.716754:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747520640:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.716779:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b26c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746144663.717175:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144663.720181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.720242:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746750080 00000100:00100000:3.0:1746144663.720256:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746750080 00000100:00100000:3.0:1746144663.720299:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12002 00000100:00100000:3.0:1746144663.720307:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:29256:x1830964746750080:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144663.720327:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.720349:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2eb expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.720379:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.720387:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.720389:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.720392:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3665920->3870719] (req 3665920->3870719) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.720452:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.720464:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144663.720476:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747520768:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.721091:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144663.723470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.723488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.723517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.723591:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746750208 00000100:00100000:2.0:1746144663.723601:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746750208 00010000:00010000:2.0:1746144663.723640:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 43 pid: 4760 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.723666:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746750336 00000100:00100000:2.0:1746144663.723668:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746750336 00010000:00010000:2.0:1746144663.723679:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 11 pid: 22208 timeout: 742 lvb_type: 1 00000100:00100000:2.0:1746144663.723689:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746750464 00000100:00100000:2.0:1746144663.723691:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746750464 00010000:00010000:2.0:1746144663.723700:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 28 pid: 4760 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.723715:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5992 00000100:00100000:2.0:1746144663.723721:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1961:x1830964746750208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144663.723724:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5993 00000100:00100000:1.0:1746144663.723733:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746750336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.723734:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.723742:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.723758:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 11 pid: 22208 timeout: 742 lvb_type: 1 00010000:00010000:2.0:1746144663.723759:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 43 pid: 4760 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.723769:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 43 pid: 4760 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.723777:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5994 00010000:00010000:1.0:1746144663.723778:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 11 pid: 22208 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144663.723783:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746750464:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.723790:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.724095:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 28 pid: 4760 timeout: 742 lvb_type: 0 00010000:00010000:1.0:1746144663.724096:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.724104:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 28 pid: 4760 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.724125:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.724131:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.724149:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144663.724151:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746750336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 421us (662us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144663.724156:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 43 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.724157:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5993 00000100:00100000:2.0:1746144663.724163:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1961:x1830964746750208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 441us (702us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144663.724165:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 43 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.724170:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5992 00010000:00010000:3.0:1746144663.724200:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 42 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.724212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.724213:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747520896:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144663.724271:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.724282:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746750720 00000100:00100000:2.0:1746144663.724285:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746750720 00010000:00010000:3.0:1746144663.724307:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764800/0xa7c849b16e01abbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f290 expref: 28 pid: 4760 timeout: 742 lvb_type: 0 00002000:00100000:2.0:1746144663.724309:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ad180 x1830964746750720/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.724318:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad180 with x1830964746750720 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.724322:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ad180 00000100:00100000:3.0:1746144663.724327:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747520384:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.724335:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4608 00010000:00010000:3.0:1746144663.724338:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01ac08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ac expref: 42 pid: 4760 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.724339:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746750720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.724346:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747520512:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.724354:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01ab13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f251 expref: 10 pid: 22208 timeout: 742 lvb_type: 1 00000100:00100000:3.0:1746144663.724362:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747520640:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.724390:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.724399:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7eac00, rc 0) 00000100:00100000:3.0:1746144663.724421:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29253:x1830964746749952:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8611us (8864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.724431:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12001 00000100:00100000:3.0:1746144663.725212:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747520768:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.725228:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3665920->3870719] (req 3665920->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.725237:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093850600, rc 0) 00000100:00100000:3.0:1746144663.725737:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:29256:x1830964746750080:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5428us (5566us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.725744:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12002 00000100:00100000:0.0:1746144663.725884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.725955:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746750848 00000100:00100000:0.0:1746144663.725959:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746750848 00010000:00010000:0.0:1746144663.725978:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 742 lvb_type: 1 00000100:00100000:1.0:1746144663.726176:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746749824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10064us (10652us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.726183:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4607 00002000:00100000:1.0:1746144663.726190:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012cef9180 x1830964746749824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.726198:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9180 with x1830964746749824 ext(1048576->2097151) 00002000:00010000:1.0:1746144663.726202:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef9180 00000100:00100000:0.0:1746144663.726213:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5995 00000100:00100000:0.0:1746144663.726220:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746750848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.726230:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.726246:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.726256:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.726272:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5345600/0xa7c849b16e01ab21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f26d expref: 10 pid: 7257 timeout: 742 lvb_type: 1 00010000:00010000:0.0:1746144663.726287:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.726288:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.726293:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.726300:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.726322:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.726330:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cefad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747521024:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144663.726382:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.729066:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.729180:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cefad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747521024:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144663.729203:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.729239:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746750848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3019us (3355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.729249:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5995 00000100:00100000:1.0:1746144663.729369:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746751104 00000100:00100000:1.0:1746144663.729376:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746751104 00002000:00100000:1.0:1746144663.729414:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (110592->114687) req@ffff88012cefb100 x1830964746751104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.729422:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb100 with x1830964746751104 ext(110592->114687) 00002000:00010000:1.0:1746144663.729426:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefb100 00000100:00100000:1.0:1746144663.729448:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4609 00000100:00100000:1.0:1746144663.729454:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746751104:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.729609:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746751104:12345-192.168.204.23@tcp:3:cat.0 Request processed in 155us (582us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144663.729615:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4609 00002000:00100000:1.0:1746144663.729619:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (110592->114687) req@ffff88012cefb100 x1830964746751104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.729625:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb100 with x1830964746751104 ext(110592->114687) 00002000:00010000:1.0:1746144663.729628:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefb100 00000100:00100000:3.0:1746144663.731206:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747520896:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144663.731226:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.731266:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746750464:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7482us (7746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.731275:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5994 00000100:00100000:0.0:1746144663.732465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.732709:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746751360 00000100:00100000:2.0:1746144663.732717:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746751360 00002000:00100000:2.0:1746144663.732755:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3665920->3670015) req@ffff88012cefad80 x1830964746751360/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.732766:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefad80 with x1830964746751360 ext(3665920->3670015) 00002000:00010000:2.0:1746144663.732771:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefad80 00000100:00100000:2.0:1746144663.732786:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4610 00000100:00100000:2.0:1746144663.732792:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746751360:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144663.732940:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746751360:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 147us (478us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144663.732945:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4610 00002000:00100000:2.0:1746144663.732950:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3665920->3670015) req@ffff88012cefad80 x1830964746751360/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.732963:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefad80 with x1830964746751360 ext(3665920->3670015) 00002000:00010000:2.0:1746144663.732965:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefad80 00000100:00100000:0.0:1746144663.738914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.739753:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746750720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15409us (15537us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.739765:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4608 00002000:00100000:2.0:1746144663.739778:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ad180 x1830964746750720/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.739787:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad180 with x1830964746750720 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.739793:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ad180 00000100:00100000:3.0:1746144663.739896:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746751488 00000100:00100000:3.0:1746144663.739905:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746751488 00000100:00100000:3.0:1746144663.739941:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12003 00000100:00100000:3.0:1746144663.739947:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:29258:x1830964746751488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.739964:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.739982:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2f2 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.740009:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.740011:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.740017:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.740042:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.740053:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8000, rc 0) 00000100:00100000:3.0:1746144663.740072:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:29258:x1830964746751488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 125us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.740077:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12003 00000100:00100000:0.0:1746144663.740370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.740431:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746751616 00000100:00100000:3.0:1746144663.740434:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746751616 00000100:00100000:3.0:1746144663.740470:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10137 00000100:00100000:3.0:1746144663.740476:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29260:x1830964746751616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.740490:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.740502:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8200/0xa7c849b16e01ac5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f2f9 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.740559:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740569:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740578:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740591:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740596:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740602:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740705:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740714:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740719:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144663.740751:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144663.740756:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144663.740769:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740777:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740783:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740789:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740795:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740800:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7f8c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144663.740804:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740811:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740820:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144663.740823:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144663.740827:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740832:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01ac63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740844:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740850:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740854:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740858:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7f8600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144663.740860:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740864:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740870:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f204f00) 00010000:00010000:3.0:1746144663.740872:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144663.740873:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740877:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8600/0xa7c849b16e01ac6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.740899:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8200/0xa7c849b16e01ac5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.740908:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.740913:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.740915:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144663.740917:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8800, rc 0) 00000100:00100000:3.0:1746144663.740938:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29260:x1830964746751616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 463us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.740943:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10137 00000100:00100000:0.0:1746144663.741451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.741477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.741801:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746752000 00000100:00100000:2.0:1746144663.741805:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746752000 00002000:00100000:2.0:1746144663.741835:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3866624->3870719) req@ffff88012cefaa00 x1830964746752000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.741845:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefaa00 with x1830964746752000 ext(3866624->3870719) 00002000:00010000:2.0:1746144663.741849:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefaa00 00000100:00100000:2.0:1746144663.741862:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746752128 00000100:00100000:2.0:1746144663.741865:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746752128 00002000:00100000:2.0:1746144663.741875:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (487424->491519) req@ffff88012cefa680 x1830964746752128/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.741881:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefa680 with x1830964746752128 ext(487424->491519) 00002000:00010000:2.0:1746144663.741885:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefa680 00000100:00100000:2.0:1746144663.741895:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4611 00000100:00100000:2.0:1746144663.741900:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746752000:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144663.742057:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746752000:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 155us (605us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144663.742062:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4611 00002000:00100000:2.0:1746144663.742067:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3866624->3870719) req@ffff88012cefaa00 x1830964746752000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.742073:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefaa00 with x1830964746752000 ext(3866624->3870719) 00002000:00010000:2.0:1746144663.742075:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefaa00 00000100:00100000:2.0:1746144663.742087:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4612 00000100:00100000:2.0:1746144663.742091:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746752128:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.743254:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746752128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 1157us (1771us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144663.743261:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4612 00002000:00100000:2.0:1746144663.743267:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (487424->491519) req@ffff88012cefa680 x1830964746752128/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/4536 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.743274:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefa680 with x1830964746752128 ext(487424->491519) 00002000:00010000:2.0:1746144663.743277:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cefa680 00000100:00100000:0.0:1746144663.744912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.745000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.745086:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746752384 00000100:00100000:2.0:1746144663.745096:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746752384 00002000:00100000:2.0:1746144663.745170:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cef8000 x1830964746752384/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.745179:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8000 with x1830964746752384 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.745184:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8000 00000100:00100000:2.0:1746144663.745207:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4613 00000100:00100000:2.0:1746144663.745214:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746752384:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144663.745635:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746752512 00000100:00100000:3.0:1746144663.745640:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746752512 00000100:00100000:3.0:1746144663.745666:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12004 00000100:00100000:3.0:1746144663.745671:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29259:x1830964746752512:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.745682:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.745701:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f300 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.745724:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.745726:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.745734:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.745748:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.745758:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008be70e00, rc 0) 00000100:00100000:3.0:1746144663.745813:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29259:x1830964746752512:12345-192.168.204.23@tcp:101:cat.0 Request processed in 142us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.745819:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12004 00000100:00100000:1.0:1746144663.746316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.746369:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746752640 00000100:00100000:3.0:1746144663.746372:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746752640 00000100:00100000:3.0:1746144663.746393:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12005 00000100:00100000:3.0:1746144663.746397:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746752640:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.746406:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.746416:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093851400/0xa7c849b16e01ac7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f307 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.746634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.746680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.746720:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747521152:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144663.746773:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.746899:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746753024 00000100:00100000:0.0:1746144663.746904:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746753024 00000100:00100000:0.0:1746144663.746925:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12006 00000100:00100000:0.0:1746144663.746929:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746753024:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144663.746935:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.746943:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4cec200/0xa7c849b16e01ac86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f30e expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.746966:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747521280:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144663.746987:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.747300:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746752896 00000100:00100000:3.0:1746144663.747304:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746752896 00000100:00100000:3.0:1746144663.747327:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4101 00000100:00100000:3.0:1746144663.747332:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29253:x1830964746752896:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144663.748241:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29253:x1830964746752896:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 906us (1604us total) trans 8589944027 rc 0/0 00000100:00100000:3.0:1746144663.748247:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4101 00000100:00100000:0.0:1746144663.751674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.751718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.752212:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746753280 00000100:00100000:3.0:1746144663.752221:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746753280 00000100:00100000:1.0:1746144663.752295:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746753536 00000100:00100000:1.0:1746144663.752298:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746753536 00002000:00100000:1.0:1746144663.752331:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880136958e00 x1830964746753536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.752340:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958e00 with x1830964746753536 ext(1048576->2097151) 00002000:00010000:1.0:1746144663.752346:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136958e00 00000100:00100000:1.0:1746144663.752363:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4614 00000100:00100000:1.0:1746144663.752370:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746753536:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144663.752873:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747521280:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144663.752908:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4cec200/0xa7c849b16e01ac86 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f30e expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.752921:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4cec200/0xa7c849b16e01ac86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f30e expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.752936:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4cec200, rc 0) 00000100:00100000:0.0:1746144663.753131:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746753024:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6199us (6448us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144663.753157:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12006 00000100:00100000:2.0:1746144663.755323:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747521152:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144663.755358:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093851400/0xa7c849b16e01ac7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f307 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.755371:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093851400/0xa7c849b16e01ac7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f307 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.755386:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093851400, rc 0) 00000100:00100000:2.0:1746144663.755425:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746752640:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9026us (9108us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.755432:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12005 00000100:00100000:2.0:1746144663.755760:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746752384:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10545us (10854us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.755768:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4613 00002000:00100000:2.0:1746144663.755784:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cef8000 x1830964746752384/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.755794:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8000 with x1830964746752384 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.755799:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8000 00000100:00100000:3.0:1746144663.755994:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4102 00000100:00100000:3.0:1746144663.756007:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29256:x1830964746753280:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144663.756211:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:29256:x1830964746753280:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 207us (4546us total) trans 8589944028 rc 0/0 00000100:00100000:3.0:1746144663.756220:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4102 00000100:00100000:1.0:1746144663.763291:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746753536:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10908us (11560us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.763304:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4614 00002000:00100000:1.0:1746144663.763318:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880136958e00 x1830964746753536/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.763327:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958e00 with x1830964746753536 ext(1048576->2097151) 00002000:00010000:1.0:1746144663.763333:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136958e00 00000100:00100000:2.0:1746144663.763767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.763802:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746753664 00000100:00100000:2.0:1746144663.763811:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746753664 00000100:00100000:2.0:1746144663.763858:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12007 00000100:00100000:2.0:1746144663.763865:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:29258:x1830964746753664:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.763883:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.763905:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f315 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.763931:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.763932:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.763940:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.763955:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.763965:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1252a00, rc 0) 00000100:00100000:2.0:1746144663.763985:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:29258:x1830964746753664:12345-192.168.204.23@tcp:101:cat.0 Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.763990:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12007 00000100:00100000:3.0:1746144663.764038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.764804:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746753920 00000100:00100000:0.0:1746144663.764809:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746753920 00000100:00100000:0.0:1746144663.764844:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10138 00000100:00100000:0.0:1746144663.764849:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29260:x1830964746753920:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144663.764859:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.765666:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cece00/0xa7c849b16e01ac94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f31c expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.765772:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.765786:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.765793:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.765821:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.765833:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 8 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:0.0:1746144663.765845:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747521408:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.765930:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.770492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.771632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.772004:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747521408:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.772021:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746754176 00000100:00100000:1.0:1746144663.772041:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746754176 00010000:00010000:2.0:1746144663.772048:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00002000:00100000:1.0:1746144663.772090:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88013695ad80 x1830964746754176/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.772100:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695ad80 with x1830964746754176 ext(1048576->2097151) 00002000:00010000:1.0:1746144663.772105:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695ad80 00000100:00100000:1.0:1746144663.772148:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4615 00000100:00100000:1.0:1746144663.772155:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746754176:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144663.772412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.772446:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746754432 00000100:00100000:2.0:1746144663.772449:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746754432 00010000:00010000:2.0:1746144663.772467:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 9 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.772489:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5996 00000100:00100000:2.0:1746144663.772494:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a44ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746754432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.772506:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.772511:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 9 pid: 14710 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.772520:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 9 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.772538:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746754304 00010000:00010000:2.0:1746144663.772540:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ac71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f9 expref: 9 pid: 14710 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.772542:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746754304 00010000:00010000:2.0:1746144663.772556:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.772560:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.772568:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144663.772570:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12008 00000100:00100000:3.0:1746144663.772575:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29259:x1830964746754304:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.772584:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.772600:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f323 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.772619:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.772621:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.772629:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 42 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.772642:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 42 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.772652:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8600, rc 0) 00010000:00010000:2.0:1746144663.772657:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.772676:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.772691:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29259:x1830964746754304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 116us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.772694:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a44ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746754432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 200us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.772697:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12008 00000100:00100000:2.0:1746144663.772701:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5996 00010000:00010000:2.0:1746144663.772760:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.772767:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144663.772783:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144663.773732:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4cece00/0xa7c849b16e01ac94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.773745:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.773751:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.773754:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144663.773756:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ced600, rc 0) 00000100:00100000:2.0:1746144663.773784:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746753920:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 8934us (9755us total) trans 8589944029 rc 0/0 00000100:00100000:2.0:1746144663.773789:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10138 00000100:00100000:0.0:1746144663.779122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.779193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.779404:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746754816 00000100:00100000:2.0:1746144663.779414:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746754816 00002000:00100000:2.0:1746144663.779458:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88013695aa00 x1830964746754816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.779468:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695aa00 with x1830964746754816 ext(1048576->2097151) 00002000:00010000:2.0:1746144663.779474:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695aa00 00000100:00100000:2.0:1746144663.779495:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4616 00000100:00100000:2.0:1746144663.779501:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746754816:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.781230:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746754560 00000100:00100000:3.0:1746144663.781239:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746754560 00000100:00100000:3.0:1746144663.781277:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10139 00000100:00100000:3.0:1746144663.781283:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746754560:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.781305:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.781324:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8200/0xa7c849b16e01acb0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f32a expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.781400:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.781415:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.781422:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.781451:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.781462:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 9 pid: 20319 timeout: 742 lvb_type: 0 00000100:00100000:3.0:1746144663.781474:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747521536:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.781564:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.789119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.789230:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747521536:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.789258:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144663.789405:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746754176:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 17248us (18921us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.789419:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4615 00002000:00100000:1.0:1746144663.789430:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88013695ad80 x1830964746754176/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.789439:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695ad80 with x1830964746754176 ext(1048576->2097151) 00002000:00010000:1.0:1746144663.789444:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695ad80 00000100:00100000:2.0:1746144663.789453:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746754944 00000100:00100000:2.0:1746144663.789461:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746754944 00010000:00010000:2.0:1746144663.789490:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 10 pid: 20319 timeout: 742 lvb_type: 0 00000100:00100000:2.0:1746144663.789514:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5997 00000100:00100000:2.0:1746144663.789520:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746754944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.789533:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.789539:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 10 pid: 20319 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.789548:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 10 pid: 20319 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.789569:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ced600/0xa7c849b16e01ac9b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f31c expref: 10 pid: 20319 timeout: 742 lvb_type: 0 00010000:00010000:2.0:1746144663.789585:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.789589:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.789598:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.789604:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.789617:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.789645:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746754944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 125us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.789650:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5997 00010000:00010000:3.0:1746144663.789908:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.789915:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144663.790401:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:3.0:1746144663.790406:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144663.790423:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.790454:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8200/0xa7c849b16e01acb0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f32a expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.790479:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f32a expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.790486:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.790488:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144663.790490:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8c00, rc 0) 00000100:00100000:3.0:1746144663.790514:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746754560:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9232us (11403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.790521:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10139 00000100:00100000:0.0:1746144663.795876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.795944:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746754816:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16440us (16748us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144663.795960:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4616 00002000:00100000:3.0:1746144663.795971:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88013695aa00 x1830964746754816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.795980:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695aa00 with x1830964746754816 ext(1048576->2097151) 00002000:00010000:3.0:1746144663.795986:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695aa00 00000100:00100000:2.0:1746144663.796247:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746755072 00000100:00100000:2.0:1746144663.796256:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746755072 00000100:00100000:2.0:1746144663.796291:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12009 00000100:00100000:2.0:1746144663.796298:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746755072:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.796313:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.796332:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e01acbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f331 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.796385:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747521664:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144663.796448:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929e3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144663.796475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.796491:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746755200 00000100:00100000:0.0:1746144663.796495:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746755200 00000100:00100000:0.0:1746144663.796516:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12010 00000100:00100000:0.0:1746144663.796521:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746755200:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144663.796527:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.796534:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c90ca00/0xa7c849b16e01acc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f338 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.796557:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747521792:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144663.796578:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.797950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.798049:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746755456 00000100:00100000:3.0:1746144663.798055:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746755456 00002000:00100000:3.0:1746144663.798089:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136959c00 x1830964746755456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.798098:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959c00 with x1830964746755456 ext(2097152->3145727) 00002000:00010000:3.0:1746144663.798102:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959c00 00000100:00100000:3.0:1746144663.798131:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4617 00000100:00100000:3.0:1746144663.798158:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746755456:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.802227:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747521664:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144663.802265:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e01acbe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f331 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.802279:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252000/0xa7c849b16e01acbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f331 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.802290:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1252000, rc 0) 00000100:00100000:2.0:1746144663.802324:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746755072:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6024us (6457us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.802333:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12009 00000100:00100000:0.0:1746144663.802603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.802608:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747521792:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144663.802626:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c90ca00/0xa7c849b16e01acc5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f338 expref: 10 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.802636:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c90ca00/0xa7c849b16e01acc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f338 expref: 10 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.802643:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c90ca00, rc 0) 00000100:00100000:2.0:1746144663.802660:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746755200:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6139us (6186us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.802668:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12010 00000100:00100000:2.0:1746144663.803163:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746755584 00000100:00100000:2.0:1746144663.803170:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746755584 00000100:00100000:2.0:1746144663.803204:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12011 00000100:00100000:2.0:1746144663.803211:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746755584:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144663.803213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144663.803227:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.803240:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a1252200/0xa7c849b16e01accc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f33f expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.803283:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747521920:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144663.803330:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929e3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144663.803864:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746755712 00000100:00100000:1.0:1746144663.803869:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746755712 00000100:00100000:1.0:1746144663.803898:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12012 00000100:00100000:1.0:1746144663.803903:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746755712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.803911:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.803922:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f346 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.803934:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.803936:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.803945:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 20 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.803961:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 20 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.803969:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f106000, rc 0) 00000100:00100000:1.0:1746144663.803994:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746755712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 91us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.803998:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12012 00000100:00100000:0.0:1746144663.812357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.812654:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746755968 00000100:00100000:3.0:1746144663.812664:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746755968 00000100:00100000:3.0:1746144663.812712:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10140 00000100:00100000:3.0:1746144663.812720:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746755968:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144663.812743:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.812764:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8200/0xa7c849b16e01acda lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f34d expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.812935:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746755456:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14776us (14988us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.812945:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4617 00002000:00100000:2.0:1746144663.812954:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880136959c00 x1830964746755456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.812962:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959c00 with x1830964746755456 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.812968:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959c00 00010000:00010000:3.0:1746144663.813039:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.813052:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.813065:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144663.813079:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144663.813573:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8200/0xa7c849b16e01acda lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.813607:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 10 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.813621:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.813624:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144663.813627:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8800, rc 0) 00000100:00100000:3.0:1746144663.813652:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29260:x1830964746755968:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 933us (1308us total) trans 8589944030 rc 0/0 00000100:00100000:3.0:1746144663.813658:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10140 00000100:00100000:2.0:1746144663.814286:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747521920:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144663.814315:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252200/0xa7c849b16e01accc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f33f expref: 43 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.814325:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252200/0xa7c849b16e01accc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f33f expref: 43 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.814341:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1252200, rc 0) 00000100:00100000:2.0:1746144663.815374:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746755584:12345-192.168.204.23@tcp:101:cat.0 Request processed in 12157us (12766us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144663.815382:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12011 00000100:00100000:1.0:1746144663.820237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.820280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.820309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.820322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.820345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.820347:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756096 00000100:00100000:2.0:1746144663.820357:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756096 00000100:00100000:1.0:1746144663.820359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.820395:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756224 00000100:00100000:2.0:1746144663.820397:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756224 00000100:00100000:2.0:1746144663.820409:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756480 00000100:00100000:2.0:1746144663.820410:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756480 00000100:00100000:2.0:1746144663.820421:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756736 00000100:00100000:2.0:1746144663.820423:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756736 00000100:00100000:2.0:1746144663.820431:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756352 00000100:00100000:2.0:1746144663.820432:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756352 00000100:00100000:2.0:1746144663.820452:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12013 00000100:00100000:2.0:1746144663.820460:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746756096:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144663.820505:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820523:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820530:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144663.820532:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144663.820535:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820565:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 41 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820577:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 41 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.820589:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747522048:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.820664:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929e3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.820684:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12014 00000100:00100000:2.0:1746144663.820690:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:29258:x1830964746756224:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.820700:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.820712:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f354 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820725:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.820727:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.820733:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820745:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.820754:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093850c00, rc 0) 00000100:00100000:2.0:1746144663.820775:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:29258:x1830964746756224:12345-192.168.204.23@tcp:101:cat.0 Request processed in 85us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.820780:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12014 00000100:00100000:2.0:1746144663.820795:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12015 00000100:00100000:2.0:1746144663.820799:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746756480:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:3.0:1746144663.820885:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12016 00000100:00100000:3.0:1746144663.820894:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746756736:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:0.0:1746144663.820914:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12017 00010000:00010000:3.0:1746144663.820915:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.820923:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746756352:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:3.0:1746144663.820926:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.820932:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.820934:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144663.820936:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.820939:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.820950:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.820951:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.820958:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.820959:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 26 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.820965:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 20 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.820967:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747522176:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.820967:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756608 00000100:00100000:1.0:1746144663.820970:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756608 00010000:00010000:0.0:1746144663.820971:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.820972:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.820975:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.820989:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12018 00000100:00100000:3.0:1746144663.820991:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746144663.820991:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 20 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.820994:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746756608:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144663.821000:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 20 pid: 4760 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.821008:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747522304:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.821010:0:8388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821020:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.821037:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 41 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821044:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.821048:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821049:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.821050:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.821052:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.821057:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 19 pid: 4760 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.821065:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747522432:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.821066:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821072:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 26 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144663.821079:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747522560:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.821089:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.821096:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 12 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.821103:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 41 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.821108:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747522688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.821110:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 41 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144663.821117:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747522816:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.821122:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf00c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144663.821152:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 11 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.821163:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 11 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144663.821169:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747522944:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.821169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.821182:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756864 00000100:00100000:0.0:1746144663.821185:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756864 00000100:00100000:1.0:1746144663.821193:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b60bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.821201:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12019 00000100:00100000:0.0:1746144663.821206:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746756864:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144663.821220:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.821266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.821279:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746756992 00000100:00100000:1.0:1746144663.821282:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746756992 00000100:00100000:1.0:1746144663.821298:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12020 00000100:00100000:1.0:1746144663.821303:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29259:x1830964746756992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.821311:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.821317:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f35b expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821328:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144663.821331:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821337:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144663.821340:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821350:0:4760:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821359:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.821367:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bba00, rc 0) 00000100:00100000:1.0:1746144663.821380:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29259:x1830964746756992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 76us (114us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144663.821383:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144663.821384:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12020 00010000:00010000:0.0:1746144663.821390:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.821397:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.821402:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.821403:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.821405:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.821421:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 19 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.821433:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 19 pid: 10724 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144663.821440:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747523072:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.821468:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.821475:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 20 pid: 8451 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.821482:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747523200:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.821503:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.821510:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 13 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144663.821517:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747523328:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.821570:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.821580:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.821587:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.821593:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.821598:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.821599:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.821601:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.821617:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.821624:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.822191:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747523456:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.822243:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.822256:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.822264:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747523584:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.822302:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0480 going to sleep for 11 seconds 00010000:00010000:2.0:1746144663.822646:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 13 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.822654:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 13 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144663.822663:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747523712:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.823233:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.824263:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747522048:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.824288:0:30345:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.826175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.826186:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747522176:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.826211:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.826957:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757120 00000100:00100000:2.0:1746144663.826966:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757120 00002000:00100000:2.0:1746144663.827017:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (110592->491519) req@ffff88009f39bb80 x1830964746757120/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.827035:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39bb80 with x1830964746757120 ext(110592->491519) 00010000:00010000:2.0:1746144663.827044:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 43 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.827061:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 43 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746144663.827067:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f39bb80 00000100:00100000:1.0:1746144663.829544:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747522304:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.829559:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747522432:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.829707:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 916 00000100:00100000:2.0:1746144663.829722:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1961:x1830964746757120:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144663.830546:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747522560:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.830556:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747522816:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.830565:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747522944:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.830593:0:8388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.832513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.832552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.832584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.832600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.832622:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757376 00000100:00100000:0.0:1746144663.832630:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757376 00010000:00010000:0.0:1746144663.832671:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 20 pid: 4760 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.832697:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757888 00000100:00100000:0.0:1746144663.832699:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757888 00010000:00010000:0.0:1746144663.832710:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 21 pid: 4760 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.832723:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757504 00000100:00100000:0.0:1746144663.832724:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757504 00010000:00010000:0.0:1746144663.832733:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 14 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144663.832744:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5998 00000100:00100000:0.0:1746144663.832750:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746757376:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.832767:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.832793:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 20 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.832804:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 20 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.832826:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b52c000/0xa7c849b16e01ac39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2d6 expref: 20 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.832847:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.832885:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746757376:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 135us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.832892:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5998 00000100:00100000:0.0:1746144663.832906:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5999 00000100:00100000:0.0:1746144663.832910:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746757888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.832919:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.832926:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 21 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.832934:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 21 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.832944:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e254e00/0xa7c849b16e01ac24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c1 expref: 21 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.832953:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.832966:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746757888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 55us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.832971:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5999 00000100:00100000:0.0:1746144663.832982:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6000 00000100:00100000:0.0:1746144663.832987:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746757504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.832994:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.833000:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 14 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:0.0:1746144663.833007:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 14 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:0.0:1746144663.833018:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.833020:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.833025:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.833045:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.833062:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144663.833077:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746757504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 90us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.833081:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6000 00000100:00100000:0.0:1746144663.833168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.833181:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758016 00000100:00100000:0.0:1746144663.833184:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758016 00010000:00010000:0.0:1746144663.833196:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 45 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.833206:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6001 00000100:00100000:0.0:1746144663.833210:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746758016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144663.833217:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144663.833229:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 45 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.833236:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 45 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.833255:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01aca2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f323 expref: 45 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.833265:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144663.833290:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01aafe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f258 expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144663.833307:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747522688:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.833329:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833338:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833343:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833509:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833518:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833530:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833537:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c90d800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144663.833540:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833548:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833559:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.833564:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c90d800/0xa7c849b16e01ad04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.833653:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757248 00000100:00100000:1.0:1746144663.833658:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757248 00002000:00100000:1.0:1746144663.833686:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3665920->3870719) req@ffff88009f39a680 x1830964746757248/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.833695:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39a680 with x1830964746757248 ext(3665920->3870719) 00010000:00010000:1.0:1746144663.833701:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 27 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.833711:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 27 pid: 8450 timeout: 743 lvb_type: 0 00002000:00010000:1.0:1746144663.833722:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f39a680 00000100:00100000:1.0:1746144663.833735:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 917 00000100:00100000:1.0:1746144663.833740:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746757248:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144663.833972:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746758016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 759us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.833978:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6001 00000100:00100000:2.0:1746144663.834454:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746756352:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 13523us (14098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.834464:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12017 00000100:00100000:2.0:1746144663.836591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.836631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.836678:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757632 00000100:00100000:1.0:1746144663.836688:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757632 00000100:00100000:2.0:1746144663.836708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144663.836722:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 29 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.836735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.836740:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747523456:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.836752:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747523584:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144663.836756:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746757760 00000100:00100000:1.0:1746144663.836759:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746757760 00000100:00100000:2.0:1746144663.836761:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758400 00000100:00100000:3.0:1746144663.836762:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747523712:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.836768:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758400 00010000:00010000:1.0:1746144663.836771:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144663.836786:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6002 00010000:00010000:3.0:1746144663.836790:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.836792:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746757632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.836796:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 19 pid: 10724 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.836804:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144663.836815:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6003 00000100:00100000:3.0:1746144663.836821:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a44bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746757760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144663.836824:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6004 00010000:00010000:1.0:1746144663.836825:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 29 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.836829:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144663.836831:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746758400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.836835:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 29 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.836843:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.836847:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.836856:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a1252a00/0xa7c849b16e01ac8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f315 expref: 29 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.836857:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144663.836862:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 19 pid: 10724 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144663.836869:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1a00/0xa7c849b16e01ab05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f266 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144663.836872:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 19 pid: 10724 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.836880:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.836882:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.836886:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.836892:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.836894:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.836903:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.836912:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.836925:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746758400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 94us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.836929:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a44bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746757760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.836931:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6004 00000100:00100000:1.0:1746144663.836931:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746757632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.836935:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6003 00000100:00100000:1.0:1746144663.836939:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6002 00000100:00100000:2.0:1746144663.836963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144663.836968:0:8388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.836976:0:8388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.836980:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758656 00000100:00100000:3.0:1746144663.836983:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758656 00010000:00010000:1.0:1746144663.836992:0:8388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.836995:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.836995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144663.837000:0:8388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.837003:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758528 00000100:00100000:2.0:1746144663.837006:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758528 00010000:00010000:1.0:1746144663.837006:0:8388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.837007:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6005 00000100:00100000:3.0:1746144663.837011:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746758656:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.837016:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.837016:0:8388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f106400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144663.837018:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.837020:0:8388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.837039:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6006 00010000:00010000:1.0:1746144663.837040:0:8388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.837043:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.837044:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746758528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.837049:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.837051:0:8388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.837052:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.837055:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.837056:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f106400/0xa7c849b16e01ad0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.837063:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144663.837064:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8000/0xa7c849b16e01ac55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2f2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.837073:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.837075:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.837086:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746758528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.837090:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6006 00000100:00100000:3.0:1746144663.837092:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746758656:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 80us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.837097:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6005 00000100:00100000:1.0:1746144663.837097:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746756608:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 16102us (16737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.837105:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12018 00000100:00100000:2.0:1746144663.837125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.837151:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758784 00000100:00100000:1.0:1746144663.837155:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758784 00010000:00010000:1.0:1746144663.837167:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.837181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.837200:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758912 00000100:00100000:1.0:1746144663.837203:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758912 00010000:00010000:1.0:1746144663.837212:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144663.837225:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6007 00000100:00100000:1.0:1746144663.837230:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746758784:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.837237:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.837244:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.837252:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.837264:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008be70e00/0xa7c849b16e01ac78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f300 expref: 19 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.837272:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144663.837304:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746758784:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.837310:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6007 00000100:00100000:1.0:1746144663.837320:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6008 00000100:00100000:1.0:1746144663.837325:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746758912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.837331:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.837338:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.837346:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.837355:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0800/0xa7c849b16e01ab1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f25f expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144663.837368:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.837369:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.837371:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.837377:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.837390:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144663.837403:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746758912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.837408:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6008 00010000:00010000:0.0:1746144663.838205:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f106000/0xa7c849b16e01acd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f346 expref: 17 pid: 10724 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144663.838217:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747523072:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.838232:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747523200:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.838242:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fff0600/0xa7c849b16e01ab0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f274 expref: 10 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144663.838249:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747523328:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.838270:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.838291:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746758272 00000100:00100000:0.0:1746144663.838294:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746758272 00002000:00100000:0.0:1746144663.838323:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800920af100 x1830964746758272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.838332:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af100 with x1830964746758272 ext(2097152->3145727) 00010000:00010000:0.0:1746144663.838339:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.838349:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746144663.838355:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920af100 00000100:00100000:0.0:1746144663.838370:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 918 00000100:00100000:0.0:1746144663.838376:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746758272:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:3.0:1746144663.838714:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838726:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838743:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838750:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838760:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838766:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a1252400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144663.838770:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838775:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838785:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.838790:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1252400/0xa7c849b16e01ad20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.838840:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746756480:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 18039us (18528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.838848:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12015 00000100:00100000:1.0:1746144663.839880:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746757248:12345-192.168.204.23@tcp:4:cat.0 Request processed in 6131us (7286us total) trans 17179873303 rc 0/0 00000100:00100000:1.0:1746144663.839890:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 917 00002000:00100000:1.0:1746144663.839900:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3665920->3870719) req@ffff88009f39a680 x1830964746757248/t17179873303(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.839909:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39a680 with x1830964746757248 ext(3665920->3870719) 00010000:00010000:1.0:1746144663.839917:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 28 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.839928:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 28 pid: 8450 timeout: 743 lvb_type: 0 00002000:00010000:1.0:1746144663.839934:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f39a680 00000100:00100000:0.0:1746144663.843862:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746757120:12345-192.168.204.23@tcp:4:cat.0 Request processed in 14132us (17681us total) trans 17179873304 rc 0/0 00000100:00100000:0.0:1746144663.843876:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 916 00002000:00100000:0.0:1746144663.843888:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (110592->491519) req@ffff88009f39bb80 x1830964746757120/t17179873304(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/448 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.843897:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39bb80 with x1830964746757120 ext(110592->491519) 00010000:00010000:0.0:1746144663.843907:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144663.843920:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746144663.843927:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f39bb80 00000100:00100000:2.0:1746144663.847610:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746758272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9221us (10887us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.847623:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 918 00002000:00100000:2.0:1746144663.847635:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800920af100 x1830964746758272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.847644:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920af100 with x1830964746758272 ext(2097152->3145727) 00010000:00010000:2.0:1746144663.847654:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.847667:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746144663.847674:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800920af100 00000100:00100000:0.0:1746144663.847748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.847838:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746759040 00000100:00100000:2.0:1746144663.847846:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746759040 00010000:00010000:2.0:1746144663.847875:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 28 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.847900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.848014:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746759168 00000100:00100000:2.0:1746144663.848017:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746759168 00010000:00010000:2.0:1746144663.848040:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.848055:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6009 00000100:00100000:2.0:1746144663.848061:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746759040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144663.848064:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6010 00000100:00100000:1.0:1746144663.848073:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1960:x1830964746759168:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.848074:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.848082:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.848096:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 28 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.848096:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.848106:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 28 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.848106:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.848126:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093850600/0xa7c849b16e01ac4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3665920->3870719) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2eb expref: 28 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.848126:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7eac00/0xa7c849b16e01ac47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 110592->491519) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2e4 expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.848156:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.848158:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.848163:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.848166:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.848168:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.848172:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.848172:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.848178:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.848195:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144663.848195:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.848221:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746759040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 159us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.848227:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6009 00010000:00010000:0.0:1746144663.848239:0:30345:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848252:0:30345:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848273:0:30345:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848280:0:30345:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848287:0:30345:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848294:0:30345:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c30f600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144663.848297:0:30345:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848305:0:30345:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848315:0:30345:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.848320:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c30f600/0xa7c849b16e01acef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848345:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848352:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848372:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848378:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848384:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848388:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7f8400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144663.848391:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848397:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848406:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.848407:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.848412:0:8450:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.848424:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.848459:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746759168:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 388us (559us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144663.848460:0:8450:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.848466:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6010 00000100:00100000:3.0:1746144663.848472:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747523840:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144663.848527:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144663.848554:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746756096:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 28094us (28327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.848562:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12013 00000100:00100000:3.0:1746144663.851188:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747523840:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144663.851215:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.851224:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8400/0xa7c849b16e01acfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.851289:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746756736:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 30395us (30964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.851299:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12016 00000100:00100000:0.0:1746144663.854663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.855734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.855876:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746759424 00000100:00100000:2.0:1746144663.855885:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746759424 00002000:00100000:2.0:1746144663.855932:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f399180 x1830964746759424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.855942:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399180 with x1830964746759424 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.855947:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f399180 00000100:00100000:2.0:1746144663.855966:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4618 00000100:00100000:2.0:1746144663.855973:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746759424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144663.856607:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746759552 00000100:00100000:3.0:1746144663.856612:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746759552 00000100:00100000:3.0:1746144663.856647:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12021 00000100:00100000:3.0:1746144663.856652:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:29258:x1830964746759552:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.856662:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.856680:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f362 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.856703:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.856705:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.856712:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.856726:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.856736:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5e600, rc 0) 00000100:00100000:3.0:1746144663.856785:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:29258:x1830964746759552:12345-192.168.204.23@tcp:101:cat.0 Request processed in 131us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.856791:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12021 00000100:00100000:1.0:1746144663.864986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.865620:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746759680 00000100:00100000:2.0:1746144663.865630:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746759680 00010000:00010000:2.0:1746144663.865671:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144663.865691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.865705:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6011 00000100:00100000:2.0:1746144663.865711:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746759680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.865723:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144663.865725:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746759936 00000100:00100000:0.0:1746144663.865730:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746759936 00010000:00010000:2.0:1746144663.865746:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.865756:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00002000:00100000:0.0:1746144663.865763:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800943f8e00 x1830964746759936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.865772:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8e00 with x1830964746759936 ext(3145728->4194303) 00010000:00010000:2.0:1746144663.865775:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093850c00/0xa7c849b16e01acf6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f354 expref: 19 pid: 8451 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746144663.865777:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f8e00 00010000:00010000:2.0:1746144663.865791:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.865793:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.865797:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.865803:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.865805:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4619 00000100:00100000:0.0:1746144663.865810:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746759936:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:2.0:1746144663.865828:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144663.865834:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.865842:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.865862:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.865870:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.865875:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746759680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 163us (900us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144663.865877:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144663.865880:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6011 00010000:00010000:0.0:1746144663.865887:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4079200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144663.865891:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.865897:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.865908:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.865913:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4079200/0xa7c849b16e01ad12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144663.865973:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746756864:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 44766us (44804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.865981:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12019 00000100:00100000:0.0:1746144663.870191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.870253:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746760192 00000100:00100000:3.0:1746144663.870264:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746760192 00000100:00100000:3.0:1746144663.870310:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10141 00000100:00100000:3.0:1746144663.870317:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29260:x1830964746760192:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:3.0:1746144663.870373:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.870400:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8c00/0xa7c849b16e01acb7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f32a expref: 10 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.870417:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.870421:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144663.870450:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.870462:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.870474:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.870480:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 297 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.870486:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.870515:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 297 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.870526:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 297 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144663.870540:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747523968:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.870622:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.870630:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 8 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144663.870638:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747524096:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.870669:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746759424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14695us (16015us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.870679:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4618 00002000:00100000:2.0:1746144663.870691:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009f399180 x1830964746759424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.870700:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399180 with x1830964746759424 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.870704:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f399180 00010000:00010000:3.0:1746144663.871319:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.871328:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 8 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144663.871337:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747524224:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.871359:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.875336:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747523968:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.876181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.876281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.876322:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747524096:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144663.876458:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746760320 00000100:00100000:2.0:1746144663.876466:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746760320 00010000:00010000:2.0:1746144663.876504:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 298 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.876529:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746760448 00000100:00100000:2.0:1746144663.876531:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746760448 00010000:00010000:2.0:1746144663.876540:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.876788:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.877266:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746760576 00000100:00100000:2.0:1746144663.877270:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746760576 00010000:00010000:2.0:1746144663.877285:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 10 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.877301:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6012 00000100:00100000:2.0:1746144663.877307:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1961:x1830964746760320:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144663.877321:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144663.877326:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 298 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.877337:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 298 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.877358:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01ac32 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2cf expref: 298 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144663.877372:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.877377:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.877386:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144663.877539:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6013 00000100:00100000:1.0:1746144663.877546:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746760448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.877555:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.877559:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 10 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.877567:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 10 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.877578:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01ac2b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2c8 expref: 10 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.877597:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.877600:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.877605:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.877689:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6014 00000100:00100000:3.0:1746144663.877698:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746760576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.877714:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.877719:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 9 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.877728:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 9 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.877739:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.877745:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.877753:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.877759:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144663.877778:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144663.877974:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:1961:x1830964746760320:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 666us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.877982:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6012 00010000:00010000:2.0:1746144663.878050:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c90dc00/0xa7c849b16e01ac1d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f2ba expref: 9 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.878060:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747524224:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144663.878087:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.878094:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144663.878099:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000040:00080000:2.0:1746144663.878744:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2949, 88 off246464 00000004:00080000:2.0:1746144663.878752:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087616890ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878839:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2865, 88 off239064 00000004:00080000:2.0:1746144663.878843:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087708637ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878857:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2866, 88 off239152 00000004:00080000:2.0:1746144663.878859:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087724727ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878867:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2950, 88 off246552 00000004:00080000:2.0:1746144663.878869:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087734694ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878879:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2951, 88 off246640 00000004:00080000:2.0:1746144663.878882:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087747117ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878890:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2867, 88 off239240 00000004:00080000:2.0:1746144663.878893:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087758449ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878898:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2868, 88 off239328 00000004:00080000:2.0:1746144663.878901:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087766097ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878906:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2869, 88 off239416 00000004:00080000:2.0:1746144663.878908:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087773747ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878914:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2952, 88 off246728 00000004:00080000:2.0:1746144663.878916:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087781977ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878925:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2870, 88 off239504 00000004:00080000:2.0:1746144663.878928:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087793727ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878934:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2953, 88 off246816 00000004:00080000:2.0:1746144663.878936:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087801729ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878944:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2871, 88 off239592 00000004:00080000:2.0:1746144663.878946:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087811840ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.878952:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2954, 88 off246904 00000004:00080000:2.0:1746144663.878954:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087819900ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878963:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2955, 88 off246992 00000004:00080000:2.0:1746144663.878966:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087831450ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878974:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2956, 88 off247080 00000004:00080000:2.0:1746144663.878977:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087842257ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878985:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2957, 88 off247168 00000004:00080000:2.0:1746144663.878987:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643087853030ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.878996:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2872, 88 off239680 00000004:00080000:2.0:1746144663.878999:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643087864425ns, next at 593480289301ns, rc = 0 00000100:00100000:1.0:1746144663.880009:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:1962:x1830964746760448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2455us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.880020:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6013 00000100:00100000:0.0:1746144663.880044:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746759936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14229us (14349us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144663.880054:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4619 00002000:00100000:0.0:1746144663.880067:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800943f8e00 x1830964746759936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.880083:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8e00 with x1830964746759936 ext(3145728->4194303) 00002000:00010000:0.0:1746144663.880088:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f8e00 00000100:00100000:0.0:1746144663.880231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.880260:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746760704 00000100:00100000:0.0:1746144663.880268:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746760704 00000100:00100000:0.0:1746144663.880302:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12022 00000100:00100000:0.0:1746144663.880308:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29259:x1830964746760704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144663.880325:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.880343:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f369 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144663.880368:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x1029 00010000:00010000:0.0:1746144663.880389:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.880391:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.880399:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 18 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.881263:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 18 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.881277:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a1252200, rc 0) 00000100:00100000:3.0:1746144663.881913:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+7:1962:x1830964746760576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4212us (5121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.881927:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6014 00000100:00100000:0.0:1746144663.882177:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29259:x1830964746760704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1867us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.882183:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12022 00000100:00100000:0.0:1746144663.897476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.897510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.897572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.897595:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761216 00000100:00100000:0.0:1746144663.897604:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761216 00000100:00100000:0.0:1746144663.897638:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761344 00000100:00100000:0.0:1746144663.897640:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761344 00000100:00100000:0.0:1746144663.897648:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746760960 00000100:00100000:0.0:1746144663.897649:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746760960 00000100:00100000:0.0:1746144663.897661:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10142 00000100:00100000:0.0:1746144663.897668:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29264:x1830964746761216:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144663.897692:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.897709:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01ad3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f377 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.897825:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.897839:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.897850:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.897861:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.897866:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.897871:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144663.897988:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10143 00000100:00100000:0.0:1746144663.897994:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29259:x1830964746761344:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144663.898001:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.898009:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f37e expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.898045:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.898052:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.898068:0:14709:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144663.898081:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.898093:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.898096:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144663.898099:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.898104:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130326200, rc 0) 00000100:00100000:0.0:1746144663.898173:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29259:x1830964746761344:12345-192.168.204.23@tcp:101:cat.0 Request processed in 177us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.898180:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10143 00000100:00100000:0.0:1746144663.898196:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10144 00000100:00100000:0.0:1746144663.898201:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:29266:x1830964746760960:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144663.898213:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.898219:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01ad58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f370 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.898258:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.898265:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.898271:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.898278:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.898282:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.898286:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144663.901170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.901195:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761472 00000100:00100000:2.0:1746144663.901205:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761472 00000100:00100000:2.0:1746144663.901244:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12023 00000100:00100000:2.0:1746144663.901250:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:29258:x1830964746761472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.901265:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.901281:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f385 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.901304:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.901306:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.901313:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 19 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.901326:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 19 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.901335:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e864600, rc 0) 00000100:00100000:2.0:1746144663.901373:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+19:29258:x1830964746761472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 123us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.901378:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12023 00000100:00100000:0.0:1746144663.903301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.903400:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761600 00000100:00100000:2.0:1746144663.903407:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761600 00000100:00100000:2.0:1746144663.903446:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10145 00000100:00100000:2.0:1746144663.903452:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:29258:x1830964746761600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.903496:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.903552:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f38c expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.903608:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.903619:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.903630:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.903632:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.903636:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.903646:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e79be00, rc 0) 00000100:00100000:2.0:1746144663.903676:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+10:29258:x1830964746761600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 223us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.903681:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10145 00000001:00080000:0.0:1746144663.908624:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944031 is committed 00000004:00080000:0.0:1746144663.908635:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2057 committed 00000004:00080000:0.0:1746144663.908643:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2138 committed 00000004:00080000:0.0:1746144663.908649:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2137 committed 00000004:00080000:0.0:1746144663.908651:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2136 committed 00000004:00080000:0.0:1746144663.908653:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2135 committed 00000004:00080000:0.0:1746144663.908656:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2056 committed 00000004:00080000:0.0:1746144663.908657:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2134 committed 00000004:00080000:0.0:1746144663.908659:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2055 committed 00000004:00080000:0.0:1746144663.908661:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2133 committed 00000004:00080000:0.0:1746144663.908663:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2054 committed 00000004:00080000:0.0:1746144663.908665:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2053 committed 00000004:00080000:0.0:1746144663.908666:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2052 committed 00000004:00080000:0.0:1746144663.908668:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2132 committed 00000004:00080000:0.0:1746144663.908669:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2131 committed 00000004:00080000:0.0:1746144663.908671:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2051 committed 00000004:00080000:0.0:1746144663.908672:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2050 committed 00000004:00080000:0.0:1746144663.908674:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2130 committed 00000001:00080000:0.0:1746144663.908688:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944028 is committed 00000001:00080000:0.0:1746144663.908693:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944027 is committed 00000100:00100000:0.0:1746144663.908855:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747524352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.908922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.908957:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747524736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.908975:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.908996:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747524608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.909014:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746144663.909064:0:20319:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f399880 reply state ffff880099413400 transno 8589944031 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144663.909075:0:20319:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746144663.909132:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747524352 00000100:00100000:1.0:1746144663.909154:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747524352 00010000:00010000:0.0:1746144663.909190:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144663.909194:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747524736 00000100:00100000:1.0:1746144663.909196:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747524736 00000100:00100000:1.0:1746144663.909207:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747524608 00010000:00010000:0.0:1746144663.909207:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.909209:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747524608 00010000:00010000:0.0:1746144663.909215:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144663.909227:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12024 00000100:00100000:1.0:1746144663.909235:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3294:x1830964747524352:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746144663.909309:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.909322:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 8 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.909334:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747525376:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144663.909371:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747524480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.909389:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.909397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746144663.909406:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144663.909413:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747524992:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746144663.909413:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144663.909420:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144663.909426:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.909436:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747524480 00000100:00100000:0.0:1746144663.909439:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747524480 00000100:00100000:1.0:1746144663.909444:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747524352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (522us total) trans 17179873305 rc 0/0 00000100:00100000:3.0:1746144663.909448:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747524992 00000100:00100000:3.0:1746144663.909451:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747524992 00000100:00100000:1.0:1746144663.909454:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12024 00000100:00100000:0.0:1746144663.909460:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12025 00000100:00100000:0.0:1746144663.909465:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747524736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.909469:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12026 00000100:00100000:1.0:1746144663.909474:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747524608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144663.909561:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144663.909564:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00000100:00100000:0.0:1746144663.909564:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3293:x1830964747524736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (587us total) trans 17179873306 rc 0/0 00002000:00010000:1.0:1746144663.909566:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.909573:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.909574:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:1.0:1746144663.909599:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3296:x1830964747524608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (583us total) trans 17179873307 rc 0/0 00000100:00100000:3.0:1746144663.909674:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12027 00000100:00100000:0.0:1746144663.909679:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12025 00000100:00100000:3.0:1746144663.909681:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3295:x1830964747524480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.909683:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12026 00000100:00100000:0.0:1746144663.909691:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12028 00000100:00100000:0.0:1746144663.909696:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3295:x1830964747524992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.909784:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3295:x1830964747524992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (356us total) trans 17179873308 rc 0/0 00000100:00100000:0.0:1746144663.909790:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12028 00000004:00080000:0.0:1746144663.909824:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12c380/2, rc 0, transno 17179873306 00000100:00100000:0.0:1746144663.909845:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747524736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.909851:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747525248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144663.909863:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12ca80/2, rc 0, transno 17179873308 00000100:00100000:3.0:1746144663.909867:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747524992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.909870:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144663.909895:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f39b800/2, rc 0, transno 17179873307 00000100:00100000:0.0:1746144663.909898:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747524608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.909903:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747525120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.909905:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830964747524480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (507us total) trans 17179873309 rc 0/0 00000100:00100000:3.0:1746144663.909910:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12027 00000100:00100000:3.0:1746144663.909919:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747525248 00000100:00100000:0.0:1746144663.909919:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144663.909921:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747525248 00000100:00100000:3.0:1746144663.909932:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747525120 00000100:00100000:3.0:1746144663.909933:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747525120 00000100:00100000:0.0:1746144663.909942:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12029 00000100:00100000:0.0:1746144663.909947:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3293:x1830964747525248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.909995:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144663.910001:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747525504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.910022:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.910044:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3293:x1830964747525248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (172us total) trans 17179873310 rc 0/0 00000004:00080000:1.0:1746144663.910055:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12f480/2, rc 0, transno 17179873310 00000100:00100000:1.0:1746144663.910059:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747525248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.910069:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747525504 00000100:00100000:1.0:1746144663.910071:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747525504 00000100:00100000:3.0:1746144663.910097:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12030 00000100:00100000:0.0:1746144663.910101:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12029 00000100:00100000:3.0:1746144663.910103:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747525120:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144663.910122:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f398380/2, rc 0, transno 17179873305 00000100:00100000:0.0:1746144663.910125:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747524352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.910130:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747524864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.910162:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.910180:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747524864 00000100:00100000:0.0:1746144663.910182:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747524864 00000100:00100000:0.0:1746144663.910196:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12031 00000100:00100000:3.0:1746144663.910198:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3296:x1830964747525120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (277us total) trans 17179873311 rc 0/0 00000100:00100000:0.0:1746144663.910200:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3294:x1830964747524864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144663.910203:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12030 00000004:00080000:3.0:1746144663.910225:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f399500/2, rc 0, transno 17179873309 00000100:00100000:3.0:1746144663.910229:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747524480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.910278:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3294:x1830964747524864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (115us total) trans 17179873312 rc 0/0 00000100:00100000:0.0:1746144663.910284:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12031 00000004:00080000:0.0:1746144663.910302:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12f800/2, rc 0, transno 17179873311 00010000:00080000:2.0:1746144663.910303:0:20319:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746144663.910305:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747525120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.910314:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746760192:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 39996us (40132us total) trans 8589944031 rc 0/0 00000100:00100000:2.0:1746144663.910320:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10141 00000004:00080000:0.0:1746144663.910362:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12c000/2, rc 0, transno 17179873312 00000100:00100000:0.0:1746144663.910366:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747524864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.910370:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12032 00000100:00100000:0.0:1746144663.910371:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746144663.910376:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3293:x1830964747525504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.910376:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747525888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910396:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.910405:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747525888 00000100:00100000:2.0:1746144663.910407:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747525888 00000100:00100000:0.0:1746144663.910409:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747526016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.910422:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12033 00000100:00100000:0.0:1746144663.910422:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144663.910427:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747525888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910430:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747526528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910442:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.910451:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746144663.910454:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747526400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.910460:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747525504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (436us total) trans 17179873313 rc 0/0 00000100:00100000:1.0:1746144663.910465:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12032 00000100:00100000:0.0:1746144663.910466:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.910474:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747526016 00000100:00100000:1.0:1746144663.910476:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747526016 00000100:00100000:0.0:1746144663.910480:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747525760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.910488:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747526528 00000100:00100000:1.0:1746144663.910490:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747526528 00000100:00100000:0.0:1746144663.910493:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.910495:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747526400 00000100:00100000:1.0:1746144663.910496:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747526400 00000100:00100000:0.0:1746144663.910500:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747526272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144663.910502:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747525760 00000100:00100000:1.0:1746144663.910503:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747525760 00000100:00100000:1.0:1746144663.910511:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12034 00000100:00100000:0.0:1746144663.910512:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.910515:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3294:x1830964747526016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910520:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144663.910523:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747525632:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144663.910530:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746144663.910533:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.910535:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00000100:00100000:0.0:1746144663.910535:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746144663.910536:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144663.910538:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144663.910539:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747526144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910548:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.910557:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747526272 00000100:00100000:0.0:1746144663.910559:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747526272 00000100:00100000:2.0:1746144663.910565:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3294:x1830964747525888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (168us total) trans 21474840537 rc 0/0 00000100:00100000:0.0:1746144663.910566:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747525632 00000100:00100000:0.0:1746144663.910568:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747525632 00000100:00100000:2.0:1746144663.910570:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12033 00000100:00100000:0.0:1746144663.910573:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747526144 00000100:00100000:0.0:1746144663.910574:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747526144 00000100:00100000:0.0:1746144663.910579:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12035 00000100:00100000:0.0:1746144663.910582:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747526528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.910583:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12036 00000100:00100000:2.0:1746144663.910587:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3294:x1830964747526400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910645:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3294:x1830964747526528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (202us total) trans 21474840538 rc 0/0 00000100:00100000:0.0:1746144663.910649:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12035 00000100:00100000:0.0:1746144663.910656:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12037 00000100:00100000:0.0:1746144663.910658:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747525760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144663.910663:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3294:x1830964747526400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (195us total) trans 21474840539 rc 0/0 00000100:00100000:2.0:1746144663.910668:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12036 00000100:00100000:2.0:1746144663.910678:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12038 00000100:00100000:2.0:1746144663.910681:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747526272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.910715:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747525760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (221us total) trans 21474840540 rc 0/0 00000100:00100000:0.0:1746144663.910718:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12037 00000100:00100000:0.0:1746144663.910725:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12039 00000100:00100000:0.0:1746144663.910728:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747525632:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911013:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920aca80/2, rc 0, transno 21474840540 00000100:00100000:0.0:1746144663.911018:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747525760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911039:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920ad500/2, rc 0, transno 21474840539 00000100:00100000:0.0:1746144663.911042:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747526400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911047:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920af480/2, rc 0, transno 21474840538 00000100:00100000:0.0:1746144663.911050:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747526528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911056:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920ad880/2, rc 0, transno 21474840537 00000100:00100000:0.0:1746144663.911058:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747525888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.911069:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12040 00000100:00100000:0.0:1746144663.911073:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3296:x1830964747526144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144663.911226:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144663.911229:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144663.911231:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144663.911233:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144663.911234:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746144663.911239:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3296:x1830964747526272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 556us (725us total) trans 21474840541 rc 0/0 00000100:00100000:2.0:1746144663.911245:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12038 00000100:00100000:1.0:1746144663.911259:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3294:x1830964747526016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 742us (835us total) trans 21474840542 rc 0/0 00000100:00100000:1.0:1746144663.911265:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12034 00010000:00010000:1.0:1746144663.911289:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.911296:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.911303:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.911309:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5fe00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144663.911313:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.911320:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.911344:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.911347:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144663.911351:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.911360:0:3279:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.911367:0:3279:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.911375:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.911381:0:3279:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.911387:0:3279:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.911409:0:3279:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.911419:0:3279:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830964747526656:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144663.911473:0:3279:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144663.911480:0:3279:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830964747526784:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144663.911497:0:3279:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af900 going to sleep for 11 seconds 00000004:00080000:1.0:1746144663.911543:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943fad80/2, rc 0, transno 17179873313 00000100:00100000:1.0:1746144663.911547:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747525504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144663.911734:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3296:x1830964747525632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1003us (1196us total) trans 21474840544 rc 0/0 00000100:00100000:2.0:1746144663.911739:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12039 00000100:00100000:0.0:1746144663.911874:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747526144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 800us (1324us total) trans 21474840543 rc 0/0 00000100:00100000:0.0:1746144663.911881:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12040 00000004:00080000:0.0:1746144663.911904:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920ae680/2, rc 0, transno 21474840542 00000100:00100000:0.0:1746144663.911908:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747526016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911921:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920ae300/2, rc 0, transno 21474840544 00000100:00100000:0.0:1746144663.911923:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747525632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911929:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920ace00/2, rc 0, transno 21474840543 00000100:00100000:0.0:1746144663.911931:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747526144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.911936:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800920ac700/2, rc 0, transno 21474840541 00000100:00100000:0.0:1746144663.911939:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747526272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.915536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.915665:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761728 00000100:00100000:2.0:1746144663.915674:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761728 00000100:00100000:2.0:1746144663.915731:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10146 00000100:00100000:2.0:1746144663.915743:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746761728:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144663.915770:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.915788:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f393 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.915847:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.915859:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144663.915878:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.915881:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144663.915884:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5ee00, rc 0) 00000100:00100000:2.0:1746144663.915927:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29260:x1830964746761728:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 185us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.915933:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10146 00000100:00100000:1.0:1746144663.916013:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747525376:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144663.916046:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144663.916096:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.916166:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761856 00000100:00100000:3.0:1746144663.916171:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761856 00010000:00010000:3.0:1746144663.916190:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144663.916208:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6015 00000100:00100000:3.0:1746144663.916212:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746761856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.916221:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.916225:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.916235:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.916250:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01ace1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f34d expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.916260:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.916263:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.916269:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.916275:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144663.916280:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.916285:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.916291:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144663.916319:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144663.916341:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746761856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.916347:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6015 00010000:00010000:2.0:1746144663.916402:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916409:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144663.916424:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144663.916568:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916576:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916581:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916584:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916587:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b22800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.916590:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916592:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916596:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144663.916602:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144663.916603:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.916605:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144663.916608:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916613:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b22800/0xa7c849b16e01ad82 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916637:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916642:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916645:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916647:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916651:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130327c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144663.916651:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916652:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916655:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916656:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916659:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130326600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144663.916661:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916662:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144663.916664:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.916666:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916666:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916670:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327c00/0xa7c849b16e01ad5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916674:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144663.916677:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916677:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144663.916680:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916681:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916684:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01ad7b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916686:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144663.916690:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130327a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144663.916692:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916694:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916697:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916699:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916702:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8200) 00010000:00010000:1.0:1746144663.916703:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916704:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144663.916706:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916707:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4e7e400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144663.916708:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916710:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327a00/0xa7c849b16e01ad66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144663.916713:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916718:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144663.916720:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144663.916722:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916725:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4e7e400/0xa7c849b16e01ad43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916732:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916736:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916743:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916745:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01ad58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f370 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.916746:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130326000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144663.916748:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.916751:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01ad58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f370 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.916752:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916757:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8200) 00010000:00010000:2.0:1746144663.916758:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130327e00, rc 0) 00010000:00010000:1.0:1746144663.916758:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144663.916760:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.916764:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130326000/0xa7c849b16e01ad4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144663.916779:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29266:x1830964746760960:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 18577us (19206us total) trans 8589944032 rc 301/301 00000100:00100000:2.0:1746144663.916784:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10144 00010000:00010000:1.0:1746144663.916792:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01ad3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f377 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.916798:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01ad3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f377 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.916805:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273400, rc 0) 00000100:00100000:1.0:1746144663.917648:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29264:x1830964746761216:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 19977us (20176us total) trans 8589944033 rc 301/301 00000100:00100000:1.0:1746144663.917655:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10142 00000100:00100000:1.0:1746144663.917931:0:3279:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830964747526784:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144663.918499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.918763:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746761984 00000100:00100000:2.0:1746144663.918768:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746761984 00000100:00100000:2.0:1746144663.918815:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4103 00000100:00100000:2.0:1746144663.918825:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746761984:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144663.919338:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746761984:12345-192.168.204.23@tcp:49:cat.0 Request processed in 512us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.919348:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4103 00000100:00100000:0.0:1746144663.919487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.919526:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746762240 00000100:00100000:2.0:1746144663.919529:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746762240 00000100:00100000:1.0:1746144663.919627:0:3279:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830964747526656:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144663.919650:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144663.919657:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ad2e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144663.919733:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4104 00000100:00100000:2.0:1746144663.919740:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29260:x1830964746762240:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746144663.919870:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746762240:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 130us (382us total) trans 8589944034 rc 0/0 00000100:00100000:2.0:1746144663.919875:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4104 00000100:00100000:0.0:1746144663.920306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.920343:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746762368 00000100:00100000:3.0:1746144663.920348:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746762368 00000100:00100000:3.0:1746144663.920493:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4105 00000100:00100000:3.0:1746144663.920500:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29258:x1830964746762368:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:3.0:1746144663.920559:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29258:x1830964746762368:12345-192.168.204.23@tcp:49:cat.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.920565:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4105 00000100:00100000:2.0:1746144663.926431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.926480:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746762624 00000100:00100000:0.0:1746144663.926490:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746762624 00000100:00100000:0.0:1746144663.926539:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4106 00000100:00100000:2.0:1746144663.926542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.926547:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29260:x1830964746762624:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1746144663.926772:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29260:x1830964746762624:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 224us (352us total) trans 8589944035 rc 0/0 00000100:00100000:0.0:1746144663.926778:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4106 00000100:00100000:1.0:1746144663.926908:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746762880 00000100:00100000:1.0:1746144663.926913:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746762880 00002000:00100000:1.0:1746144663.926941:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800920afb80 x1830964746762880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.926951:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920afb80 with x1830964746762880 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.926956:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920afb80 00000100:00100000:1.0:1746144663.926971:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4620 00000100:00100000:1.0:1746144663.926976:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746762880:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.935940:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746762880:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8949us (9383us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144663.935953:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4620 00002000:00100000:1.0:1746144663.935967:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800920afb80 x1830964746762880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144663.935977:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920afb80 with x1830964746762880 ext(3145728->4194303) 00002000:00010000:1.0:1746144663.935985:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920afb80 00000100:00100000:0.0:1746144663.940274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.940320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.940356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.940451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.940485:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746763008 00000100:00100000:0.0:1746144663.940485:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746763136 00000100:00100000:2.0:1746144663.940493:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746763008 00000100:00100000:0.0:1746144663.940493:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746763136 00000100:00100000:2.0:1746144663.940533:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746763264 00000100:00100000:2.0:1746144663.940535:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746763264 00000100:00100000:3.0:1746144663.940666:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746763392 00000100:00100000:3.0:1746144663.940671:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746763392 00000100:00100000:1.0:1746144663.940730:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12041 00000100:00100000:1.0:1746144663.940744:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746763008:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.940764:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.940786:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f39a expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144663.940812:0:8389:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x805 00010000:00010000:1.0:1746144663.940832:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.940834:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144663.940844:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.940866:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144663.940876:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c90d800, rc 0) 00000100:00100000:1.0:1746144663.940924:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746763008:12345-192.168.204.23@tcp:101:cat.0 Request processed in 182us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.940930:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12041 00000100:00100000:3.0:1746144663.941472:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12042 00000100:00100000:3.0:1746144663.941478:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746763392:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144663.941485:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144663.941496:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3af expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144663.941509:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x81d 00010000:00010000:3.0:1746144663.941517:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.941519:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144663.941524:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 30 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.941539:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 30 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144663.941547:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5fe00, rc 0) 00000100:00100000:3.0:1746144663.941565:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746763392:12345-192.168.204.23@tcp:101:cat.0 Request processed in 88us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.941570:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12042 00000100:00100000:2.0:1746144663.941625:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12043 00000100:00100000:2.0:1746144663.941631:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746763264:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144663.941639:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144663.941649:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3a8 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144663.941664:0:8453:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x821 00010000:00010000:2.0:1746144663.941672:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.941674:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144663.941678:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 21 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.941693:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 21 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144663.941700:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273000, rc 0) 00000100:00100000:2.0:1746144663.941716:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746763264:12345-192.168.204.23@tcp:101:cat.0 Request processed in 86us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.941721:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12043 00000100:00100000:0.0:1746144663.941749:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12044 00000100:00100000:0.0:1746144663.941755:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746763136:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144663.941763:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.941770:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3a1 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144663.941782:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x821 00010000:00010000:0.0:1746144663.941789:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.941790:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144663.941794:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 21 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.941803:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 21 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144663.941809:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e2400, rc 0) 00000100:00100000:0.0:1746144663.941823:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746763136:12345-192.168.204.23@tcp:101:cat.0 Request processed in 69us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144663.941828:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12044 00000100:00100000:0.0:1746144663.942291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.942356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.942395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144663.942397:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746763648 00000100:00100000:2.0:1746144663.942401:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746763648 00002000:00100000:2.0:1746144663.942429:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008b9a3800 x1830964746763648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.942438:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3800 with x1830964746763648 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.942443:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3800 00000100:00100000:2.0:1746144663.943021:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746763776 00000100:00100000:0.0:1746144663.943032:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746764160 00000100:00100000:2.0:1746144663.943033:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746763776 00000100:00100000:0.0:1746144663.943037:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746764160 00002000:00100000:2.0:1746144663.943049:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008b9a3b80 x1830964746763776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.943056:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3b80 with x1830964746763776 ext(3145728->4194303) 00002000:00100000:0.0:1746144663.943056:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008b9a0000 x1830964746764160/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746144663.943059:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3b80 00002000:00100000:0.0:1746144663.943064:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0000 with x1830964746764160 ext(3145728->4194303) 00002000:00010000:0.0:1746144663.943067:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0000 00000100:00100000:2.0:1746144663.943071:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4621 00000100:00100000:2.0:1746144663.943076:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746763648:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144663.943388:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4622 00000100:00100000:0.0:1746144663.943395:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746763776:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.943518:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4623 00000100:00100000:1.0:1746144663.943534:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746764160:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144663.948015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.949178:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746764416 00000100:00100000:0.0:1746144663.949192:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746764416 00000100:00100000:0.0:1746144663.949245:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10147 00000100:00100000:0.0:1746144663.949253:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29264:x1830964746764416:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144663.949278:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144663.949286:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746144663.949315:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130326200/0xa7c849b16e01ad51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f37e expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.949339:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144663.949343:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144663.949355:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01adba lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3b6 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.949409:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.949427:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.949433:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.949443:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144663.949476:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.949488:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 8 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.949499:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747526912:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144663.950872:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144663.950886:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 7 pid: 15388 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144663.950896:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747527040:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.950917:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144663.951043:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.951096:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746764672 00000100:00100000:3.0:1746144663.951104:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746764672 00002000:00100000:3.0:1746144663.951160:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800920aed80 x1830964746764672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/0 e 0 to 0 dl 1746144674 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.951170:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aed80 with x1830964746764672 ext(4194304->4935679) 00002000:00010000:3.0:1746144663.951174:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920aed80 00000100:00100000:3.0:1746144663.951191:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4624 00000100:00100000:3.0:1746144663.951198:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746764672:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144663.957244:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747526912:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144663.958243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.958302:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746764800 00000100:00100000:0.0:1746144663.958308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.958311:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746764800 00010000:00010000:3.0:1746144663.958347:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144663.958361:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746764928 00000100:00100000:1.0:1746144663.958365:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746764928 00000100:00100000:3.0:1746144663.958378:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6016 00010000:00010000:1.0:1746144663.958384:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144663.958385:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746764800:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144663.958398:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144663.958404:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144663.958408:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6017 00010000:00010000:3.0:1746144663.958414:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144663.958415:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746764928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144663.958422:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144663.958427:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144663.958435:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ee00/0xa7c849b16e01ad89 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f393 expref: 9 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.958437:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144663.958452:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.958457:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.958466:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.958473:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.958535:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e79be00/0xa7c849b16e01ad74 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f38c expref: 8 pid: 15388 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144663.958549:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747527040:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144663.958904:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.958909:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144663.958914:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.958914:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144663.958922:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144663.958927:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144663.958949:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:1961:x1830964746764928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 534us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.958955:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6017 00000100:00100000:3.0:1746144663.959103:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746764800:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 717us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144663.959109:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6016 00000040:00080000:2.0:1746144663.960274:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2958, 88 off247256 00000004:00080000:2.0:1746144663.960283:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643169147587ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.960414:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2873, 88 off239768 00000004:00080000:2.0:1746144663.960419:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643169284255ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961077:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2874, 88 off239856 00000004:00080000:2.0:1746144663.961083:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643169948250ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961091:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2959, 88 off247344 00000004:00080000:2.0:1746144663.961094:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643169959189ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961102:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2960, 88 off247432 00000004:00080000:2.0:1746144663.961104:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643169969827ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961110:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2875, 88 off239944 00000004:00080000:2.0:1746144663.961113:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643169978310ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961119:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2876, 88 off240032 00000004:00080000:2.0:1746144663.961122:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643169987195ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961127:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2877, 88 off240120 00000004:00080000:2.0:1746144663.961131:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643169996212ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961239:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2961, 88 off247520 00000004:00080000:2.0:1746144663.961244:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643170109227ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961255:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2878, 88 off240208 00000004:00080000:2.0:1746144663.961259:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643170124402ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961266:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2962, 88 off247608 00000004:00080000:2.0:1746144663.961268:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643170133724ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961275:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2879, 88 off240296 00000004:00080000:2.0:1746144663.961277:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643170142425ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144663.961283:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2963, 88 off247696 00000004:00080000:2.0:1746144663.961285:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643170150165ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961290:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2964, 88 off247784 00000004:00080000:2.0:1746144663.961292:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643170157589ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961298:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2965, 88 off247872 00000004:00080000:2.0:1746144663.961300:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643170165864ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961306:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2966, 88 off247960 00000004:00080000:2.0:1746144663.961308:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643170173332ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144663.961314:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2880, 88 off240384 00000004:00080000:2.0:1746144663.961316:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643170181620ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144663.961502:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746764160:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17972us (19102us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144663.961511:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4623 00002000:00100000:0.0:1746144663.961522:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008b9a0000 x1830964746764160/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.961531:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0000 with x1830964746764160 ext(3145728->4194303) 00002000:00010000:0.0:1746144663.961537:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0000 00000100:00100000:2.0:1746144663.963550:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746763648:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20467us (21253us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144663.963560:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4621 00002000:00100000:2.0:1746144663.963569:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008b9a3800 x1830964746763648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144663.963578:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3800 with x1830964746763648 ext(2097152->3145727) 00002000:00010000:2.0:1746144663.963583:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3800 00000100:00100000:0.0:1746144663.968992:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746763776:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25585us (26623us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144663.969004:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4622 00002000:00100000:0.0:1746144663.969016:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008b9a3b80 x1830964746763776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144663.969041:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a3b80 with x1830964746763776 ext(3145728->4194303) 00002000:00010000:0.0:1746144663.969048:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a3b80 00000100:00100000:0.0:1746144663.972068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.972219:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765056 00000100:00100000:1.0:1746144663.972229:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765056 00000100:00100000:1.0:1746144663.972270:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10148 00000100:00100000:1.0:1746144663.972278:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29259:x1830964746765056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.972296:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.972314:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3bd expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.972370:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.972381:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.972397:0:14709:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144663.972409:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.972420:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.972423:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144663.972426:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.972431:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921c6a00, rc 0) 00000100:00100000:1.0:1746144663.972470:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29259:x1830964746765056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 193us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.972474:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10148 00000100:00100000:3.0:1746144663.972532:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746764672:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21333us (21489us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144663.972540:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4624 00002000:00100000:3.0:1746144663.972548:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff8800920aed80 x1830964746764672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:304/0 lens 488/440 e 0 to 0 dl 1746144674 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144663.972557:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aed80 with x1830964746764672 ext(4194304->4935679) 00002000:00010000:3.0:1746144663.972644:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920aed80 00000100:00100000:0.0:1746144663.977065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144663.977289:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765184 00000100:00100000:1.0:1746144663.977299:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765184 00000100:00100000:1.0:1746144663.977340:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10149 00000100:00100000:1.0:1746144663.977347:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+7:29258:x1830964746765184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144663.977371:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144663.977390:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3c4 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.977688:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.977700:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.977713:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144663.977716:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144663.977720:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144663.977726:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921c7000, rc 0) 00000100:00100000:1.0:1746144663.977774:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:29258:x1830964746765184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 426us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.977780:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10149 00000001:00080000:1.0:1746144663.990623:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944035 is committed 00000001:00080000:1.0:1746144663.990642:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944033 is committed 00000001:00080000:1.0:1746144663.990647:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944036 is committed 00000004:00080000:1.0:1746144663.990651:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2065 committed 00000004:00080000:1.0:1746144663.990658:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2147 committed 00000004:00080000:1.0:1746144663.990665:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2146 committed 00000004:00080000:1.0:1746144663.990666:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2145 committed 00000004:00080000:1.0:1746144663.990668:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2144 committed 00000004:00080000:1.0:1746144663.990670:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2064 committed 00000004:00080000:1.0:1746144663.990671:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2143 committed 00000004:00080000:1.0:1746144663.990673:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2063 committed 00000004:00080000:1.0:1746144663.990675:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2142 committed 00000004:00080000:1.0:1746144663.990677:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2062 committed 00000004:00080000:1.0:1746144663.990679:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2061 committed 00000004:00080000:1.0:1746144663.990680:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2060 committed 00000004:00080000:1.0:1746144663.990682:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2141 committed 00000004:00080000:1.0:1746144663.990685:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2140 committed 00000004:00080000:1.0:1746144663.990686:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2059 committed 00000004:00080000:1.0:1746144663.990688:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2058 committed 00000004:00080000:1.0:1746144663.990689:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2139 committed 00000001:00080000:1.0:1746144663.990697:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944032 is committed 00000100:00100000:1.0:1746144663.990857:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.990924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.990962:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.990976:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.990993:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746144663.990997:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991009:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.991019:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991045:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.991061:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747527424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991075:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.991085:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747527936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991096:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.991106:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746144663.991110:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747527552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991120:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.991128:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747528064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991162:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144663.991190:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527168 00000100:00100000:1.0:1746144663.991197:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527168 00000100:00100000:1.0:1746144663.991229:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527680 00000100:00100000:1.0:1746144663.991232:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527680 00000100:00100000:1.0:1746144663.991241:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527296 00000100:00100000:1.0:1746144663.991243:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527296 00000100:00100000:1.0:1746144663.991252:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527808 00000100:00100000:1.0:1746144663.991254:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527808 00000100:00100000:1.0:1746144663.991263:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527424 00000100:00100000:1.0:1746144663.991265:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527424 00000100:00100000:1.0:1746144663.991272:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527936 00000100:00100000:1.0:1746144663.991273:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527936 00000100:00100000:1.0:1746144663.991279:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747527552 00000100:00100000:1.0:1746144663.991280:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747527552 00000100:00100000:1.0:1746144663.991286:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528064 00000100:00100000:1.0:1746144663.991287:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528064 00000100:00100000:1.0:1746144663.991296:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12045 00000100:00100000:1.0:1746144663.991303:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747527168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144663.991493:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746144663.991497:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991499:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991501:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991503:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00000100:00100000:1.0:1746144663.991532:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747527168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (608us total) trans 17179873314 rc 0/0 00000100:00100000:1.0:1746144663.991538:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12045 00000100:00100000:1.0:1746144663.991557:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12046 00000100:00100000:1.0:1746144663.991561:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747527680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991643:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747527680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (665us total) trans 17179873315 rc 0/0 00000100:00100000:1.0:1746144663.991648:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12046 00000100:00100000:1.0:1746144663.991658:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12047 00000100:00100000:1.0:1746144663.991662:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747527296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144663.991725:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144663.991727:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991729:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991731:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991732:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746144663.991747:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747527296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (737us total) trans 17179873316 rc 0/0 00000100:00100000:1.0:1746144663.991751:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12047 00000100:00100000:1.0:1746144663.991758:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12048 00000100:00100000:1.0:1746144663.991762:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747527808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991821:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747527808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (776us total) trans 17179873317 rc 0/0 00000100:00100000:1.0:1746144663.991826:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12048 00000100:00100000:1.0:1746144663.991838:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12049 00000100:00100000:1.0:1746144663.991841:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747527424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144663.991892:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:1.0:1746144663.991894:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991896:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991898:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144663.991900:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:1.0:1746144663.991915:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747527424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (840us total) trans 17179873318 rc 0/0 00000100:00100000:1.0:1746144663.991919:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12049 00000100:00100000:1.0:1746144663.991928:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12050 00000100:00100000:1.0:1746144663.991932:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747527936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.991987:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747527936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (890us total) trans 17179873319 rc 0/0 00000100:00100000:1.0:1746144663.991992:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12050 00000100:00100000:1.0:1746144663.991999:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12051 00000100:00100000:1.0:1746144663.992003:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747527552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.992071:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747527552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (949us total) trans 17179873320 rc 0/0 00000100:00100000:1.0:1746144663.992075:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12051 00000100:00100000:1.0:1746144663.992082:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12052 00000100:00100000:1.0:1746144663.992086:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747528064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.992165:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747528064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1001us total) trans 17179873321 rc 0/0 00000100:00100000:1.0:1746144663.992170:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12052 00000004:00080000:1.0:1746144663.992219:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01c380/2, rc 0, transno 17179873320 00000100:00100000:1.0:1746144663.992228:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747527552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.992236:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01d180/2, rc 0, transno 17179873321 00000100:00100000:1.0:1746144663.992238:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747528064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.992243:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01df80/2, rc 0, transno 17179873318 00000100:00100000:1.0:1746144663.992246:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747527424:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.992251:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01f480/2, rc 0, transno 17179873319 00000100:00100000:1.0:1746144663.992253:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747527936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.992286:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747528192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.992308:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746144663.992331:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01ed80/2, rc 0, transno 17179873316 00000100:00100000:1.0:1746144663.992333:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.992340:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01e680/2, rc 0, transno 17179873317 00000100:00100000:1.0:1746144663.992342:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.992349:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01c000/2, rc 0, transno 17179873314 00000100:00100000:1.0:1746144663.992351:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144663.992355:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f01ce00/2, rc 0, transno 17179873315 00000100:00100000:1.0:1746144663.992357:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747527680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.992371:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528192 00000100:00100000:1.0:1746144663.992374:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528192 00000100:00100000:1.0:1746144663.992389:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12053 00000100:00100000:1.0:1746144663.992394:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747528192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144663.992471:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830964747528192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (162us total) trans 17179873322 rc 0/0 00000100:00100000:1.0:1746144663.992476:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12053 00000004:00080000:1.0:1746144663.992493:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b572d80/2, rc 0, transno 17179873322 00000100:00100000:1.0:1746144663.992496:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747528192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144663.992691:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747528320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992717:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992730:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747528832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992744:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992755:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144663.992758:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747528704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992769:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992776:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747529216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992802:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747528576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992816:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992825:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747529088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992837:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992847:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746144663.992851:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747528448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992874:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747528960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.992886:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144663.992900:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528320 00000100:00100000:0.0:1746144663.992903:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528320 00000100:00100000:0.0:1746144663.992915:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528832 00000100:00100000:0.0:1746144663.992916:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528832 00000100:00100000:0.0:1746144663.992921:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528704 00000100:00100000:0.0:1746144663.992922:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528704 00000100:00100000:0.0:1746144663.992927:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747529216 00000100:00100000:0.0:1746144663.992929:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747529216 00000100:00100000:0.0:1746144663.992933:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528576 00000100:00100000:0.0:1746144663.992934:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528576 00000100:00100000:0.0:1746144663.992938:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747529088 00000100:00100000:0.0:1746144663.992940:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747529088 00000100:00100000:0.0:1746144663.992944:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528448 00000100:00100000:0.0:1746144663.992945:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528448 00000100:00100000:0.0:1746144663.992950:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747528960 00000100:00100000:0.0:1746144663.992951:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747528960 00000100:00100000:0.0:1746144663.992957:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12054 00000100:00100000:0.0:1746144663.992960:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3296:x1830964747528320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144663.993076:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144663.993079:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993081:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993082:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993084:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144663.993105:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747528320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (387us total) trans 21474840545 rc 0/0 00000100:00100000:0.0:1746144663.993110:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12054 00000100:00100000:0.0:1746144663.993121:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12055 00000100:00100000:0.0:1746144663.993125:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3296:x1830964747528832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.993214:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747528832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (469us total) trans 21474840546 rc 0/0 00000100:00100000:0.0:1746144663.993220:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12055 00000100:00100000:0.0:1746144663.993228:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1746144663.993232:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3296:x1830964747528704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144663.993293:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746144663.993295:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144663.993298:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144663.993299:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:0.0:1746144663.993301:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746144663.993318:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747528704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (548us total) trans 21474840547 rc 0/0 00000100:00100000:0.0:1746144663.993323:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12056 00000100:00100000:0.0:1746144663.993332:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12057 00000100:00100000:0.0:1746144663.993336:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3296:x1830964747529216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.993405:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3296:x1830964747529216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (616us total) trans 21474840548 rc 0/0 00000100:00100000:0.0:1746144663.993410:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12057 00000100:00100000:0.0:1746144663.993419:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12058 00000100:00100000:0.0:1746144663.993423:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3294:x1830964747528576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144663.993489:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144663.993491:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993493:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993495:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993496:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144663.993516:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747528576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (700us total) trans 21474840549 rc 0/0 00000100:00100000:0.0:1746144663.993521:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12058 00000100:00100000:0.0:1746144663.993531:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12059 00000100:00100000:0.0:1746144663.993535:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3294:x1830964747529088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.993606:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747529088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (767us total) trans 21474840550 rc 0/0 00000100:00100000:0.0:1746144663.993610:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12059 00000100:00100000:0.0:1746144663.993619:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12060 00000100:00100000:0.0:1746144663.993622:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3294:x1830964747528448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144663.993688:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144663.993690:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993692:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993694:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144663.993695:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144663.993712:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747528448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (846us total) trans 21474840551 rc 0/0 00000100:00100000:0.0:1746144663.993718:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12060 00000100:00100000:0.0:1746144663.993726:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12061 00000100:00100000:0.0:1746144663.993730:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3294:x1830964747528960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144663.993797:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747528960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (910us total) trans 21474840552 rc 0/0 00000100:00100000:0.0:1746144663.993802:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12061 00000004:00080000:0.0:1746144663.993829:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a3100/2, rc 0, transno 21474840551 00000100:00100000:0.0:1746144663.993833:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747528448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993839:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136448380/2, rc 0, transno 21474840552 00000100:00100000:0.0:1746144663.993842:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747528960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993846:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a0e00/2, rc 0, transno 21474840549 00000100:00100000:0.0:1746144663.993849:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747528576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993854:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136449180/2, rc 0, transno 21474840550 00000100:00100000:0.0:1746144663.993856:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136449180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747529088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993869:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a1180/2, rc 0, transno 21474840547 00000100:00100000:0.0:1746144663.993872:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747528704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993877:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644a300/2, rc 0, transno 21474840548 00000100:00100000:0.0:1746144663.993879:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747529216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993884:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a0380/2, rc 0, transno 21474840545 00000100:00100000:0.0:1746144663.993886:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747528320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144663.993892:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a0700/2, rc 0, transno 21474840546 00000100:00100000:0.0:1746144663.993894:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747528832:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746144663.994116:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994129:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144663.994157:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746144663.994163:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994178:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994184:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994192:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994198:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994204:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.994230:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.994241:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747529344:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144663.994323:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144663.994331:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747529472:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144663.994348:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144663.997709:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747529344:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144663.997724:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747529472:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144663.997770:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e3600/0xa7c849b16e01adba lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 299 pid: 14710 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746144663.997787:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144663.997822:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e2c00, rc 0) 00000100:00100000:3.0:1746144663.997886:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29264:x1830964746764416:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 48632us (49881us total) trans 8589944036 rc 0/0 00000100:00100000:3.0:1746144663.997895:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10147 00000100:00100000:0.0:1746144663.998800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.999547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144663.999573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144663.999713:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765312 00000100:00100000:3.0:1746144663.999721:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765312 00000100:00100000:3.0:1746144663.999764:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765440 00000100:00100000:3.0:1746144663.999767:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765440 00000100:00100000:3.0:1746144663.999775:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765568 00000100:00100000:3.0:1746144663.999777:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765568 00000100:00100000:3.0:1746144663.999785:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4107 00000100:00100000:3.0:1746144663.999793:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29259:x1830964746765312:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:1.0:1746144663.999844:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4108 00000100:00100000:1.0:1746144663.999854:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+7:29258:x1830964746765440:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:1.0:1746144663.999909:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+7:29258:x1830964746765440:12345-192.168.204.23@tcp:49:cat.0 Request processed in 58us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144663.999915:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4108 00000100:00100000:2.0:1746144663.999927:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4109 00000100:00100000:2.0:1746144663.999934:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29264:x1830964746765568:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:2.0:1746144663.999977:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29264:x1830964746765568:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 44us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144663.999983:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4109 00000100:00100000:3.0:1746144664.000247:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29259:x1830964746765312:12345-192.168.204.23@tcp:49:cat.0 Request processed in 454us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.000253:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4107 00000100:00100000:0.0:1746144664.005399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.005518:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765824 00000100:00100000:3.0:1746144664.005528:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765824 00002000:00100000:3.0:1746144664.005723:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4931584->4935679) req@ffff88013644ad80 x1830964746765824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.005733:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ad80 with x1830964746765824 ext(4931584->4935679) 00002000:00010000:3.0:1746144664.005738:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644ad80 00000100:00080000:0.0:1746144664.005800:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144664.005889:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4625 00000100:00100000:3.0:1746144664.005898:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1962:x1830964746765824:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144664.006326:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1962:x1830964746765824:12345-192.168.204.23@tcp:3:cat.0 Request processed in 428us (936us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144664.006333:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4625 00002000:00100000:3.0:1746144664.006340:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4931584->4935679) req@ffff88013644ad80 x1830964746765824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.006346:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ad80 with x1830964746765824 ext(4931584->4935679) 00002000:00010000:3.0:1746144664.006349:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644ad80 00000100:00100000:0.0:1746144664.007100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.007243:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746765952 00000100:00100000:1.0:1746144664.007249:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746765952 00000100:00100000:1.0:1746144664.007537:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12062 00000100:00100000:1.0:1746144664.007545:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29264:x1830964746765952:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144664.007558:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.007577:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3cb expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.007605:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 20 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.007612:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.007614:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.007618:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1388544->1802239] (req 1388544->1802239) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.007648:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 20 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.007660:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 20 pid: 30345 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.007671:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747529600:192.168.204.23@tcp:104: 00000100:00080000:0.0:1746144664.007790:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144664.008046:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.008780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.009395:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746766208 00000100:00100000:3.0:1746144664.009401:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746766208 00000100:00100000:3.0:1746144664.009485:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4110 00000100:00100000:0.0:1746144664.009501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00080000:1.0:1746144664.009553:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144664.009585:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747529600:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144664.009610:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1388544->1802239] (req 1388544->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.009631:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8400, rc 0) 00000100:00100000:3.0:1746144664.009639:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:29258:x1830964746766208:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144664.009661:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29264:x1830964746765952:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2117us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.009667:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12062 00000100:00100000:3.0:1746144664.010045:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29258:x1830964746766208:12345-192.168.204.23@tcp:35:cat.0 Request processed in 553us (1265us total) trans 8589944037 rc 0/0 00000100:00100000:3.0:1746144664.010054:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4110 00000100:00100000:3.0:1746144664.010075:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746766336 00000100:00100000:3.0:1746144664.010078:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746766336 00000100:00080000:1.0:1746144664.010192:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746144664.010239:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 21 pid: 30345 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.010258:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6018 00000100:00100000:3.0:1746144664.010264:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746766336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.010274:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.010306:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 21 pid: 30345 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.010316:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 21 pid: 30345 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.010336:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e7e2400/0xa7c849b16e01adb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a1 expref: 21 pid: 30345 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.010346:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.010348:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.010354:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.010362:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.010387:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.010402:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747529728:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.010464:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.012234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.012269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.012306:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746766592 00000100:00100000:3.0:1746144664.012313:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746766592 00000100:00100000:2.0:1746144664.012412:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747529728:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.012427:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.012458:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746766336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2194us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.012465:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6018 00000100:00100000:1.0:1746144664.012488:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746766848 00000100:00100000:1.0:1746144664.012491:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746766848 00002000:00100000:3.0:1746144664.012526:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d1f80 x1830964746766592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.012526:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008c7d3100 x1830964746766848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.012535:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1f80 with x1830964746766592 ext(3145728->4194303) 00002000:00100000:1.0:1746144664.012535:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3100 with x1830964746766848 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.012539:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d1f80 00002000:00010000:1.0:1746144664.012539:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d3100 00000100:00100000:3.0:1746144664.012553:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4626 00000100:00100000:3.0:1746144664.012558:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746766592:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144664.012641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.012707:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746767104 00000100:00100000:1.0:1746144664.012710:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746767104 00000100:00100000:2.0:1746144664.012717:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4627 00000100:00100000:2.0:1746144664.012725:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746766848:12345-192.168.204.23@tcp:3:multiop.0 00002000:00100000:1.0:1746144664.012725:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1388544->1392639) req@ffff88008c7d0e00 x1830964746767104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.012731:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0e00 with x1830964746767104 ext(1388544->1392639) 00002000:00010000:1.0:1746144664.012734:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d0e00 00000100:00100000:1.0:1746144664.012748:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4628 00000100:00100000:1.0:1746144664.012753:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746767104:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144664.013077:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746767104:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 323us (436us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144664.013084:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4628 00002000:00100000:1.0:1746144664.013089:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1388544->1392639) req@ffff88008c7d0e00 x1830964746767104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.013101:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0e00 with x1830964746767104 ext(1388544->1392639) 00002000:00010000:1.0:1746144664.013104:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d0e00 00000100:00080000:1.0:1746144664.013123:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144664.022384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.022462:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746767360 00000100:00100000:2.0:1746144664.022474:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746767360 00002000:00100000:2.0:1746144664.022523:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1798144->1802239) req@ffff88008c7d0380 x1830964746767360/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.022533:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0380 with x1830964746767360 ext(1798144->1802239) 00002000:00010000:2.0:1746144664.022539:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d0380 00000100:00100000:2.0:1746144664.022561:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4629 00000100:00100000:2.0:1746144664.022568:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746767360:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144664.022750:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746767360:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 181us (380us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.022757:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4629 00002000:00100000:2.0:1746144664.022763:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1798144->1802239) req@ffff88008c7d0380 x1830964746767360/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.022770:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0380 with x1830964746767360 ext(1798144->1802239) 00002000:00010000:2.0:1746144664.022773:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d0380 00000100:00100000:3.0:1746144664.027826:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746766592:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 15255us (15588us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.027840:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4626 00002000:00100000:3.0:1746144664.028116:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d1f80 x1830964746766592/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.028126:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1f80 with x1830964746766592 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.028332:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d1f80 00000100:00100000:2.0:1746144664.029318:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746766848:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 16590us (17042us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.029327:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4627 00002000:00100000:2.0:1746144664.029334:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008c7d3100 x1830964746766848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.029342:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3100 with x1830964746766848 ext(3145728->4194303) 00002000:00010000:2.0:1746144664.029346:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d3100 00000100:00100000:0.0:1746144664.029966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.030124:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746767616 00000100:00100000:3.0:1746144664.030152:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746767616 00000100:00100000:3.0:1746144664.030215:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4111 00000100:00100000:3.0:1746144664.030222:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29264:x1830964746767616:12345-192.168.204.23@tcp:35:multiop.0 00000100:00080000:1.0:1746144664.030622:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144664.030823:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29264:x1830964746767616:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 599us (856us total) trans 8589944038 rc 0/0 00000100:00100000:3.0:1746144664.030829:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4111 00000100:00100000:0.0:1746144664.033333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.033366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.033405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.033508:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746767744 00000100:00100000:1.0:1746144664.033517:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746767744 00000100:00100000:1.0:1746144664.033568:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746768000 00000100:00100000:1.0:1746144664.033570:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746768000 00000100:00100000:1.0:1746144664.033583:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746767872 00000100:00100000:1.0:1746144664.033585:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746767872 00000100:00100000:1.0:1746144664.033602:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12063 00000100:00100000:1.0:1746144664.033609:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746767744:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.033627:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.033647:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3d2 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.033671:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.033674:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.033684:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.033700:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.033712:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8200, rc 0) 00000100:00100000:1.0:1746144664.033749:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746767744:12345-192.168.204.23@tcp:101:cat.0 Request processed in 141us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.033759:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12063 00000100:00100000:1.0:1746144664.033778:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12064 00000100:00100000:1.0:1746144664.033782:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746768000:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.033788:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.033795:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3e0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.033804:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.033805:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.033810:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.033818:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.033825:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8600, rc 0) 00000100:00100000:1.0:1746144664.033838:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746768000:12345-192.168.204.23@tcp:101:cat.0 Request processed in 56us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.033843:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12064 00000100:00100000:1.0:1746144664.033853:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12065 00000100:00100000:1.0:1746144664.033857:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746767872:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.033864:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.033872:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3d9 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.033884:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.033886:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.033890:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.033899:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.033904:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7f8800, rc 0) 00000100:00100000:1.0:1746144664.033918:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746767872:12345-192.168.204.23@tcp:101:cat.0 Request processed in 61us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.033922:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12065 00000100:00100000:0.0:1746144664.041636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.041749:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746768256 00000100:00100000:2.0:1746144664.041760:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746768256 00002000:00100000:2.0:1746144664.041811:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88008c7d3480 x1830964746768256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.041820:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3480 with x1830964746768256 ext(4194304->4935679) 00002000:00010000:2.0:1746144664.041827:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d3480 00000100:00100000:2.0:1746144664.041865:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4630 00000100:00100000:2.0:1746144664.041873:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746768256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.050171:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746768256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8286us (8534us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144664.050184:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4630 00002000:00100000:2.0:1746144664.050198:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88008c7d3480 x1830964746768256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.050207:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d3480 with x1830964746768256 ext(4194304->4935679) 00002000:00010000:2.0:1746144664.050215:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d3480 00000100:00100000:0.0:1746144664.071978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.072060:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746768384 00000100:00100000:3.0:1746144664.072071:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746768384 00000100:00100000:3.0:1746144664.072162:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12066 00000100:00100000:3.0:1746144664.072171:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+30:29266:x1830964746768384:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.072192:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.072211:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3e7 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.072245:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.072255:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.072262:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.072263:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.072267:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3518464->4194303] (req 3518464->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 31 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.072300:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.072313:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 31 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.072325:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747529856:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.073771:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.073785:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 44 pid: 4760 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.073795:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747529984:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144664.074225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.074276:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746768512 00000100:00100000:2.0:1746144664.074283:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746768512 00010000:00010000:2.0:1746144664.074312:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 32 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.074338:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6019 00000100:00100000:2.0:1746144664.074344:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746768512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.074355:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.074377:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 32 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.074388:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 32 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.074408:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.074433:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746768512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.074440:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6019 00000100:00100000:3.0:1746144664.075908:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2480 going to sleep for 11 seconds 00010000:00010000:3.0:1746144664.075948:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5e600/0xa7c849b16e01ad27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f362 expref: 31 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.075987:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747529856:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.077277:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747529984:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.077314:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3518464->4194303] (req 3518464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.077329:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437ce00, rc 0) 00000100:00100000:3.0:1746144664.077387:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+30:29266:x1830964746768384:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5216us (5419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.077395:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12066 00000100:00100000:0.0:1746144664.080568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.080681:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746768640 00000100:00100000:2.0:1746144664.080692:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746768640 00010000:00010000:2.0:1746144664.080734:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 45 pid: 4760 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.080763:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6020 00000100:00100000:2.0:1746144664.080770:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746768640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.080785:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.080812:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 45 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.080824:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 45 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.080908:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5bba00/0xa7c849b16e01ad19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f35b expref: 45 pid: 4760 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.080938:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.080940:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.080948:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.080957:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.080992:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.081004:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747530112:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.081093:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.084119:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747530112:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.084391:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.084435:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746768640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3664us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.084445:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6020 00000100:00100000:0.0:1746144664.086243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.086843:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746768896 00000100:00100000:2.0:1746144664.086853:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746768896 00002000:00100000:2.0:1746144664.086905:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3518464->3522559) req@ffff88008c7d0a80 x1830964746768896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.086915:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0a80 with x1830964746768896 ext(3518464->3522559) 00002000:00010000:2.0:1746144664.086921:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0a80 00000100:00100000:2.0:1746144664.087332:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4631 00000100:00100000:2.0:1746144664.087340:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746768896:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144664.087651:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746768896:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 310us (1413us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.087658:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4631 00002000:00100000:2.0:1746144664.087664:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3518464->3522559) req@ffff88008c7d0a80 x1830964746768896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.087671:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0a80 with x1830964746768896 ext(3518464->3522559) 00002000:00010000:2.0:1746144664.087674:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0a80 00000100:00100000:0.0:1746144664.094398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.094470:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746769024 00000100:00100000:3.0:1746144664.094481:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746769024 00000100:00100000:3.0:1746144664.094634:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12067 00000100:00100000:3.0:1746144664.094642:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+20:29266:x1830964746769024:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.094662:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.094683:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3ee expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.094711:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 19 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.094718:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.094724:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.094727:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.094730:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.095465:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.095478:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.095490:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747530240:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.095586:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 19 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.095594:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 19 pid: 10724 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.095705:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747530368:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.095726:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.099529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.099783:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747530240:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.099794:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747530368:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.099824:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->3436543] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 21 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.099842:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437d400, rc 0) 00000100:00100000:3.0:1746144664.099886:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+21:29266:x1830964746769024:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5243us (5500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.099896:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12067 00000100:00100000:2.0:1746144664.099986:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746769152 00000100:00100000:2.0:1746144664.099993:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746769152 00010000:00010000:2.0:1746144664.100029:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.100070:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6021 00000100:00100000:2.0:1746144664.100078:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746769152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.100090:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.100112:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.100128:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.100178:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e864600/0xa7c849b16e01ad6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f385 expref: 21 pid: 10724 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.100763:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.100799:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746769152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 720us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.100805:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6021 00000100:00100000:0.0:1746144664.102600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.102707:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746769280 00000100:00100000:2.0:1746144664.102717:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746769280 00010000:00010000:2.0:1746144664.102748:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 20 pid: 10724 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.103080:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6022 00000100:00100000:2.0:1746144664.103088:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746769280:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.103099:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.103120:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 20 pid: 10724 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.103131:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 20 pid: 10724 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.103187:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a1252200/0xa7c849b16e01ad35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f369 expref: 20 pid: 10724 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.103202:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.103205:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.103211:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.103220:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.103253:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.103265:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747530496:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.103346:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.105192:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747530496:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.105215:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.105629:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746769280:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2539us (3033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.105640:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6022 00000100:00100000:0.0:1746144664.109529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.109611:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746769536 00000100:00100000:2.0:1746144664.109622:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746769536 00002000:00100000:2.0:1746144664.109670:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3432448->3436543) req@ffff88009b482300 x1830964746769536/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.109679:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b482300 with x1830964746769536 ext(3432448->3436543) 00002000:00010000:2.0:1746144664.109685:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b482300 00000100:00100000:2.0:1746144664.109718:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4632 00000100:00100000:2.0:1746144664.109725:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746769536:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144664.109921:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746769536:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 196us (403us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.109929:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4632 00002000:00100000:2.0:1746144664.109934:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3432448->3436543) req@ffff88009b482300 x1830964746769536/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.109942:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b482300 with x1830964746769536 ext(3432448->3436543) 00002000:00010000:2.0:1746144664.109944:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b482300 00000100:00100000:0.0:1746144664.113862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.114535:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746769792 00000100:00100000:3.0:1746144664.114545:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746769792 00000100:00100000:3.0:1746144664.115329:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4112 00000100:00100000:3.0:1746144664.115340:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:29266:x1830964746769792:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144664.115733:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:29266:x1830964746769792:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 250us (1737us total) trans 8589944039 rc 0/0 00000100:00100000:3.0:1746144664.115740:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4112 00000100:00100000:0.0:1746144664.156339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.157504:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746770048 00000100:00100000:3.0:1746144664.157517:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746770048 00000100:00100000:3.0:1746144664.157573:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10150 00000100:00100000:3.0:1746144664.157582:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29275:x1830964746770048:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.157611:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.157628:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3f5 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.157744:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157758:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157769:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157786:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157791:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157796:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157900:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157906:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.157912:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.157919:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.157993:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158000:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158006:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158010:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437d800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.158013:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158019:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158039:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.158042:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.158046:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158051:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158076:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158080:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158084:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158088:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437d600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.158089:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158093:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158097:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea200) 00010000:00010000:3.0:1746144664.158099:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.158100:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158104:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.158154:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 302 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.158164:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.158170:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.158172:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144664.158174:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437d000, rc 0) 00000100:00100000:3.0:1746144664.158219:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29275:x1830964746770048:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 638us (1889us total) trans 8589944040 rc 0/0 00000100:00100000:3.0:1746144664.158225:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10150 00000100:00100000:0.0:1746144664.187201:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.187959:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746770176 00000100:00100000:3.0:1746144664.187969:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746770176 00000100:00100000:3.0:1746144664.188038:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12068 00000100:00100000:3.0:1746144664.188048:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:29275:x1830964746770176:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.188069:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.188088:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f3fc expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.188124:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 29 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.188155:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.188162:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.188165:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.188168:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [32768->475135] (req 32768->475135) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 45 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.188204:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.188217:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 45 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.188231:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747530624:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.188341:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 29 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.188350:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 29 pid: 8389 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.188358:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747530752:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.188378:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.190988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.191041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.191670:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747530624:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.191680:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747530752:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.191709:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [32768->475135] (req 32768->475135) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 45 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.191728:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437da00, rc 0) 00000100:00100000:2.0:1746144664.192168:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746770304 00000100:00100000:2.0:1746144664.192176:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746770304 00010000:00010000:2.0:1746144664.192210:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 46 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144664.192243:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746770432 00000100:00100000:2.0:1746144664.192246:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746770432 00010000:00010000:2.0:1746144664.192257:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 30 pid: 8389 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144664.192273:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6023 00000100:00100000:2.0:1746144664.192280:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746770304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.192294:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.192318:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 46 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.192328:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 46 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.192351:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8200/0xa7c849b16e01addd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d2 expref: 46 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.192375:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.192428:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:29275:x1830964746770176:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4381us (5239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.192439:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12068 00000100:00100000:3.0:1746144664.192503:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6024 00000100:00100000:3.0:1746144664.192509:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+30:1962:x1830964746770432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.192517:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.192527:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 30 pid: 8389 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.192535:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 30 pid: 8389 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.192548:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c90d800/0xa7c849b16e01ad9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f39a expref: 30 pid: 8389 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.192560:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.192562:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.192568:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 44 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.192575:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 44 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.192605:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 44 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.192617:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747530880:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.193598:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746770304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1314us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.193606:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6023 00000100:00100000:3.0:1746144664.193712:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.196435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.197127:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747530880:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.197180:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.197224:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746770432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4714us (6180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.197234:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6024 00000100:00100000:3.0:1746144664.197687:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746770688 00000100:00100000:3.0:1746144664.197695:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746770688 00002000:00100000:3.0:1746144664.197735:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (32768->36863) req@ffff88009b481880 x1830964746770688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.197744:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481880 with x1830964746770688 ext(32768->36863) 00002000:00010000:3.0:1746144664.197749:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481880 00000100:00100000:3.0:1746144664.197775:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4633 00000100:00100000:3.0:1746144664.197783:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1960:x1830964746770688:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144664.197950:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1960:x1830964746770688:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 167us (1522us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144664.197956:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4633 00002000:00100000:3.0:1746144664.197962:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (32768->36863) req@ffff88009b481880 x1830964746770688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.197969:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481880 with x1830964746770688 ext(32768->36863) 00002000:00010000:3.0:1746144664.197972:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481880 00000100:00100000:0.0:1746144664.202427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.202574:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746770944 00000100:00100000:2.0:1746144664.202585:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746770944 00002000:00100000:2.0:1746144664.202637:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (471040->475135) req@ffff88009b481500 x1830964746770944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.202646:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481500 with x1830964746770944 ext(471040->475135) 00002000:00010000:2.0:1746144664.202652:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481500 00000100:00100000:2.0:1746144664.202687:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4634 00000100:00100000:2.0:1746144664.202694:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746770944:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144664.202896:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746770944:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 201us (478us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.202902:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4634 00002000:00100000:2.0:1746144664.202908:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (471040->475135) req@ffff88009b481500 x1830964746770944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.202915:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481500 with x1830964746770944 ext(471040->475135) 00002000:00010000:2.0:1746144664.202919:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b481500 00000100:00100000:0.0:1746144664.204589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.204818:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746771200 00000100:00100000:3.0:1746144664.204826:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746771200 00000100:00100000:3.0:1746144664.204876:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4113 00000100:00100000:3.0:1746144664.204883:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29275:x1830964746771200:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144664.205997:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29275:x1830964746771200:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1110us (1409us total) trans 8589944041 rc 0/0 00000100:00100000:3.0:1746144664.206005:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4113 00000100:00100000:0.0:1746144664.238298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.238995:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746771456 00000100:00100000:1.0:1746144664.239007:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746771456 00000100:00100000:3.0:1746144664.239248:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10151 00000100:00100000:3.0:1746144664.239260:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29280:x1830964746771456:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.239290:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.239314:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f403 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.239439:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239452:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239463:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239476:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239482:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239487:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239824:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239833:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239839:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.239849:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.239937:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239947:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239952:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239956:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437de00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.239959:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239965:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239976:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.239978:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.239982:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.239986:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240207:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240213:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240218:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240222:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437d800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.240224:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240232:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240239:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaa00) 00010000:00010000:3.0:1746144664.240241:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.240243:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240248:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d800/0xa7c849b16e01ae38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.240291:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d600/0xa7c849b16e01ae2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.240301:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.240307:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.240309:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144664.240311:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437c600, rc 0) 00000100:00100000:3.0:1746144664.240499:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:29280:x1830964746771456:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1240us (2211us total) trans 8589944042 rc 0/0 00000100:00100000:3.0:1746144664.240506:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10151 00000100:00100000:1.0:1746144664.243716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.243951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.245083:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746771584 00000100:00100000:3.0:1746144664.245097:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746771584 00000100:00100000:3.0:1746144664.245159:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746771712 00000100:00100000:3.0:1746144664.245162:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746771712 00000100:00100000:3.0:1746144664.245183:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12069 00000100:00100000:3.0:1746144664.245189:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746771584:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.245209:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.245230:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437d600/0xa7c849b16e01ae4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f40a expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.245286:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747531008:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144664.245374:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.245405:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12070 00000100:00100000:3.0:1746144664.245412:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746771712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.245420:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.245429:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009437dc00/0xa7c849b16e01ae54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f411 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.245453:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747531136:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144664.245472:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.245876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.246961:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746771968 00000100:00100000:3.0:1746144664.246969:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746771968 00000100:00100000:3.0:1746144664.247028:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10152 00000100:00100000:3.0:1746144664.247035:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:29281:x1830964746771968:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.247054:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.247070:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4efac00/0xa7c849b16e01ae5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f418 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.247212:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.247227:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.247237:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.247242:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.247268:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.247280:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 12 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.247290:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747531264:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.247377:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.247385:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 301 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.247392:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747531392:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.247410:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.248583:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747531136:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144664.248611:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009437dc00/0xa7c849b16e01ae54 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f411 expref: 21 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.248624:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009437dc00/0xa7c849b16e01ae54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f411 expref: 21 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.248653:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437dc00, rc 0) 00000100:00100000:3.0:1746144664.248690:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746771712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3277us (4738us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144664.248698:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12070 00000100:00100000:2.0:1746144664.248970:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747531008:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144664.248988:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437d600/0xa7c849b16e01ae4d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f40a expref: 30 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.248997:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437d600/0xa7c849b16e01ae4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f40a expref: 30 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.249009:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437d600, rc 0) 00000100:00100000:2.0:1746144664.249043:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746771584:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3854us (5336us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144664.249049:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12069 00000100:00100000:2.0:1746144664.249729:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747531264:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.249737:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747531392:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.249751:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144664.250268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.250326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.250493:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746772224 00000100:00100000:1.0:1746144664.250499:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746772224 00010000:00010000:1.0:1746144664.250530:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 302 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.250584:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746772096 00000100:00100000:1.0:1746144664.250587:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746772096 00010000:00010000:1.0:1746144664.250598:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 13 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.250612:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6025 00000100:00100000:1.0:1746144664.250619:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1960:x1830964746772224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.250630:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.250636:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 302 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.250645:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 302 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.250664:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d000/0xa7c849b16e01ae15 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3f5 expref: 302 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.250712:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6026 00000100:00100000:2.0:1746144664.250719:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746772096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.250727:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.250731:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 13 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.250739:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 13 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.250755:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437c600/0xa7c849b16e01ae3f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f403 expref: 13 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.250765:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.250769:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.250778:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.250784:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.250802:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144664.250926:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.250933:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.250951:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.251097:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4efac00/0xa7c849b16e01ae5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.251108:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.251114:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.251116:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144664.251118:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c198000, rc 0) 00010000:00010000:1.0:1746144664.251281:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.251284:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.251337:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746772096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 619us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.251344:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6026 00000100:00100000:3.0:1746144664.251974:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:29281:x1830964746771968:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4938us (6097us total) trans 8589944043 rc 0/0 00000100:00100000:3.0:1746144664.251980:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10152 00000100:00100000:1.0:1746144664.252077:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1960:x1830964746772224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1457us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.252083:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6025 00000100:00100000:0.0:1746144664.253222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.253345:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746772352 00000100:00100000:2.0:1746144664.253353:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746772352 00000100:00100000:2.0:1746144664.253418:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12071 00000100:00100000:2.0:1746144664.253425:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:29280:x1830964746772352:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.253444:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.253459:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f41f expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.253486:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 43 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.253499:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.253501:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.253505:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.253533:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 43 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.253545:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 43 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.253559:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747531520:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.254453:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.258729:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747531520:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.258767:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.258788:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7c00, rc 0) 00000100:00100000:2.0:1746144664.258836:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+30:29280:x1830964746772352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5411us (5617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.258846:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12071 00000100:00100000:0.0:1746144664.260329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.260440:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746772480 00000100:00100000:3.0:1746144664.260449:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746772480 00002000:00100000:3.0:1746144664.260494:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (32768->475135) req@ffff88009b480380 x1830964746772480/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.260508:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480380 with x1830964746772480 ext(32768->475135) 00010000:00010000:3.0:1746144664.260517:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.260528:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 44 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.260534:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b480380 00000100:00100000:3.0:1746144664.260554:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 919 00000100:00100000:3.0:1746144664.260562:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746772480:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1746144664.270338:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746772480:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 9761us (9999us total) trans 17179873323 rc 0/0 00000100:00100000:3.0:1746144664.270354:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 919 00002000:00100000:3.0:1746144664.270372:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (32768->475135) req@ffff88009b480380 x1830964746772480/t17179873323(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.270382:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480380 with x1830964746772480 ext(32768->475135) 00010000:00010000:3.0:1746144664.270393:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 46 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.270411:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 46 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.270419:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b480380 00000100:00100000:0.0:1746144664.284245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.284379:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746772608 00000100:00100000:1.0:1746144664.284389:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746772608 00010000:00010000:1.0:1746144664.284428:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 46 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.285360:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6027 00000100:00100000:1.0:1746144664.285371:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746772608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.285392:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.285424:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 46 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.285438:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 46 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.285469:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437da00/0xa7c849b16e01ae23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 32768->475135) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3fc expref: 46 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.285512:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.285514:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.285524:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.285532:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.285577:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.285591:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747531648:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144664.286131:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.297262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.297460:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746772864 00000100:00100000:3.0:1746144664.297471:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746772864 00000100:00100000:3.0:1746144664.297519:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10153 00000100:00100000:3.0:1746144664.297527:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29284:x1830964746772864:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.297553:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.297573:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f426 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.297579:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747531648:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144664.297604:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.297646:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746772608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 12279us (13410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.297656:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6027 00010000:00010000:3.0:1746144664.297698:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297711:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297722:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297734:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297740:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297745:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297853:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297861:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297867:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.297882:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.297968:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297975:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297981:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297986:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437ca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.297990:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.297995:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298004:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.298007:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.298010:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298014:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437ca00/0xa7c849b16e01ae7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298050:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298056:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298061:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298068:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437cc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.298070:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298075:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298080:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaf00) 00010000:00010000:3.0:1746144664.298082:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.298084:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298088:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437cc00/0xa7c849b16e01ae85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.298123:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437de00/0xa7c849b16e01ae77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 304 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.298166:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 303 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.298172:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.298174:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144664.298177:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437d200, rc 0) 00000100:00100000:3.0:1746144664.298208:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29284:x1830964746772864:12345-192.168.204.23@tcp:101:cat.0 Request processed in 682us (956us total) trans 8589944044 rc 0/0 00000100:00100000:3.0:1746144664.298214:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10153 00000100:00100000:0.0:1746144664.302330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.304812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.305250:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746773376 00000100:00100000:2.0:1746144664.305263:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746773376 00000100:00100000:2.0:1746144664.305325:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4114 00000100:00100000:2.0:1746144664.305337:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29284:x1830964746773376:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144664.305639:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746773120 00000100:00100000:2.0:1746144664.305641:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29284:x1830964746773376:12345-192.168.204.23@tcp:35:cat.0 Request processed in 303us (837us total) trans 8589944045 rc 0/0 00000100:00100000:3.0:1746144664.305644:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746773120 00000100:00100000:2.0:1746144664.305649:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4114 00002000:00100000:3.0:1746144664.305675:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009b480700 x1830964746773120/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.305685:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480700 with x1830964746773120 ext(0->1048575) 00002000:00010000:3.0:1746144664.305690:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b480700 00000100:00100000:3.0:1746144664.305705:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4635 00000100:00100000:3.0:1746144664.305711:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746773120:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.310287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.310327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.310426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.310610:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746773504 00000100:00100000:0.0:1746144664.310619:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746773504 00000100:00100000:0.0:1746144664.310660:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746773632 00000100:00100000:0.0:1746144664.310662:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746773632 00000100:00100000:0.0:1746144664.310684:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746773760 00000100:00100000:0.0:1746144664.310686:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746773760 00000100:00100000:0.0:1746144664.310704:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12072 00000100:00100000:1.0:1746144664.310711:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12073 00000100:00100000:0.0:1746144664.310711:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1963:x1830964746773504:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144664.310718:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746773632:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144664.310738:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12074 00000100:00100000:0.0:1746144664.310742:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746773760:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.310743:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.310749:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.310763:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b764e00/0xa7c849b16e01ae9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f434 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.310763:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c90c800/0xa7c849b16e01aea1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f43b expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.310814:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747531776:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144664.310814:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ea0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747531904:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144664.311529:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b60b600 going to sleep for 11 seconds 00010000:00010000:0.0:1746144664.311542:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.311550:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f42d expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.311562:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.311565:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.311576:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 48 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.311590:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 48 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.311601:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c90da00, rc 0) 00000100:00100000:0.0:1746144664.311623:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746773504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 913us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.311629:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12072 00000100:00100000:1.0:1746144664.312465:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00002000:00010000:0.0:1746144664.316195:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144664 -> 1746144665 00000100:00100000:0.0:1746144664.316231:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ea0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747531904:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144664.316280:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c90c800/0xa7c849b16e01aea1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f43b expref: 20 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.316295:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c90c800/0xa7c849b16e01aea1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f43b expref: 20 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.316319:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c90c800, rc 0) 00002000:00010000:1.0:1746144664.316497:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144664 -> 1746144665 00000100:00100000:1.0:1746144664.316514:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747531776:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144664.316539:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b764e00/0xa7c849b16e01ae9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f434 expref: 47 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.316548:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b764e00/0xa7c849b16e01ae9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f434 expref: 47 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.316570:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764e00, rc 0) 00000100:00100000:1.0:1746144664.316600:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746773632:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5882us (6270us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144664.316608:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12073 00000100:00100000:0.0:1746144664.316843:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746773760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6097us (6414us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144664.316849:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12074 00000100:00100000:0.0:1746144664.329012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.329122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.329409:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746774016 00000100:00100000:2.0:1746144664.329421:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746774016 00002000:00100000:2.0:1746144664.329475:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0ed80 x1830964746774016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.329485:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ed80 with x1830964746774016 ext(0->1048575) 00002000:00010000:2.0:1746144664.329492:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0ed80 00000100:00100000:2.0:1746144664.329513:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746774272 00000100:00100000:2.0:1746144664.329516:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746774272 00002000:00100000:2.0:1746144664.329530:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0c000 x1830964746774272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 504/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.329538:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c000 with x1830964746774272 ext(1048576->2097151) 00002000:00010000:2.0:1746144664.329541:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0c000 00000100:00100000:2.0:1746144664.329554:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4636 00000100:00100000:2.0:1746144664.329561:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746774016:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.330428:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4637 00000100:00100000:1.0:1746144664.330439:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746774272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.336919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.336956:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746774528 00000100:00100000:0.0:1746144664.336967:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746774528 00002000:00100000:0.0:1746144664.337028:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0ce00 x1830964746774528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.337040:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ce00 with x1830964746774528 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.337046:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0ce00 00000100:00100000:0.0:1746144664.337075:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4638 00000100:00100000:0.0:1746144664.337086:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746774528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.339438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.340351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.340391:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746774784 00000100:00100000:0.0:1746144664.340401:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746774784 00002000:00100000:0.0:1746144664.340453:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0ca80 x1830964746774784/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.340464:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ca80 with x1830964746774784 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.340470:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0ca80 00000100:00100000:0.0:1746144664.340500:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4639 00000100:00100000:0.0:1746144664.340510:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1962:x1830964746774784:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.344289:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775040 00000100:00100000:2.0:1746144664.344309:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775040 00000100:00100000:2.0:1746144664.344389:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10154 00000100:00100000:2.0:1746144664.344401:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29286:x1830964746775040:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144664.344431:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.344455:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01aeaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f442 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.344602:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344620:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344633:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344650:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344656:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344662:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344787:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6200/0xa7c849b16e01aec4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344799:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6200/0xa7c849b16e01aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344806:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6200/0xa7c849b16e01aec4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144664.344816:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144664.344922:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344930:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344939:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344945:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e7e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.344949:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344956:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344969:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144664.344972:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144664.344977:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.344982:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01aeb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345002:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345007:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345012:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345050:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e7800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.345055:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345060:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345072:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4e33e00) 00010000:00010000:2.0:1746144664.345074:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144664.345077:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345081:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aebd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.345128:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01aeaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f442 expref: 307 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.345177:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6200/0xa7c849b16e01aec4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f442 expref: 306 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.345184:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.345186:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144664.345188:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e6200, rc 0) 00000100:00100000:2.0:1746144664.345249:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29286:x1830964746775040:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 849us (5815us total) trans 8589944046 rc 0/0 00000100:00100000:2.0:1746144664.345256:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10154 00000100:00100000:2.0:1746144664.345351:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746773120:12345-192.168.204.23@tcp:3:cat.0 Request processed in 39638us (43031us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.345361:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4635 00002000:00100000:2.0:1746144664.345372:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009b480700 x1830964746773120/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.345381:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b480700 with x1830964746773120 ext(0->1048575) 00002000:00010000:2.0:1746144664.345386:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b480700 00000100:00100000:0.0:1746144664.356193:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746774272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25744us (27057us total) trans 0 rc 634880/634880 00000100:00100000:0.0:1746144664.356207:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4637 00002000:00100000:0.0:1746144664.356221:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0c000 x1830964746774272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 504/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 634880/634880 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.356231:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c000 with x1830964746774272 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.356237:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0c000 00000100:00100000:0.0:1746144664.356841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.357624:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775168 00000100:00100000:2.0:1746144664.357633:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775168 00000100:00100000:2.0:1746144664.358234:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12075 00000100:00100000:2.0:1746144664.358241:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:29280:x1830964746775168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.358258:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.358276:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f449 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.358304:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.358312:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.358313:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.358317:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.358344:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.358354:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 20 pid: 8388 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.358364:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747532032:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.359326:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.360944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.361046:0:14704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775296 00000100:00100000:3.0:1746144664.361054:0:14704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775296 00000100:00100000:3.0:1746144664.361111:0:14704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:3.0:1746144664.361120:0:14704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:087a468c-8f92-434b-ae24-50378d554a48+15:1960:x1830964746775296:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1746144664.361211:0:14704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:087a468c-8f92-434b-ae24-50378d554a48+15:1960:x1830964746775296:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.361218:0:14704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:0.0:1746144664.365576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.365635:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775424 00000100:00100000:1.0:1746144664.365644:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775424 00002000:00100000:1.0:1746144664.365685:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1388544->1802239) req@ffff88009ea0ea00 x1830964746775424/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.365695:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ea00 with x1830964746775424 ext(1388544->1802239) 00010000:00010000:1.0:1746144664.365703:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 21 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.365718:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 21 pid: 8388 timeout: 743 lvb_type: 0 00002000:00010000:1.0:1746144664.365725:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea0ea00 00000100:00100000:1.0:1746144664.365745:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 920 00000100:00100000:1.0:1746144664.365752:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746775424:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144664.365900:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1962:x1830964746774784:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25392us (25552us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144664.365907:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4639 00002000:00100000:0.0:1746144664.365913:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0ca80 x1830964746774784/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.365920:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ca80 with x1830964746774784 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.365923:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0ca80 00000100:00100000:2.0:1746144664.368313:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746774528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 31218us (31396us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.368326:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4638 00002000:00100000:2.0:1746144664.368337:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0ce00 x1830964746774528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.368346:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ce00 with x1830964746774528 ext(1048576->2097151) 00002000:00010000:2.0:1746144664.368351:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0ce00 00000100:00100000:3.0:1746144664.368463:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747532032:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.368497:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.368515:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7a00, rc 0) 00000100:00100000:3.0:1746144664.368546:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:29280:x1830964746775168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 10306us (11706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.368557:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12075 00000100:00100000:3.0:1746144664.376747:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746774016:12345-192.168.204.23@tcp:3:cat.0 Request processed in 47173us (47733us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.376761:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4636 00002000:00100000:3.0:1746144664.376774:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0ed80 x1830964746774016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.376788:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ed80 with x1830964746774016 ext(0->1048575) 00002000:00010000:3.0:1746144664.376794:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0ed80 00000100:00100000:0.0:1746144664.377460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.377514:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775552 00000100:00100000:2.0:1746144664.377522:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775552 00000100:00100000:2.0:1746144664.377571:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 641 00000100:00100000:2.0:1746144664.377578:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:1961:x1830964746775552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.377594:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.377624:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6200/0xa7c849b16e01aec4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f442 expref: 306 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.377660:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.377665:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.377688:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:1961:x1830964746775552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.377694:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 641 00000100:00100000:2.0:1746144664.381969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.382048:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775680 00000100:00100000:3.0:1746144664.382058:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775680 00000100:00100000:3.0:1746144664.382117:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12076 00000100:00100000:3.0:1746144664.382125:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:29284:x1830964746775680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.382161:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.382181:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f450 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.382211:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144664.382217:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.382229:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.382240:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437da00, rc 0) 00000100:00100000:3.0:1746144664.382286:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29284:x1830964746775680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 163us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.382292:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12076 00000100:00100000:0.0:1746144664.382732:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746775424:12345-192.168.204.23@tcp:4:cat.0 Request processed in 16977us (17165us total) trans 21474840553 rc 0/0 00000100:00100000:0.0:1746144664.382742:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 920 00002000:00100000:0.0:1746144664.382751:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1388544->1802239) req@ffff88009ea0ea00 x1830964746775424/t21474840553(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.382876:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0ea00 with x1830964746775424 ext(1388544->1802239) 00010000:00010000:0.0:1746144664.382885:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.382898:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746144664.382904:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ea0ea00 00000100:00100000:0.0:1746144664.392251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.392456:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746775808 00000100:00100000:3.0:1746144664.392469:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746775808 00010000:00010000:3.0:1746144664.392517:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.392583:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6028 00000100:00100000:3.0:1746144664.392594:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746775808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.392613:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.392692:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.392706:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.392732:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8400/0xa7c849b16e01add6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->1802239) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3cb expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.392755:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.392757:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.392764:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.392772:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.392780:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.392781:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.392784:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.392790:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.392823:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.392836:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747532160:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144664.393722:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.393732:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747532288:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.393758:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.411701:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747532160:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144664.412038:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.412095:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747532288:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144664.412115:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144664.412238:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746776064 00000100:00100000:0.0:1746144664.412246:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746776064 00002000:00100000:0.0:1746144664.412290:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f39b480 x1830964746776064/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.412299:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b480 with x1830964746776064 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.412304:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39b480 00000100:00100000:3.0:1746144664.412412:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746775808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 19819us (20173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.412422:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6028 00000100:00100000:3.0:1746144664.412554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.412565:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4640 00000100:00100000:0.0:1746144664.412573:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746776064:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.412709:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746776192 00000100:00100000:1.0:1746144664.412713:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746776192 00000100:00100000:1.0:1746144664.412751:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12077 00000100:00100000:1.0:1746144664.412756:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:29286:x1830964746776192:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144664.412766:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.412794:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f457 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.412819:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.412826:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144664.412827:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144664.412830:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3457024->3997695] (req 3457024->3997695) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.412858:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.412874:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 29 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.412885:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747532416:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.412951:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.416662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.416701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.416733:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746776448 00000100:00100000:0.0:1746144664.416738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.416743:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746776448 00002000:00100000:2.0:1746144664.416785:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0e300 x1830964746776448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.416795:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e300 with x1830964746776448 ext(1048576->2097151) 00002000:00010000:2.0:1746144664.416801:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0e300 00000100:00100000:2.0:1746144664.416832:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746776704 00000100:00100000:2.0:1746144664.416834:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746776704 00002000:00100000:2.0:1746144664.416846:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0c380 x1830964746776704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.416852:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c380 with x1830964746776704 ext(1048576->2097151) 00002000:00010000:2.0:1746144664.416855:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0c380 00000100:00100000:1.0:1746144664.416860:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746776960 00000100:00100000:1.0:1746144664.416867:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746776960 00000100:00100000:2.0:1746144664.416877:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4641 00000100:00100000:1.0:1746144664.416883:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4642 00000100:00100000:2.0:1746144664.416885:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746776448:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.416891:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746776704:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:0.0:1746144664.419186:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0d180 x1830964746776960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.419198:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0d180 with x1830964746776960 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.419203:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0d180 00000100:00100000:0.0:1746144664.419237:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4643 00000100:00100000:0.0:1746144664.419245:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746776960:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.425684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.425749:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777088 00000100:00100000:3.0:1746144664.425758:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777088 00002000:00100000:3.0:1746144664.425828:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3518464->4194303) req@ffff88009ea0d500 x1830964746777088/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.425837:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0d500 with x1830964746777088 ext(3518464->4194303) 00000100:00100000:0.0:1746144664.426035:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746776064:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13461us (13996us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144664.426045:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4640 00002000:00100000:0.0:1746144664.426051:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f39b480 x1830964746776064/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.426058:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b480 with x1830964746776064 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.426063:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39b480 00010000:00010000:3.0:1746144664.426124:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 32 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.426167:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 32 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.426174:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0d500 00000100:00100000:3.0:1746144664.426190:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 921 00000100:00100000:3.0:1746144664.426198:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746777088:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144664.426345:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747532416:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144664.426377:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3457024->3997695] (req 3457024->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.426392:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6000, rc 0) 00000100:00100000:1.0:1746144664.426416:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:29286:x1830964746776192:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 13660us (13863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.426423:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12077 00000100:00100000:0.0:1746144664.429377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.429610:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777344 00000100:00100000:2.0:1746144664.429620:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777344 00000100:00100000:3.0:1746144664.430196:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746776448:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13308us (13543us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.430207:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4641 00002000:00100000:3.0:1746144664.430218:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0e300 x1830964746776448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.430229:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e300 with x1830964746776448 ext(1048576->2097151) 00002000:00010000:3.0:1746144664.430234:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0e300 00002000:00100000:2.0:1746144664.430327:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3514368->3518463) req@ffff88009ea0f480 x1830964746777344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.430335:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f480 with x1830964746777344 ext(3514368->3518463) 00002000:00010000:2.0:1746144664.430339:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0f480 00000100:00100000:2.0:1746144664.430354:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4644 00000100:00100000:2.0:1746144664.430362:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746777344:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144664.430502:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746777344:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 141us (1136us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.430516:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4644 00002000:00100000:2.0:1746144664.430520:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3514368->3518463) req@ffff88009ea0f480 x1830964746777344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.430526:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f480 with x1830964746777344 ext(3514368->3518463) 00002000:00010000:2.0:1746144664.430529:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0f480 00000100:00100000:1.0:1746144664.436390:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746776704:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19487us (19674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144664.436403:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4642 00002000:00100000:1.0:1746144664.436415:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0c380 x1830964746776704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.436424:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0c380 with x1830964746776704 ext(1048576->2097151) 00002000:00010000:1.0:1746144664.436431:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0c380 00000100:00100000:2.0:1746144664.440283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.440306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.440373:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777600 00000100:00100000:3.0:1746144664.440383:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777600 00000100:00100000:3.0:1746144664.440427:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777472 00000100:00100000:3.0:1746144664.440429:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777472 00000100:00100000:3.0:1746144664.440454:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12078 00000100:00100000:3.0:1746144664.440463:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746777600:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144664.440464:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12079 00000100:00100000:2.0:1746144664.440472:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746777472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.440484:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.440484:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.440502:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ca3de00/0xa7c849b16e01aeee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f465 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.440502:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f000/0xa7c849b16e01aee7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f45e expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.440550:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747532544:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144664.440550:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747532672:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144664.440615:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.440752:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144664.441147:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746776960:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21889us (24393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144664.441157:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4643 00002000:00100000:1.0:1746144664.441165:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0d180 x1830964746776960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.441174:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0d180 with x1830964746776960 ext(1048576->2097151) 00002000:00010000:1.0:1746144664.441178:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0d180 00002000:00010000:0.0:1746144664.443530:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144664 -> 1746144665 00002000:00010000:0.0:1746144664.443537:0:8388:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144664 -> 1746144665 00000100:00100000:0.0:1746144664.443561:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747532544:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144664.443591:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ca3de00/0xa7c849b16e01aeee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f465 expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.443604:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ca3de00/0xa7c849b16e01aeee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f465 expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.443619:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ca3de00, rc 0) 00000100:00100000:0.0:1746144664.443653:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746777600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3191us (3380us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144664.443660:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12078 00002000:00010000:2.0:1746144664.443814:0:22208:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144664 -> 1746144665 00002000:00010000:2.0:1746144664.443817:0:22208:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144664 -> 1746144665 00000100:00100000:2.0:1746144664.443826:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747532672:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144664.443845:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f000/0xa7c849b16e01aee7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f45e expref: 48 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.443853:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f000/0xa7c849b16e01aee7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f45e expref: 48 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.443866:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f000, rc 0) 00000100:00100000:2.0:1746144664.443885:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746777472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3415us (3578us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144664.443890:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12079 00000100:00100000:3.0:1746144664.447830:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746777088:12345-192.168.204.23@tcp:4:cat.0 Request processed in 21619us (22143us total) trans 17179873324 rc 0/0 00000100:00100000:3.0:1746144664.447842:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 921 00002000:00100000:3.0:1746144664.447855:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3518464->4194303) req@ffff88009ea0d500 x1830964746777088/t17179873324(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.447863:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0d500 with x1830964746777088 ext(3518464->4194303) 00010000:00010000:3.0:1746144664.447872:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 32 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.447885:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 32 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.447892:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0d500 00000100:00100000:1.0:1746144664.448847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.448981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.449056:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777728 00000100:00100000:2.0:1746144664.449065:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777728 00000100:00100000:2.0:1746144664.449095:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777856 00000100:00100000:2.0:1746144664.449097:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777856 00000100:00100000:2.0:1746144664.449110:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12080 00000100:00100000:2.0:1746144664.449118:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+32:29281:x1830964746777728:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144664.449169:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.449186:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f46c expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.449211:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.449214:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.449218:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.449230:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4481023] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.449240:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e3400, rc 0) 00000100:00100000:2.0:1746144664.449265:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+33:29281:x1830964746777728:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 148us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.449271:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12080 00000100:00100000:2.0:1746144664.449282:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12081 00000100:00100000:2.0:1746144664.449286:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:29284:x1830964746777856:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.449293:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.449298:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f473 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.449309:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.449311:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.449313:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.449320:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.449328:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e3c00, rc 0) 00000100:00100000:2.0:1746144664.449342:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:29284:x1830964746777856:12345-192.168.204.23@tcp:101:cat.0 Request processed in 55us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.449347:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12081 00000100:00100000:0.0:1746144664.452574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.452625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.452694:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746777984 00000100:00100000:3.0:1746144664.452703:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746777984 00010000:00010000:3.0:1746144664.452738:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 33 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.452773:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6029 00000100:00100000:3.0:1746144664.452779:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746777984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.452795:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144664.452834:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746778112 00000100:00100000:1.0:1746144664.452837:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746778112 00000100:00100000:1.0:1746144664.452858:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12082 00000100:00100000:1.0:1746144664.452862:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+34:29280:x1830964746778112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.452875:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.452885:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f47a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.452903:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144664.452908:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.452919:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.452928:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782c00, rc 0) 00010000:00010000:3.0:1746144664.453104:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 35 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.453115:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 35 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.453368:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+35:29280:x1830964746778112:12345-192.168.204.23@tcp:101:cat.0 Request processed in 504us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.453375:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12082 00010000:00010000:3.0:1746144664.453434:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01adf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3518464->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e7 expref: 34 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.453448:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453449:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453456:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453464:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453471:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453472:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453476:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453483:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453488:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453489:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453492:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453498:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453509:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453510:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.453512:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453519:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.453548:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.453559:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747532800:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.453784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.453882:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746778240 00000100:00100000:0.0:1746144664.453885:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746778240 00000100:00100000:0.0:1746144664.453913:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10155 00000100:00100000:0.0:1746144664.453919:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29287:x1830964746778240:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144664.453934:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.453948:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b8e00/0xa7c849b16e01af0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f481 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.454007:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454035:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454044:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454057:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454063:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454068:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454201:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454212:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.454218:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.454239:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.454249:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 11 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.454258:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747532928:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144664.454295:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b60b600 going to sleep for 11 seconds 00010000:00010000:3.0:1746144664.454415:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.454425:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747533056:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144664.454452:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.454460:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747533184:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144664.454481:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.454489:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747533312:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.454505:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.458751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.458787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.458825:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746778368 00000100:00100000:0.0:1746144664.458832:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746778368 00010000:00010000:0.0:1746144664.458866:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 12 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.458908:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6030 00000100:00100000:0.0:1746144664.458914:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746778368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.458926:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.458936:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 12 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.458948:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 12 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.458971:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.458976:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.458986:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.458993:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.459008:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144664.459057:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746778368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.459064:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6030 00000100:00100000:0.0:1746144664.459172:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746778624 00000100:00100000:0.0:1746144664.459176:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746778624 00002000:00100000:0.0:1746144664.459203:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3457024->3461119) req@ffff8800a4dd6300 x1830964746778624/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.459213:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd6300 with x1830964746778624 ext(3457024->3461119) 00002000:00010000:0.0:1746144664.459218:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd6300 00000100:00100000:0.0:1746144664.459229:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4645 00000100:00100000:0.0:1746144664.459234:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1960:x1830964746778624:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:2.0:1746144664.459423:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c198000/0xa7c849b16e01ae62 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f418 expref: 11 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.459447:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747532928:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.459464:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459470:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459475:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144664.459518:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144664.459521:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144664.459537:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459547:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459557:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459563:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459569:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459575:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7b9000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.459578:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459584:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459593:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144664.459595:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144664.459599:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459603:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9000/0xa7c849b16e01af11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459611:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459615:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459620:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459623:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7b9200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.459625:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459629:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459638:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8b00) 00010000:00010000:2.0:1746144664.459640:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144664.459642:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459646:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9200/0xa7c849b16e01af18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.459676:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b8e00/0xa7c849b16e01af0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.459687:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.459691:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.459693:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144664.459695:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b9400, rc 0) 00000100:00100000:2.0:1746144664.459722:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746778240:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5803us (5938us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.459729:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10155 00000100:00100000:3.0:1746144664.459865:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747532800:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.459878:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747533056:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.459886:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747533184:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.459891:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747533312:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144664.459905:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.459926:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746777984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7147us (7361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.459938:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6029 00000100:00100000:0.0:1746144664.460221:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1960:x1830964746778624:12345-192.168.204.23@tcp:3:cat.0 Request processed in 985us (1431us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144664.460228:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4645 00002000:00100000:0.0:1746144664.460234:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3457024->3461119) req@ffff8800a4dd6300 x1830964746778624/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.460241:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd6300 with x1830964746778624 ext(3457024->3461119) 00002000:00010000:0.0:1746144664.460244:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd6300 00000100:00100000:2.0:1746144664.460332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.460502:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746778880 00000100:00100000:0.0:1746144664.460510:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746778880 00002000:00100000:0.0:1746144664.460528:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4476928->4481023) req@ffff88008c7d0000 x1830964746778880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.460535:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0000 with x1830964746778880 ext(4476928->4481023) 00002000:00010000:0.0:1746144664.460538:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0000 00000100:00100000:0.0:1746144664.460549:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4646 00000100:00100000:0.0:1746144664.460554:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746778880:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.460723:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746778880:12345-192.168.204.23@tcp:3:cat.0 Request processed in 167us (390us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144664.460729:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4646 00002000:00100000:0.0:1746144664.460735:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4476928->4481023) req@ffff88008c7d0000 x1830964746778880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.460741:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0000 with x1830964746778880 ext(4476928->4481023) 00002000:00010000:0.0:1746144664.460744:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d0000 00000100:00100000:0.0:1746144664.462101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.462169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.462215:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746779136 00000100:00100000:1.0:1746144664.462604:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746779520 00000100:00100000:1.0:1746144664.462611:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746779520 00002000:00100000:1.0:1746144664.462644:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4dd5500 x1830964746779520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.462653:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5500 with x1830964746779520 ext(2097152->3145727) 00002000:00010000:1.0:1746144664.462657:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5500 00000100:00100000:3.0:1746144664.462718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.463298:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746779648 00000100:00100000:3.0:1746144664.463302:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746779648 00002000:00100000:3.0:1746144664.463322:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee08e00 x1830964746779648/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.463331:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08e00 with x1830964746779648 ext(2097152->3145727) 00002000:00010000:3.0:1746144664.463334:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee08e00 00000100:00100000:3.0:1746144664.463350:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4647 00000100:00100000:3.0:1746144664.463356:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746779520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.463742:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746779136 00002000:00100000:2.0:1746144664.463767:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4dd5180 x1830964746779136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.463775:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5180 with x1830964746779136 ext(2097152->3145727) 00002000:00010000:2.0:1746144664.463778:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5180 00000100:00100000:2.0:1746144664.464366:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4648 00000100:00100000:1.0:1746144664.464375:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4649 00000100:00100000:2.0:1746144664.464376:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746779648:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.464385:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746779136:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.465922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.466051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.466078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.466091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.466108:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746779776 00000100:00100000:2.0:1746144664.466114:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746779776 00000100:00100000:2.0:1746144664.466160:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746779904 00000100:00100000:2.0:1746144664.466162:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746779904 00000100:00100000:2.0:1746144664.466175:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746780032 00000100:00100000:2.0:1746144664.466177:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746780032 00000100:00100000:0.0:1746144664.466179:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746780160 00000100:00100000:0.0:1746144664.466183:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746780160 00000100:00100000:2.0:1746144664.466190:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12083 00000100:00100000:0.0:1746144664.466211:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12084 00000100:00100000:0.0:1746144664.466217:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746779904:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144664.466230:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.466248:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f48f expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.466292:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12085 00000100:00100000:1.0:1746144664.466299:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746780032:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144664.466306:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.466313:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f496 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.466329:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.466331:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.466340:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.466342:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746779776:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144664.466353:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.466355:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.466364:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783000, rc 0) 00010000:00010000:2.0:1746144664.466365:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f488 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.466378:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.466380:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.466386:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144664.466395:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746780032:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 97us (317us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144664.466397:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 10 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144664.466401:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12085 00010000:00010000:2.0:1746144664.466404:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e7e2600, rc 0) 00000100:00100000:1.0:1746144664.466415:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12086 00000100:00100000:1.0:1746144664.466420:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746780160:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:2.0:1746144664.466421:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746779776:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 225us (506us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144664.466426:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144664.466427:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12083 00010000:00010000:1.0:1746144664.466433:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f49d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.466443:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.466444:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.466448:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.466457:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.466464:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783200, rc 0) 00000100:00100000:1.0:1746144664.466478:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746780160:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.466483:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12086 00000100:00100000:1.0:1746144664.466510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.466520:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746780288 00000100:00100000:1.0:1746144664.466523:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746780288 00000100:00100000:1.0:1746144664.466537:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12087 00000100:00100000:1.0:1746144664.466541:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746780288:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144664.466547:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.466554:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01af42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4a4 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.466587:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747533440:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144664.466602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.466633:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144664.466648:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746780416 00000100:00100000:1.0:1746144664.466650:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746780416 00000100:00100000:1.0:1746144664.466671:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12088 00000100:00100000:1.0:1746144664.466675:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746780416:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144664.466681:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.466688:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135783e00/0xa7c849b16e01af49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4ab expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.466710:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747533568:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144664.466731:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8540 going to sleep for 11 seconds 00010000:00010000:0.0:1746144664.466833:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.466835:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.466840:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 12 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.466851:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 12 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.466858:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b9c00, rc 0) 00000100:00100000:0.0:1746144664.466878:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746779904:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 662us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.466884:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12084 00000100:00100000:2.0:1746144664.467752:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.467792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.467809:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746780928 00000100:00100000:2.0:1746144664.467813:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746780928 00002000:00100000:2.0:1746144664.467840:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3993600->3997695) req@ffff88008c7d2a00 x1830964746780928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.467850:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2a00 with x1830964746780928 ext(3993600->3997695) 00002000:00010000:2.0:1746144664.467854:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d2a00 00000100:00100000:2.0:1746144664.467875:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4650 00000100:00100000:2.0:1746144664.467880:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+50:1960:x1830964746780928:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.468001:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+50:1960:x1830964746780928:12345-192.168.204.23@tcp:3:cat.0 Request processed in 121us (208us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.468008:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4650 00002000:00100000:2.0:1746144664.468023:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3993600->3997695) req@ffff88008c7d2a00 x1830964746780928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.468031:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2a00 with x1830964746780928 ext(3993600->3997695) 00002000:00010000:2.0:1746144664.468033:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d2a00 00000100:00100000:3.0:1746144664.468100:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746780672 00000100:00100000:3.0:1746144664.468104:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746780672 00000100:00100000:3.0:1746144664.468145:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4115 00000100:00100000:3.0:1746144664.468151:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:29281:x1830964746780672:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144664.468385:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:29281:x1830964746780672:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 233us (635us total) trans 8589944047 rc 0/0 00000100:00100000:3.0:1746144664.468391:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4115 00000100:00100000:1.0:1746144664.471753:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747533568:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144664.471792:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135783e00/0xa7c849b16e01af49 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ab expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.471805:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135783e00/0xa7c849b16e01af49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ab expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.472116:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747533440:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144664.472147:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01af42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4a4 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.472157:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01af42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4a4 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.472183:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783600, rc 0) 00000100:00100000:2.0:1746144664.472233:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746780288:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5689us (5720us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144664.472240:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12087 00010000:00010000:1.0:1746144664.472443:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783e00, rc 0) 00000100:00100000:1.0:1746144664.472466:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746780416:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5790us (5863us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144664.472472:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12088 00000100:00100000:1.0:1746144664.473292:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746779136:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8906us (11193us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144664.473302:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4649 00002000:00100000:1.0:1746144664.473313:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4dd5180 x1830964746779136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.473322:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5180 with x1830964746779136 ext(2097152->3145727) 00002000:00010000:1.0:1746144664.473328:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5180 00000100:00100000:0.0:1746144664.491842:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.491897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.491949:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746781312 00000100:00100000:0.0:1746144664.491959:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746781312 00000100:00100000:0.0:1746144664.492003:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10156 00000100:00100000:0.0:1746144664.492011:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746781312:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144664.492045:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.492066:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01af50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4b9 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.492194:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.492209:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.492215:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.492246:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.492257:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 8 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.492269:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746781056 00000100:00100000:0.0:1746144664.492269:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747533696:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.492273:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746781056 00000100:00100000:1.0:1746144664.492299:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12089 00000100:00100000:1.0:1746144664.492303:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:29284:x1830964746781056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.492311:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.492323:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4b2 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.492342:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.492345:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b60b180 going to sleep for 11 seconds 00010000:00010000:1.0:1746144664.492348:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144664.492350:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144664.492353:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.492370:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.492378:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 22 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.492387:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747533824:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.492410:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.492853:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746779648:12345-192.168.204.23@tcp:3:cat.0 Request processed in 28476us (30133us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.492863:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4648 00002000:00100000:3.0:1746144664.492872:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee08e00 x1830964746779648/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.492881:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08e00 with x1830964746779648 ext(2097152->3145727) 00010000:00010000:3.0:1746144664.492887:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 21 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.492897:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 21 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.492902:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee08e00 00000100:00100000:3.0:1746144664.493884:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+33:1960:x1830964746779520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 30524us (31711us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.493890:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4647 00002000:00100000:3.0:1746144664.493897:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a4dd5500 x1830964746779520/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.493905:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5500 with x1830964746779520 ext(2097152->3145727) 00002000:00010000:3.0:1746144664.493909:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd5500 00000100:00100000:0.0:1746144664.494373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.494551:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747533696:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.494990:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746781568 00000100:00100000:3.0:1746144664.494996:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746781568 00000100:00100000:3.0:1746144664.495041:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4116 00000100:00100000:3.0:1746144664.495048:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29286:x1830964746781568:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:0.0:1746144664.495207:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747533824:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144664.495231:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.495246:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7400, rc 0) 00000100:00100000:3.0:1746144664.495264:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29286:x1830964746781568:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 215us (891us total) trans 8589944048 rc 0/0 00000100:00100000:0.0:1746144664.495265:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29284:x1830964746781056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2962us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.495270:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4116 00000100:00100000:0.0:1746144664.495272:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12089 00010000:00010000:1.0:1746144664.495347:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144664.496634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.496712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.496872:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746781696 00000100:00100000:0.0:1746144664.496879:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746781696 00010000:00010000:0.0:1746144664.496908:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.496996:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746781824 00000100:00100000:3.0:1746144664.497000:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746781824 00002000:00100000:3.0:1746144664.497041:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800943f8a80 x1830964746781824/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 504/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.497050:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8a80 with x1830964746781824 ext(3145728->4194303) 00010000:00010000:3.0:1746144664.497057:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 21 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.497068:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 21 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.497075:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943f8a80 00000100:00100000:3.0:1746144664.497090:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 922 00000100:00100000:3.0:1746144664.497097:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746781824:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144664.497112:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6031 00000100:00100000:0.0:1746144664.497118:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746781696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.497128:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.497150:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.497161:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.497183:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7b9400/0xa7c849b16e01af1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f481 expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.497207:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.497213:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.497223:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.497229:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.497246:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144664.497255:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144664.497262:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144664.497274:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746781696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 156us (562us total) trans 0 rc 0/0 00000004:00200000:1.0:1746144664.497279:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:0.0:1746144664.497279:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6031 00010000:00010000:1.0:1746144664.497404:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01af50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b9 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.497415:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b9 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.497421:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.497424:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746144664.497426:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7e00, rc 0) 00000100:00100000:1.0:1746144664.497449:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746781312:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5440us (5618us total) trans 8589944049 rc 0/0 00000100:00100000:1.0:1746144664.497456:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10156 00000100:00100000:1.0:1746144664.501156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.501494:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746781952 00000100:00100000:0.0:1746144664.501504:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746781952 00000100:00100000:0.0:1746144664.501552:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12090 00000100:00100000:0.0:1746144664.501560:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:29280:x1830964746781952:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.501579:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.501596:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4c0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.501623:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144664.501628:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.501640:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.501650:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e6c00, rc 0) 00000100:00100000:0.0:1746144664.501694:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:29280:x1830964746781952:12345-192.168.204.23@tcp:101:cat.0 Request processed in 135us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.501702:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12090 00000100:00100000:0.0:1746144664.506743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.507433:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782208 00000100:00100000:1.0:1746144664.507441:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782208 00000100:00100000:1.0:1746144664.507498:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10157 00000100:00100000:1.0:1746144664.507506:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746782208:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144664.507531:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.507535:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144664.507562:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01af57 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b9 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.507592:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.507597:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144664.507609:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01af73 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4c7 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.507700:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144664.507712:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144664.507722:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:1.0:1746144664.507734:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144664.507820:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01af73 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.507836:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.507847:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.507850:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144664.507851:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6a00, rc 0) 00000100:00100000:1.0:1746144664.507910:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29287:x1830964746782208:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 404us (1177us total) trans 8589944050 rc 0/0 00000100:00100000:1.0:1746144664.507917:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10157 00000100:00100000:0.0:1746144664.510606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.511187:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782336 00000100:00100000:1.0:1746144664.511197:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782336 00000100:00100000:1.0:1746144664.511237:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10158 00000100:00100000:1.0:1746144664.511244:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29287:x1830964746782336:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144664.511264:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.511281:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01af88 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4ce expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.511337:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01af88 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ce expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.511349:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01af88 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ce expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.511365:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.511367:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144664.511370:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6800, rc 0) 00000100:00100000:1.0:1746144664.511409:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29287:x1830964746782336:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 166us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.511415:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10158 00000100:00100000:3.0:1746144664.512218:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746781824:12345-192.168.204.23@tcp:4:cat.0 Request processed in 15119us (15584us total) trans 21474840554 rc 0/0 00000100:00100000:3.0:1746144664.512228:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 922 00002000:00100000:3.0:1746144664.512237:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800943f8a80 x1830964746781824/t21474840554(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 504/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.512247:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8a80 with x1830964746781824 ext(3145728->4194303) 00010000:00010000:3.0:1746144664.512255:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 24 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.512268:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 24 pid: 29370 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.512274:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800943f8a80 00000100:00100000:1.0:1746144664.517507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.517530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.517553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.517579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.517580:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782464 00000100:00100000:2.0:1746144664.517589:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782464 00000100:00100000:1.0:1746144664.517592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.517604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.517608:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782720 00000100:00100000:3.0:1746144664.517612:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782720 00000100:00100000:2.0:1746144664.517626:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782976 00000100:00100000:2.0:1746144664.517628:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782976 00000100:00100000:3.0:1746144664.517633:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782592 00000100:00100000:3.0:1746144664.517635:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782592 00000100:00100000:1.0:1746144664.517635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.517638:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746782848 00000100:00100000:2.0:1746144664.517640:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746782848 00000100:00100000:3.0:1746144664.517646:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783104 00000100:00100000:3.0:1746144664.517648:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783104 00000100:00100000:2.0:1746144664.517654:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12091 00000100:00100000:1.0:1746144664.517654:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783232 00000100:00100000:1.0:1746144664.517656:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783232 00000100:00100000:2.0:1746144664.517661:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746782464:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144664.517705:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.517722:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 32 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.517730:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.517734:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 24 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.517738:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 47 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.517743:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.517745:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.517749:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.517755:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6032 00000100:00100000:1.0:1746144664.517760:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746783232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.517770:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.517778:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 47 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.517788:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 47 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.517795:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 24 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.517802:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747533952:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144664.517806:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 24 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.517825:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009437d400/0xa7c849b16e01adf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3ee expref: 24 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.517837:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.517838:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.517844:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.517856:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.517863:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.517864:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.517867:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.517873:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.517893:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.517901:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747534080:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.518006:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12092 00000100:00100000:3.0:1746144664.518021:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746782720:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:3.0:1746144664.518041:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518042:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.518051:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518051:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.518059:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.518060:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747534208:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.518066:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.518071:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.518073:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.518075:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518082:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 32 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518091:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518094:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 32 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.518099:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 21 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144664.518101:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747534336:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.518107:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747534464:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.518115:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.518147:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12093 00010000:00010000:3.0:1746144664.518152:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.518153:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746782976:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:3.0:1746144664.518160:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 12 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.518168:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747534592:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.518169:0:4760:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518179:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518186:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518193:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518199:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518204:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:2.0:1746144664.518205:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 4 00010000:00010000:3.0:1746144664.518206:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518207:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518214:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.518221:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747534720:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.518221:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518228:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 32 pid: 8451 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.518232:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.518234:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747534848:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.518248:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12094 00000100:00100000:3.0:1746144664.518254:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746782592:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144664.518257:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518264:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 47 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.518268:0:29370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.518270:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747534976:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.518278:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 23 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518283:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518286:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 12 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518290:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.518293:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.518297:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747535104:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.518298:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.518299:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.518301:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518313:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518319:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518321:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 21 pid: 8388 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.518328:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747535232:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.518331:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.518339:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747535360:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.518346:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 12 pid: 4760 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.518350:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1d300 going to sleep for 11 seconds 00010000:00010000:3.0:1746144664.518354:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 12 pid: 4760 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.518360:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747535488:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.518364:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12095 00000100:00100000:2.0:1746144664.518369:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746782848:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:3.0:1746144664.518375:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 23 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518382:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 23 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.518382:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.518389:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747535616:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.518391:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 32 pid: 4760 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144664.518398:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c000 going to sleep for 11 seconds 00010000:00010000:2.0:1746144664.518399:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518406:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 47 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518411:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.518412:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144664.518413:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12096 00010000:00010000:2.0:1746144664.518414:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.518417:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746783104:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144664.518425:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 47 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.518429:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518432:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 47 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.518438:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.518438:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747535744:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.518445:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518450:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.518451:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.518454:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.518454:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518461:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 12 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.518466:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.518473:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 23 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.518474:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747535872:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.518481:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747536000:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.518488:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 32 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.518495:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 32 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.518497:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.518502:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747536128:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.518504:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.518512:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747536256:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.518512:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012db1dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.518522:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d54c600 going to sleep for 11 seconds 00010000:00010000:1.0:1746144664.519630:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.519641:0:7101:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.519650:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747536384:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144664.521494:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.521912:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747533952:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.521923:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747534208:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.522106:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747534080:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.522674:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747534592:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.522683:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747534720:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.523332:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747535232:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.523351:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747534848:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.523361:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747534976:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.523368:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747535104:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.523374:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747535360:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.523407:0:4760:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.528543:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747534464:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.528577:0:8453:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.528654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.528684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.528712:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783744 00000100:00100000:0.0:1746144664.528718:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783744 00010000:00010000:0.0:1746144664.528751:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.528774:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783360 00000100:00100000:0.0:1746144664.528776:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783360 00010000:00010000:0.0:1746144664.528788:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 48 pid: 4760 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144664.528802:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6033 00000100:00100000:0.0:1746144664.528808:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746783744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.528822:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.528845:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.528855:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.528877:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01af03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f47a expref: 33 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.528908:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.528912:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6034 00000100:00100000:2.0:1746144664.528922:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746783360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.528930:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144664.528943:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746783744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 135us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144664.528946:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 48 pid: 4760 timeout: 743 lvb_type: 1 00000100:00100000:0.0:1746144664.528950:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6033 00010000:00010000:2.0:1746144664.528955:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 48 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.528967:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c90da00/0xa7c849b16e01aea8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f42d expref: 48 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.528982:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144664.528995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.529001:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746783360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.529007:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6034 00000100:00100000:2.0:1746144664.529064:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747534336:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.529084:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.529108:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747535744:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144664.529790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.529821:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747536000:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144664.529829:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747536256:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144664.529841:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.529857:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783872 00000100:00100000:0.0:1746144664.529860:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783872 00002000:00100000:0.0:1746144664.529888:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4481023) req@ffff8800a4dd6d80 x1830964746783872/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.529897:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd6d80 with x1830964746783872 ext(4194304->4481023) 00010000:00010000:0.0:1746144664.529904:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.529913:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746144664.529920:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4dd6d80 00000100:00100000:0.0:1746144664.529941:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784256 00000100:00100000:0.0:1746144664.529944:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784256 00002000:00100000:0.0:1746144664.529954:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3457024->3997695) req@ffff8800a4dd4700 x1830964746784256/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.529961:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4700 with x1830964746784256 ext(3457024->3997695) 00010000:00010000:0.0:1746144664.529965:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.529973:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00002000:00010000:0.0:1746144664.529979:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4dd4700 00000100:00100000:0.0:1746144664.529990:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 923 00000100:00100000:0.0:1746144664.529995:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746783872:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144664.530082:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747535872:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.530098:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747536128:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.530122:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.530178:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 924 00000100:00100000:2.0:1746144664.530188:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746784256:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144664.530495:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747535488:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.530505:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747535616:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.530518:0:29370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.534582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.534827:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747536384:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144664.534853:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.534900:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746783232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 17139us (17263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.534911:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6032 00000100:00100000:2.0:1746144664.535095:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746785408 00000100:00100000:2.0:1746144664.535107:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746785408 00002000:00100000:2.0:1746144664.535179:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a4dd4a80 x1830964746785408/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.535188:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4a80 with x1830964746785408 ext(2097152->3145727) 00010000:00010000:2.0:1746144664.535197:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 22 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.535209:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 22 pid: 8450 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746144664.535216:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd4a80 00000100:00100000:2.0:1746144664.535238:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 925 00000100:00100000:2.0:1746144664.535245:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746785408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.535331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.535708:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.535846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.535910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.535935:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746785536 00000100:00100000:1.0:1746144664.535940:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746785536 00000100:00100000:1.0:1746144664.536582:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783616 00000100:00100000:1.0:1746144664.536587:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783616 00010000:00010000:1.0:1746144664.536614:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.536633:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784128 00000100:00100000:1.0:1746144664.536635:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784128 00010000:00010000:1.0:1746144664.536645:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.536659:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6035 00000100:00100000:1.0:1746144664.536665:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746783616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.536676:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.536697:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536708:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536730:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01af2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f496 expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536750:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.536773:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746783616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.536779:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6035 00000100:00100000:1.0:1746144664.536795:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6036 00000100:00100000:1.0:1746144664.536800:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1373850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746784128:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.536806:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.536813:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536820:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536830:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273000/0xa7c849b16e01adac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3a8 expref: 23 pid: 8453 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536838:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.536851:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1373850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746784128:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 51us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.536855:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6036 00010000:00010000:1.0:1746144664.536878:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 24 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.536894:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6037 00000100:00100000:1.0:1746144664.536898:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746785536:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.536905:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.536911:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 24 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536918:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 24 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536930:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7f8800/0xa7c849b16e01adeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3d9 expref: 24 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.536939:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.536941:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.536945:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.536953:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.537599:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.537619:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746785536:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 720us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.537626:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6037 00000100:00100000:3.0:1746144664.539031:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784512 00000100:00100000:3.0:1746144664.539040:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784512 00010000:00010000:3.0:1746144664.539071:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.539095:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6038 00000100:00100000:3.0:1746144664.539100:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746784512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.539112:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.539131:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.539161:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.539181:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01aed2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f449 expref: 22 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.539209:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.539239:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746784512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 139us (3328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.539250:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6038 00010000:00010000:3.0:1746144664.539272:0:8453:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539281:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539302:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539310:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539492:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539499:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092459a00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144664.539503:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539510:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539521:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.539526:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092459a00/0xa7c849b16e01af96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.539568:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746782720:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 21556us (22037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.539576:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12092 00000100:00100000:0.0:1746144664.539889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.540382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.541236:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784768 00000100:00100000:1.0:1746144664.541241:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784768 00010000:00010000:1.0:1746144664.541268:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.541301:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746785024 00000100:00100000:1.0:1746144664.541304:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746785024 00010000:00010000:1.0:1746144664.541313:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 34 pid: 29370 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.541338:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6039 00000100:00100000:1.0:1746144664.541343:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746784768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.541353:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.541369:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.541380:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.541396:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01af3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f49d expref: 13 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.541409:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.541434:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746784768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 90us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.541439:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6039 00000100:00100000:1.0:1746144664.541452:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6040 00000100:00100000:1.0:1746144664.541456:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746785024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.541462:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.541470:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 34 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.541482:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 34 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.541491:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e9e7c00/0xa7c849b16e01ae70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f41f expref: 34 pid: 29370 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.541499:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.541511:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746785024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 55us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.541516:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6040 00000100:00100000:1.0:1746144664.543272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.543295:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746785664 00000100:00100000:1.0:1746144664.543300:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746785664 00010000:00010000:1.0:1746144664.543326:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 23 pid: 8388 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.543351:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6041 00000100:00100000:1.0:1746144664.543356:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746785664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.543366:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.543382:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 23 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.543391:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 23 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.543410:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009437da00/0xa7c849b16e01aed9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f450 expref: 23 pid: 8388 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.543422:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.543443:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746785664:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.543448:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6041 00000100:00100000:1.0:1746144664.543488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.543496:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746783488 00000100:00100000:1.0:1746144664.543498:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746783488 00010000:00010000:1.0:1746144664.543508:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.543520:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6042 00000100:00100000:1.0:1746144664.543524:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746783488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.543530:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.543538:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.543545:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.543555:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2600/0xa7c849b16e01af34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f488 expref: 12 pid: 22208 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.543568:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.543570:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.543574:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.543583:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.544539:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746783872:12345-192.168.204.23@tcp:4:cat.0 Request processed in 14535us (15535us total) trans 17179873325 rc 0/0 00000100:00100000:2.0:1746144664.544550:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 923 00002000:00100000:2.0:1746144664.544559:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4481023) req@ffff8800a4dd6d80 x1830964746783872/t17179873325(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.544568:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd6d80 with x1830964746783872 ext(4194304->4481023) 00010000:00010000:2.0:1746144664.544575:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.544587:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 33 pid: 22208 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746144664.544593:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4dd6d80 00010000:00010000:1.0:1746144664.544744:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.544772:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746783488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1245us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.544780:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6042 00010000:00010000:2.0:1746144664.544862:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.544870:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.544891:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.544892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144664.544897:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.544908:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784000 00000100:00100000:1.0:1746144664.544911:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784000 00010000:00010000:1.0:1746144664.544929:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 49 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.545021:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.545027:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e7e2200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144664.545030:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.545034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144664.545037:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.545051:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.545060:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e2200/0xa7c849b16e01af8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.545111:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746782464:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 27450us (27613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.545118:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12091 00000100:00100000:3.0:1746144664.546370:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784384 00000100:00100000:3.0:1746144664.546381:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784384 00010000:00010000:3.0:1746144664.546407:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 11 pid: 4760 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144664.546416:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6043 00000100:00100000:2.0:1746144664.546426:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746784000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144664.546429:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6044 00000100:00100000:3.0:1746144664.546434:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1370c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746784384:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.546441:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.546442:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.546459:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 49 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.546460:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 11 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:3.0:1746144664.546470:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 11 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.546471:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 49 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.546488:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9c00/0xa7c849b16e01af26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f48f expref: 11 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.546488:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3c00/0xa7c849b16e01aefc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f473 expref: 49 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.546501:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.546501:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144664.546503:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.546506:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546515:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.546527:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1961:x1830964746784000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 103us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.546533:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6043 00010000:00010000:3.0:1746144664.546534:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.546549:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1370c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746784384:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 114us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.546554:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6044 00010000:00010000:3.0:1746144664.546595:0:29370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546602:0:29370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546619:0:29370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546625:0:29370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546631:0:29370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546637:0:29370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19c600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144664.546640:0:29370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546646:0:29370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546658:0:29370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.546663:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19c600/0xa7c849b16e01afa4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.546698:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746782592:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 28444us (29118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.546705:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12094 00000100:00100000:1.0:1746144664.546828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.546852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.546909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.547005:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784640 00000100:00100000:1.0:1746144664.547008:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784640 00010000:00010000:1.0:1746144664.547035:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 48 pid: 8451 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.547052:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746784896 00000100:00100000:1.0:1746144664.547054:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746784896 00010000:00010000:1.0:1746144664.547065:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 33 pid: 4760 timeout: 743 lvb_type: 1 00000100:00100000:1.0:1746144664.547076:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6045 00000100:00100000:1.0:1746144664.547081:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1961:x1830964746784640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.547086:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.547097:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 48 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.547105:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 48 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.547117:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7f8600/0xa7c849b16e01ade4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3e0 expref: 48 pid: 8451 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.547128:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.547159:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1961:x1830964746784640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 77us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.547165:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6045 00000100:00100000:1.0:1746144664.547174:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6046 00000100:00100000:1.0:1746144664.547179:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746784896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.547185:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.547192:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 33 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.547205:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 33 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.547216:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5fe00/0xa7c849b16e01ada5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3af expref: 33 pid: 4760 timeout: 743 lvb_type: 1 00010000:00010000:1.0:1746144664.547225:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.547226:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.547229:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.547235:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.547249:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.547267:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746784896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 83us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.547271:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6046 00010000:00010000:2.0:1746144664.547374:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547387:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547401:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547406:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547412:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547417:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c312600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144664.547420:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547427:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547436:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.547442:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c312600/0xa7c849b16e01afab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.547498:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746782848:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 29127us (29903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.547506:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12095 00000100:00100000:3.0:1746144664.548640:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746785792 00000100:00100000:3.0:1746144664.548648:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746785792 00002000:00100000:3.0:1746144664.548682:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012e12df80 x1830964746785792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.548691:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12df80 with x1830964746785792 ext(2097152->3145727) 00010000:00010000:3.0:1746144664.548698:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.548713:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.548719:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e12df80 00000100:00100000:3.0:1746144664.548737:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 926 00000100:00100000:3.0:1746144664.548743:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746785792:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.549127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.549199:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746785920 00000100:00100000:2.0:1746144664.549203:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746785920 00010000:00010000:2.0:1746144664.549221:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.549237:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6047 00000100:00100000:2.0:1746144664.549242:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746785920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.549251:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.549264:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.549273:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.549289:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e7e3400/0xa7c849b16e01aef5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f46c expref: 32 pid: 22208 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.549299:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.549325:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+31:1962:x1830964746785920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.549330:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6047 00000100:00100000:2.0:1746144664.553794:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746784256:12345-192.168.204.23@tcp:4:cat.0 Request processed in 23356us (23751us total) trans 17179873326 rc 0/0 00000100:00100000:2.0:1746144664.553808:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 924 00002000:00100000:2.0:1746144664.553824:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3457024->3997695) req@ffff8800a4dd4700 x1830964746784256/t17179873326(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.553834:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4700 with x1830964746784256 ext(3457024->3997695) 00010000:00010000:2.0:1746144664.553845:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.553859:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746144664.553866:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4dd4700 00000100:00100000:0.0:1746144664.560109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.560151:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746786048 00000100:00100000:0.0:1746144664.560160:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746786048 00010000:00010000:0.0:1746144664.560195:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.560236:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6048 00000100:00100000:0.0:1746144664.560242:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1962:x1830964746786048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.560253:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.560272:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.560280:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.560307:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01aee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3457024->3997695) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f457 expref: 47 pid: 8451 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.560325:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.560327:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.560333:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560342:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560363:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144664.560397:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746786048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 155us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.560403:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6048 00000100:00100000:2.0:1746144664.560495:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746785408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25249us (25921us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.560504:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 925 00002000:00100000:2.0:1746144664.560513:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a4dd4a80 x1830964746785408/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.560523:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd4a80 with x1830964746785408 ext(2097152->3145727) 00010000:00010000:2.0:1746144664.560531:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.560541:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00002000:00010000:2.0:1746144664.560547:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4dd4a80 00010000:00010000:0.0:1746144664.560569:0:4760:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560582:0:4760:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560603:0:4760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560610:0:4760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560616:0:4760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560622:0:4760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff1800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144664.560677:0:4760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560685:0:4760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560694:0:4760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.560699:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fff1800/0xa7c849b16e01af9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.560742:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746782976:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 42588us (43187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.560750:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12093 00000100:00100000:3.0:1746144664.564847:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746785792:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16091us (17924us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.564860:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 926 00002000:00100000:3.0:1746144664.564872:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012e12df80 x1830964746785792/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.564882:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12df80 with x1830964746785792 ext(2097152->3145727) 00010000:00010000:3.0:1746144664.564892:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.564906:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00002000:00010000:3.0:1746144664.564914:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e12df80 00000100:00100000:0.0:1746144664.568355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.568459:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746786176 00000100:00100000:2.0:1746144664.568469:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746786176 00000100:00100000:2.0:1746144664.568603:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12097 00000100:00100000:2.0:1746144664.568612:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:29284:x1830964746786176:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.568633:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.568654:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4d5 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144664.568680:0:4760:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d99, atime: 0x68140d99, ctime: 0x68140d99, blocks: 0x15ef 00010000:00010000:2.0:1746144664.568704:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.568706:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.568714:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 47 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.568730:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 47 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.568740:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942f0e00, rc 0) 00000100:00100000:2.0:1746144664.568797:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:29284:x1830964746786176:12345-192.168.204.23@tcp:101:cat.0 Request processed in 185us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.568803:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12097 00000100:00100000:0.0:1746144664.571640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.571763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.571803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.571854:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746786304 00000100:00100000:2.0:1746144664.571864:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746786304 00000100:00100000:2.0:1746144664.571907:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12098 00000100:00100000:2.0:1746144664.571914:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+31:29280:x1830964746786304:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.571933:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.571949:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4dc expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.571972:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.571975:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.571981:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.571994:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 32 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.572003:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942f1000, rc 0) 00000100:00100000:1.0:1746144664.572024:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746786432 00000100:00100000:1.0:1746144664.572028:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746786432 00010000:00010000:1.0:1746144664.572050:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.572052:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:29280:x1830964746786304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 139us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.572057:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12098 00000100:00100000:1.0:1746144664.572105:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746786560 00000100:00100000:1.0:1746144664.572107:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746786560 00010000:00010000:1.0:1746144664.572117:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.572118:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6049 00000100:00100000:3.0:1746144664.572126:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746786432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.572163:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144664.572166:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6050 00000100:00100000:1.0:1746144664.572172:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746786560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.572180:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.572187:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.572190:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.572198:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.572208:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.572494:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01af5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4b2 expref: 20 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.572521:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.572545:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746786432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 420us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.572551:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6049 00010000:00010000:1.0:1746144664.572807:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01af6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c0 expref: 21 pid: 8450 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.572861:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.572863:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.572867:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.572874:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.572904:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.572926:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746786560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 754us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.572932:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6050 00010000:00010000:0.0:1746144664.572957:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.572967:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.572989:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.572995:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.573003:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.573010:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144664.573036:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.573043:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.573058:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.573064:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19d400/0xa7c849b16e01afb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.573109:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746783104:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 54690us (55502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.573115:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12096 00000100:00100000:0.0:1746144664.576956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.577057:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746786816 00000100:00100000:3.0:1746144664.577595:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746786816 00002000:00100000:3.0:1746144664.577646:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f272300 x1830964746786816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.577655:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f272300 with x1830964746786816 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.577660:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f272300 00000100:00100000:3.0:1746144664.577695:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4651 00000100:00100000:3.0:1746144664.577702:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746786816:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.578284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.578792:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787072 00000100:00100000:2.0:1746144664.578797:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787072 00002000:00100000:2.0:1746144664.578823:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f270000 x1830964746787072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.578832:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f270000 with x1830964746787072 ext(3145728->4194303) 00002000:00010000:2.0:1746144664.578836:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f270000 00000100:00100000:2.0:1746144664.578852:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4652 00000100:00100000:2.0:1746144664.578858:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746787072:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.579914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.579939:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787328 00000100:00100000:0.0:1746144664.579943:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787328 00000100:00100000:0.0:1746144664.579984:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10159 00000100:00100000:0.0:1746144664.579990:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29287:x1830964746787328:12345-192.168.204.23@tcp:36:mirror_io.0 00010000:00010000:0.0:1746144664.580041:0:14709:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.580069:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01af88 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ce expref: 10 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580092:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.580096:0:14709:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144664.580127:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.580159:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 305 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580167:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 305 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580174:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580180:0:14709:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 305 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580186:0:14709:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.580217:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 305 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580229:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 305 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.580244:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536512:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144664.580310:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580319:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 11 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.580326:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536640:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144664.580348:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 305 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580356:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 305 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.580363:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536768:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144664.580387:0:14709:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 305 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.580393:0:14709:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 305 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.580400:0:14709:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536896:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144664.580418:0:14709:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b60ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.585301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.585329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.585352:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787456 00000100:00100000:0.0:1746144664.585355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.585361:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787456 00000100:00100000:0.0:1746144664.585384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.585394:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787584 00000100:00100000:3.0:1746144664.585399:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787584 00010000:00010000:1.0:1746144664.585401:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 306 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.585406:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787712 00000100:00100000:0.0:1746144664.585409:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787712 00010000:00010000:3.0:1746144664.585412:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 12 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.585424:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787840 00010000:00010000:0.0:1746144664.585424:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 307 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.585426:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787840 00010000:00010000:1.0:1746144664.585435:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 308 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.585587:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536512:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.585598:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536640:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.585604:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536768:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.585611:0:14709:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14709:1830964747536896:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.585617:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6051 00000100:00100000:3.0:1746144664.585630:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:1962:x1830964746787456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.585638:0:14709:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144664.585645:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.585650:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 308 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.585659:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 308 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.585680:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437d200/0xa7c849b16e01ae8c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f426 expref: 308 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:0.0:1746144664.585683:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6052 00000100:00100000:0.0:1746144664.585689:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746787584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.585697:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.585701:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 12 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.585753:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6053 00000100:00100000:1.0:1746144664.585759:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:1960:x1830964746787712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144664.585761:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6054 00010000:00010000:1.0:1746144664.585766:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144664.585768:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:1963:x1830964746787840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.585770:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 307 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.585776:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.585780:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 307 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.586061:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.586067:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:3.0:1746144664.586075:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144664.586105:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 12 pid: 20319 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.586119:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c7000/0xa7c849b16e01adcf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3c4 expref: 12 pid: 20319 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.586120:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:1962:x1830964746787456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 494us (827us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144664.586122:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 307 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.586130:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6051 00010000:00010000:1.0:1746144664.586151:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6a00/0xa7c849b16e01adc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3bd expref: 307 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.586153:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.586157:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.586162:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144664.586163:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.586166:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:1.0:1746144664.586171:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144664.586183:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746787584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 494us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.586189:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:1960:x1830964746787712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 430us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.586189:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6052 00000100:00100000:1.0:1746144664.586195:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6053 00010000:00010000:2.0:1746144664.586331:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 304 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.586344:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e7e2c00/0xa7c849b16e01adc1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f3b6 expref: 304 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.586356:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.586359:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.586366:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.586373:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.586387:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.586405:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1963:x1830964746787840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 638us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.586411:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6054 00010000:00010000:2.0:1746144664.586425:0:14709:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.586435:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000040:00080000:2.0:1746144664.587131:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2967, 88 off248048 00000004:00080000:2.0:1746144664.588366:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797230646ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588441:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2881, 88 off240472 00000004:00080000:2.0:1746144664.588445:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797310750ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588458:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2882, 88 off240560 00000004:00080000:2.0:1746144664.588461:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797325989ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588469:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2968, 88 off248136 00000004:00080000:2.0:1746144664.588472:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797337329ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588489:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2969, 88 off248224 00000004:00080000:2.0:1746144664.588492:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797357691ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588499:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2883, 88 off240648 00000004:00080000:2.0:1746144664.588501:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797366850ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588508:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2884, 88 off240736 00000004:00080000:2.0:1746144664.588511:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797376036ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588517:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2885, 88 off240824 00000004:00080000:2.0:1746144664.588520:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797385236ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588526:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2970, 88 off248312 00000004:00080000:2.0:1746144664.588528:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797393856ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588536:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2886, 88 off240912 00000004:00080000:2.0:1746144664.588539:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797404077ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588545:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2971, 88 off248400 00000004:00080000:2.0:1746144664.588547:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797412747ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588555:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2887, 88 off241000 00000004:00080000:2.0:1746144664.588560:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797425289ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144664.588566:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2972, 88 off248488 00000004:00080000:2.0:1746144664.588569:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797434234ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588576:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2973, 88 off248576 00000004:00080000:2.0:1746144664.588579:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797444401ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588587:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2974, 88 off248664 00000004:00080000:2.0:1746144664.588590:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797455326ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588597:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2975, 88 off248752 00000004:00080000:2.0:1746144664.588600:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643797465374ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144664.588608:0:14709:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2888, 88 off241088 00000004:00080000:2.0:1746144664.588610:0:14709:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643797475990ns, next at 593480289301ns, rc = 0 00000100:00100000:2.0:1746144664.589925:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746787072:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11060us (11635us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.589937:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4652 00002000:00100000:2.0:1746144664.589948:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f270000 x1830964746787072/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.589957:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f270000 with x1830964746787072 ext(3145728->4194303) 00002000:00010000:2.0:1746144664.589964:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f270000 00000100:00100000:3.0:1746144664.596221:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746786816:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18510us (19265us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.596234:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4651 00002000:00100000:3.0:1746144664.596247:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009f272300 x1830964746786816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.596256:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f272300 with x1830964746786816 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.596263:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f272300 00000100:00100000:0.0:1746144664.596551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.596581:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746787968 00000100:00100000:0.0:1746144664.596588:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746787968 00000100:00100000:0.0:1746144664.596625:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12099 00000100:00100000:0.0:1746144664.596631:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+20:29280:x1830964746787968:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.596648:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.596667:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4e3 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144664.596693:0:7257:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d99, atime: 0x68140d98, ctime: 0x68140d99, blocks: 0x1029 00010000:00010000:0.0:1746144664.596714:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.597616:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.597628:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.597652:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 21 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.597664:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7e00, rc 0) 00000100:00100000:0.0:1746144664.597700:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+21:29280:x1830964746787968:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1069us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.597706:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12099 00000100:00100000:0.0:1746144664.601694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.601738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.601764:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746788096 00000100:00100000:0.0:1746144664.601772:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746788096 00000100:00100000:0.0:1746144664.601820:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10160 00000100:00100000:0.0:1746144664.601827:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:29280:x1830964746788096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.601853:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.601873:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4ea expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.601935:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.601945:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.601962:0:14710:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144664.601975:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.601989:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.601992:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144664.601995:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.602002:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7400, rc 0) 00000100:00100000:0.0:1746144664.602059:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:29280:x1830964746788096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 231us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.602065:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10160 00000100:00100000:0.0:1746144664.602091:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746788224 00000100:00100000:0.0:1746144664.602094:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746788224 00000100:00100000:0.0:1746144664.602114:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12100 00000100:00100000:0.0:1746144664.602118:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29284:x1830964746788224:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.602126:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.602154:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4f1 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.602171:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.602173:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.602180:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.602192:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 20 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.602199:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7000, rc 0) 00000100:00100000:0.0:1746144664.602214:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:29284:x1830964746788224:12345-192.168.204.23@tcp:101:cat.0 Request processed in 95us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.602219:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12100 00000100:00100000:0.0:1746144664.604175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.604197:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746788352 00000100:00100000:0.0:1746144664.604203:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746788352 00000100:00100000:0.0:1746144664.604231:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10161 00000100:00100000:0.0:1746144664.604237:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29284:x1830964746788352:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.604253:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.604266:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4f8 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.604311:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 304 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.604321:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 304 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.604332:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.604335:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144664.604338:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.604344:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e6400, rc 0) 00000100:00100000:0.0:1746144664.604372:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29284:x1830964746788352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 135us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.604377:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10161 00000100:00100000:0.0:1746144664.617580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.617607:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746788608 00000100:00100000:0.0:1746144664.617616:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746788608 00000100:00100000:0.0:1746144664.617654:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10162 00000100:00100000:0.0:1746144664.617662:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:29291:x1830964746788608:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144664.617680:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.617698:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01afea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f4ff expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.617799:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144664.617811:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144664.617823:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144664.617833:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144664.617838:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144664.617843:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144664.620996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.621062:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746788864 00000100:00100000:0.0:1746144664.621070:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746788864 00000100:00100000:0.0:1746144664.621285:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10163 00000100:00100000:0.0:1746144664.621294:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29293:x1830964746788864:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144664.621313:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.621332:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6a00/0xa7c849b16e01afff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f506 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.621455:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.621468:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.621478:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.621487:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.621492:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.621497:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000001:00080000:0.0:1746144664.622921:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944050 is committed 00000001:00080000:0.0:1746144664.622936:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944051 is committed 00000004:00080000:0.0:1746144664.622939:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2073 committed 00000004:00080000:0.0:1746144664.622947:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2156 committed 00000004:00080000:0.0:1746144664.622953:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2155 committed 00000004:00080000:0.0:1746144664.622954:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2154 committed 00000004:00080000:0.0:1746144664.622956:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2153 committed 00000004:00080000:0.0:1746144664.622957:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2072 committed 00000004:00080000:0.0:1746144664.622959:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2152 committed 00000004:00080000:0.0:1746144664.622961:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2071 committed 00000004:00080000:0.0:1746144664.622962:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2151 committed 00000004:00080000:0.0:1746144664.622964:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2070 committed 00000004:00080000:0.0:1746144664.622965:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2069 committed 00000004:00080000:0.0:1746144664.622968:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2068 committed 00000004:00080000:0.0:1746144664.622969:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2150 committed 00000004:00080000:0.0:1746144664.622971:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2149 committed 00000004:00080000:0.0:1746144664.622972:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2067 committed 00000004:00080000:0.0:1746144664.622974:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2066 committed 00000004:00080000:0.0:1746144664.622975:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2148 committed 00000001:00080000:0.0:1746144664.622981:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944046 is committed 00000001:00080000:0.0:1746144664.622988:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944048 is committed 00000001:00080000:0.0:1746144664.622993:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944047 is committed 00000100:00100000:0.0:1746144664.623258:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.623314:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.623349:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.623361:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.623370:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.623383:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.623391:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.623401:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.623415:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746144664.623419:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.623430:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.623438:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.623448:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746144664.623635:0:14709:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f272d80 reply state ffff88009f0cc800 transno 8589944051 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14709 initiator: MDT0 00000100:00100000:3.0:1746144664.623646:0:14709:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746144664.623727:0:14709:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746144664.623738:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746787328:12345-192.168.204.23@tcp:36:mirror_io.0 Request processed in 43747us (43825us total) trans 8589944051 rc 0/0 00000100:00100000:3.0:1746144664.623747:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10159 00010000:00010000:3.0:1746144664.623869:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.623882:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.623891:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.623916:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.623926:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 7 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.623936:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539072:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.623970:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49b2600 going to sleep for 11 seconds 00010000:00010000:3.0:1746144664.624024:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.624031:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.624036:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144664.625266:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.625293:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144664.625310:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537024 00000100:00100000:3.0:1746144664.625317:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537024 00000100:00100000:3.0:1746144664.625356:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537536 00000100:00100000:3.0:1746144664.625358:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537536 00000100:00100000:3.0:1746144664.625369:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538048 00000100:00100000:3.0:1746144664.625372:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538048 00000100:00100000:3.0:1746144664.625383:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538560 00000100:00100000:3.0:1746144664.625385:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538560 00000100:00100000:2.0:1746144664.625388:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537408 00000100:00100000:2.0:1746144664.625393:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537408 00000100:00100000:3.0:1746144664.625394:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537920 00000100:00100000:3.0:1746144664.625396:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537920 00000100:00100000:3.0:1746144664.625410:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12101 00000100:00100000:2.0:1746144664.625416:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12102 00000100:00100000:3.0:1746144664.625418:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3296:x1830964747537024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.625421:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3296:x1830964747537536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.625437:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12103 00000100:00100000:2.0:1746144664.625441:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3296:x1830964747538048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144664.625615:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747537024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (2300us total) trans 21474840555 rc 0/0 00000100:00100000:3.0:1746144664.625621:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12101 00000100:00100000:2.0:1746144664.625628:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747538048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (2243us total) trans 17179873327 rc 0/0 00000100:00100000:3.0:1746144664.625631:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12104 00000100:00100000:2.0:1746144664.625635:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12103 00000100:00100000:3.0:1746144664.625636:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747538560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.625646:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12105 00000100:00100000:2.0:1746144664.625651:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3296:x1830964747537920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144664.625713:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747538560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (2310us total) trans 17179873328 rc 0/0 00000100:00100000:3.0:1746144664.625719:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12104 00000100:00100000:3.0:1746144664.625727:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12106 00000100:00100000:3.0:1746144664.625731:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747537408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.625733:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747537920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (2282us total) trans 21474840556 rc 0/0 00000100:00100000:2.0:1746144664.625738:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12105 00010000:00010000:2.0:1746144664.625760:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.625768:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.625776:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.625782:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e6600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.625786:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.625793:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 14709 initiator: MDT0 00002000:00010000:3.0:1746144664.625796:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144664.625799:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144664.625801:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144664.625803:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144664.625806:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1746144664.625807:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.625810:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144664.625816:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.625823:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747537408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (2391us total) trans 21474840557 rc 0/0 00010000:00010000:2.0:1746144664.625825:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.625828:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12106 00010000:00010000:2.0:1746144664.625837:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.625845:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.625852:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.625858:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.625883:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.625892:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747539200:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.625939:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.625946:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747539328:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.625962:0:3280:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013640ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.626098:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747537536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 676us (2734us total) trans 21474840558 rc 0/0 00000100:00100000:2.0:1746144664.626103:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12102 00000100:00100000:2.0:1746144664.626791:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747537280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.627233:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.627254:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144664.627447:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538432 00000100:00100000:3.0:1746144664.627452:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538432 00000004:00080000:0.0:1746144664.627516:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44000/2, rc 0, transno 21474840555 00000100:00100000:0.0:1746144664.627522:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.627529:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a2d80/2, rc 0, transno 21474840558 00000100:00100000:0.0:1746144664.627531:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.627538:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a2a00/2, rc 0, transno 17179873327 00000100:00100000:0.0:1746144664.627544:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144664.627550:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a1880/2, rc 0, transno 17179873328 00000100:00100000:0.0:1746144664.627553:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144664.627560:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a1500/2, rc 0, transno 21474840557 00000100:00100000:0.0:1746144664.627562:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.627569:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0700/2, rc 0, transno 21474840556 00000100:00100000:0.0:1746144664.627572:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747537920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.627587:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747537152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.627604:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.627994:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747537664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.628024:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144664.628109:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538944 00000100:00100000:1.0:1746144664.628113:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538944 00000100:00100000:1.0:1746144664.628146:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537152 00000100:00100000:1.0:1746144664.628149:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537152 00000100:00100000:1.0:1746144664.628164:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12107 00000100:00100000:1.0:1746144664.628169:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747538432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.628305:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3296:x1830964747538432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (3010us total) trans 17179873329 rc 0/0 00000100:00100000:1.0:1746144664.628311:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12107 00000100:00100000:1.0:1746144664.628322:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12108 00000100:00100000:1.0:1746144664.628326:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747538944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.628400:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3296:x1830964747538944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1145us total) trans 17179873330 rc 0/0 00000100:00100000:1.0:1746144664.628406:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12108 00000100:00100000:1.0:1746144664.628415:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12109 00000100:00100000:1.0:1746144664.628420:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747537152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144664.628515:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3293:x1830964747537152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (910us total) trans 21474840559 rc 0/0 00000100:00100000:1.0:1746144664.628520:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12109 00000100:00100000:3.0:1746144664.629036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.629106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.629176:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746788992 00000100:00100000:3.0:1746144664.629179:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746788992 00010000:00010000:3.0:1746144664.629198:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 8 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.629217:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6055 00000100:00100000:3.0:1746144664.629221:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746788992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144664.629229:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.629235:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 8 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.629245:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 8 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.629264:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.629269:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.629278:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.629284:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.629290:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629295:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629299:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629313:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144664.629335:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746788992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 114us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.629341:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6055 00000100:00100000:3.0:1746144664.629354:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746789120 00000100:00100000:3.0:1746144664.629356:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746789120 00000100:00100000:3.0:1746144664.629370:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10164 00000100:00100000:3.0:1746144664.629375:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746789120:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144664.629387:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.629397:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f50d expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.629436:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.629444:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.629456:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.629459:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144664.629460:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19dc00, rc 0) 00000100:00100000:3.0:1746144664.629475:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29287:x1830964746789120:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.629480:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10164 00010000:00010000:3.0:1746144664.629493:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629500:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144664.629512:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.629625:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629632:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629638:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629642:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19ca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.629646:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629651:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629658:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.629659:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144664.629662:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629666:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01b01b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629678:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629683:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629687:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629691:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e7600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.629693:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629698:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629703:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.629705:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.629707:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629711:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7600/0xa7c849b16e01b006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629718:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629722:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629726:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629730:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e6800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.629732:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629736:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629740:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136982800) 00010000:00010000:3.0:1746144664.629742:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.629744:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629748:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6800/0xa7c849b16e01b00d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.629780:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6a00/0xa7c849b16e01afff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f506 expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.629787:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6a00/0xa7c849b16e01afff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f506 expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.629793:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e6a00, rc 0) 00000100:00100000:3.0:1746144664.629806:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746788864:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8515us (8820us total) trans 8589944052 rc 301/301 00000100:00100000:3.0:1746144664.629811:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10163 00010000:00010000:2.0:1746144664.629947:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01af7a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4c7 expref: 8 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.629962:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539072:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144664.629974:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747538176:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746144664.629979:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.629986:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.629990:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144664.629999:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144664.630048:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630054:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630059:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630063:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19c400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.630065:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630070:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630078:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.630080:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144664.630082:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630090:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01b014 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630100:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630104:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630108:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630111:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e7800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.630113:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630117:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630121:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144664.630123:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144664.630124:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630128:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01aff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144664.630147:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746144664.630158:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630163:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144664.630163:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747538688:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746144664.630167:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630172:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e7c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144664.630174:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630179:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144664.630179:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746144664.630185:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136982800) 00010000:00010000:2.0:1746144664.630187:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144664.630189:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.630193:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7c00/0xa7c849b16e01aff8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000004:00080000:0.0:1746144664.630205:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47100/2, rc 0, transno 21474840559 00000100:00100000:0.0:1746144664.630210:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747537152:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746144664.630219:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01afea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ff expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.630226:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7a00/0xa7c849b16e01afea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ff expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.630233:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7a00, rc 0) 00000100:00100000:2.0:1746144664.630254:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29291:x1830964746788608:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 12593us (12681us total) trans 8589944053 rc 301/301 00000100:00100000:2.0:1746144664.630260:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10162 00000100:00100000:0.0:1746144664.630276:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747539456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.630281:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537664 00000100:00100000:2.0:1746144664.630283:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537664 00000100:00100000:0.0:1746144664.630297:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144664.630298:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538176 00000100:00100000:2.0:1746144664.630300:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538176 00000100:00100000:2.0:1746144664.630310:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538688 00000100:00100000:2.0:1746144664.630313:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538688 00000004:00080000:0.0:1746144664.630318:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a3b80/2, rc 0, transno 17179873329 00000100:00100000:2.0:1746144664.630321:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747539456 00000100:00100000:2.0:1746144664.630322:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747539456 00000100:00100000:0.0:1746144664.630322:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144664.630330:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a1f80/2, rc 0, transno 17179873330 00000100:00100000:2.0:1746144664.630333:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12110 00000100:00100000:0.0:1746144664.630333:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747538944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.630338:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3293:x1830964747537664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.630349:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12111 00000100:00100000:0.0:1746144664.630357:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3293:x1830964747538176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.630451:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3293:x1830964747537664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (2425us total) trans 21474840560 rc 0/0 00000100:00100000:2.0:1746144664.630457:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12110 00000100:00100000:0.0:1746144664.630458:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3293:x1830964747538176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (324us total) trans 17179873331 rc 0/0 00000100:00100000:0.0:1746144664.630463:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12111 00000100:00100000:2.0:1746144664.630467:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12112 00000100:00100000:2.0:1746144664.630471:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3293:x1830964747538688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.630473:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12113 00000100:00100000:0.0:1746144664.630477:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3296:x1830964747539456:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144664.630500:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a3480/2, rc 0, transno 21474840560 00000100:00100000:0.0:1746144664.630504:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747537664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.630509:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0e00/2, rc 0, transno 17179873331 00000100:00100000:0.0:1746144664.630511:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747538176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.630562:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3293:x1830964747538688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (380us total) trans 17179873332 rc 0/0 00000100:00100000:2.0:1746144664.630567:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12112 00000100:00100000:0.0:1746144664.630572:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3296:x1830964747539456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (274us total) trans 17179873333 rc 0/0 00000100:00100000:0.0:1746144664.630578:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12113 00000100:00100000:2.0:1746144664.630584:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.630600:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537280 00000100:00100000:0.0:1746144664.630603:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537280 00000100:00100000:0.0:1746144664.630617:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12114 00000100:00100000:0.0:1746144664.630621:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+51:3294:x1830964747537280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.630692:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747537792:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746144664.630699:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144664.630702:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144665 -> 1746144665 00002000:00010000:0.0:1746144664.630705:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144664.630707:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144665 -> 1746144665 00002000:00010000:0.0:1746144664.630709:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746144664.630711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.630728:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3294:x1830964747537280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (142us total) trans 21474840561 rc 0/0 00000100:00100000:0.0:1746144664.630733:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12114 00000100:00100000:0.0:1746144664.631108:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747537792 00000100:00100000:0.0:1746144664.631112:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747537792 00000100:00100000:2.0:1746144664.631114:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747538304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.631131:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.631289:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538304 00000100:00100000:0.0:1746144664.631292:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538304 00000100:00100000:2.0:1746144664.631298:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747538816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.631309:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12115 00000100:00100000:2.0:1746144664.631315:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.631315:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3294:x1830964747537792:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144664.631337:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0a80/2, rc 0, transno 21474840561 00000100:00100000:2.0:1746144664.631341:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747537280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.631353:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747538816 00000100:00100000:2.0:1746144664.631356:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747538816 00000100:00100000:2.0:1746144664.631371:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12116 00000100:00100000:2.0:1746144664.631376:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747538304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144664.631455:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00002000:00010000:2.0:1746144664.631458:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144665 -> 1746144665 00002000:00010000:2.0:1746144664.631460:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144665 -> 1746144665 00002000:00010000:2.0:1746144664.631462:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144665 -> 1746144665 00002000:00010000:2.0:1746144664.631464:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:2.0:1746144664.631486:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3294:x1830964747538304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (353us total) trans 17179873334 rc 0/0 00000100:00100000:2.0:1746144664.631491:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12116 00000100:00100000:2.0:1746144664.631500:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12117 00000100:00100000:2.0:1746144664.631504:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747538816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.631524:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3294:x1830964747537792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (810us total) trans 21474840562 rc 0/0 00000100:00100000:0.0:1746144664.631529:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12115 00000004:00080000:0.0:1746144664.631549:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a2680/2, rc 0, transno 17179873332 00000100:00100000:0.0:1746144664.631553:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747538688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144664.631563:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ee4700/2, rc 0, transno 17179873333 00000100:00100000:0.0:1746144664.631566:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747539456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.631580:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3294:x1830964747538816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (264us total) trans 17179873335 rc 0/0 00000100:00100000:2.0:1746144664.631585:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12117 00000004:00080000:2.0:1746144664.632381:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a1180/2, rc 0, transno 21474840562 00000100:00100000:2.0:1746144664.632386:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747537792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144664.632398:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0380/2, rc 0, transno 17179873334 00000100:00100000:2.0:1746144664.632401:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747538304:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144664.632407:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a3100/2, rc 0, transno 17179873335 00000100:00100000:2.0:1746144664.632410:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747538816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.633247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.633847:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747539200:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.633857:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830964747539328:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.633879:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144664.633892:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01afc7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14709 initiator: MDT0 00000100:00100000:1.0:1746144664.634008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.634065:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746789248 00000100:00100000:0.0:1746144664.634070:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746789248 00000100:00100000:0.0:1746144664.634100:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746789376 00000100:00100000:0.0:1746144664.634102:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746789376 00000100:00100000:0.0:1746144664.634115:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4117 00000100:00100000:0.0:1746144664.634121:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29284:x1830964746789248:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:1.0:1746144664.634200:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4118 00000100:00100000:1.0:1746144664.634208:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:29280:x1830964746789376:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:1.0:1746144664.634294:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:29280:x1830964746789376:12345-192.168.204.23@tcp:49:cat.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.634300:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4118 00000100:00100000:0.0:1746144664.634542:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29284:x1830964746789248:12345-192.168.204.23@tcp:49:cat.0 Request processed in 420us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.634547:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4117 00000100:00100000:3.0:1746144664.634551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.634754:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746789504 00000100:00100000:2.0:1746144664.634757:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746789504 00000100:00100000:2.0:1746144664.634787:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10165 00000100:00100000:2.0:1746144664.634793:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746789504:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144664.634806:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.634826:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01b037 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f514 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.634901:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.634915:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.634925:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144664.634950:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144664.634953:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144664.634963:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.634983:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304be00/0xa7c849b16e01b037 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.634995:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.635006:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.635009:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144664.635023:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130327e00, rc 0) 00000100:00100000:2.0:1746144664.635045:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746789504:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 252us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.635050:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10165 00000100:00100000:0.0:1746144664.637237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.637597:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746789632 00000100:00100000:2.0:1746144664.637604:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746789632 00000100:00100000:2.0:1746144664.637801:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4119 00000100:00100000:2.0:1746144664.637808:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746789632:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:2.0:1746144664.637908:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746789632:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 101us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.637914:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4119 00000100:00100000:0.0:1746144664.639930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.639980:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746789888 00000100:00100000:3.0:1746144664.639987:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746789888 00002000:00100000:3.0:1746144664.640036:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee7b80 x1830964746789888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.640053:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7b80 with x1830964746789888 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.640059:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee7b80 00000100:00100000:3.0:1746144664.640086:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4653 00000100:00100000:3.0:1746144664.640092:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746789888:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144664.642978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.643104:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746790144 00000100:00100000:2.0:1746144664.643112:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746790144 00000100:00100000:0.0:1746144664.643120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.643171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.643178:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10166 00000100:00100000:2.0:1746144664.643185:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746790144:12345-192.168.204.23@tcp:101:multiop.0 00000100:00100000:0.0:1746144664.643185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.643197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144664.643208:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144664.643208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144664.643212:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1746144664.643222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144664.643239:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01afe3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f8 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.643241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.643257:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746790528 00010000:00010000:2.0:1746144664.643258:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:0.0:1746144664.643260:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746790528 00010000:00010000:2.0:1746144664.643262:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144664.643273:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01b045 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f51b expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.643279:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746790784 00000100:00100000:0.0:1746144664.643280:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746790784 00000100:00100000:0.0:1746144664.643293:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791040 00000100:00100000:0.0:1746144664.643294:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791040 00000100:00100000:0.0:1746144664.643305:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746790656 00000100:00100000:0.0:1746144664.643306:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746790656 00000100:00100000:0.0:1746144664.643315:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746790912 00000100:00100000:0.0:1746144664.643316:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746790912 00010000:00010000:2.0:1746144664.643324:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144664.643325:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791168 00000100:00100000:0.0:1746144664.643326:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791168 00010000:00010000:2.0:1746144664.643336:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.643338:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12118 00010000:00010000:2.0:1746144664.643343:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.643343:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746790528:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144664.643350:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.643350:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.643355:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144664.643364:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f522 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144664.643382:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x805 00010000:00010000:2.0:1746144664.643384:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.643394:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 7 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:0.0:1746144664.643395:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643397:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643405:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.643406:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539584:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144664.643416:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643425:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b8600, rc 0) 00000100:00100000:0.0:1746144664.643460:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746790528:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.643466:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12118 00000100:00100000:0.0:1746144664.643479:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12119 00000100:00100000:3.0:1746144664.643484:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12120 00000100:00100000:0.0:1746144664.643484:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746790784:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:3.0:1746144664.643490:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746791040:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144664.643491:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.643495:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.643501:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f530 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.643502:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f53e expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144664.643514:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x821 00010000:00010000:3.0:1746144664.643516:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.643518:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643521:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.643523:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643523:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643526:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.643532:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.643538:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19c000, rc 0) 00010000:00010000:0.0:1746144664.643539:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643545:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b8a00, rc 0) 00000100:00100000:3.0:1746144664.643552:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746791040:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 63us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.643556:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746790784:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 72us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.643558:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12120 00000100:00100000:0.0:1746144664.643560:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12119 00000100:00100000:0.0:1746144664.643568:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12121 00000100:00100000:0.0:1746144664.643572:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746790656:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144664.643577:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.643584:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f529 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144664.643593:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x821 00010000:00010000:0.0:1746144664.643600:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643601:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643605:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643613:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144664.643618:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12122 00010000:00010000:0.0:1746144664.643619:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b8c00, rc 0) 00000100:00100000:3.0:1746144664.643623:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746790912:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144664.643629:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144664.643633:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746790656:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 61us (424us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144664.643636:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f537 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.643641:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12121 00002000:00010000:3.0:1746144664.643647:0:8389:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d98, atime: 0x68140d98, ctime: 0x68140d98, blocks: 0x81d 00000100:00100000:0.0:1746144664.643649:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12123 00000100:00100000:0.0:1746144664.643654:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746791168:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144664.643655:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.643656:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643658:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.643659:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643663:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f545 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.643667:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643671:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643672:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.643676:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.643678:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19c600, rc 0) 00010000:00010000:0.0:1746144664.643683:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 11 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.643689:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b9800, rc 0) 00000100:00100000:3.0:1746144664.643690:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746790912:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 67us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.643694:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12122 00000100:00100000:0.0:1746144664.643699:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746791168:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.643703:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12123 00010000:00010000:2.0:1746144664.643871:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 7 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.643884:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 7 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.643895:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539712:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.643923:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.643931:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 7 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.643938:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539840:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.643957:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013640ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.644052:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746790400 00000100:00100000:3.0:1746144664.644056:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746790400 00002000:00100000:3.0:1746144664.644080:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a51edc00 x1830964746790400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.644089:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51edc00 with x1830964746790400 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.644092:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51edc00 00000100:00100000:3.0:1746144664.644105:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4654 00000100:00100000:3.0:1746144664.644109:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746790400:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.653492:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539584:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.653505:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539712:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.653621:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746789888:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 13525us (13695us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.653633:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4653 00002000:00100000:3.0:1746144664.653646:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee7b80 x1830964746789888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.653656:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7b80 with x1830964746789888 ext(3145728->4194303) 00002000:00010000:3.0:1746144664.653662:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee7b80 00000100:00100000:0.0:1746144664.655556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.655579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.655593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.655609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.655670:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791296 00000100:00100000:1.0:1746144664.655678:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791296 00000100:00100000:2.0:1746144664.655683:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791552 00000100:00100000:2.0:1746144664.655691:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791552 00010000:00010000:2.0:1746144664.655715:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.655715:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 8 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.655736:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791424 00000100:00100000:2.0:1746144664.655738:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791424 00000100:00100000:1.0:1746144664.655744:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6056 00010000:00010000:2.0:1746144664.655747:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.655751:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:1963:x1830964746791552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144664.655758:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6057 00000100:00100000:2.0:1746144664.655762:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746791296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.655763:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144664.655765:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6058 00010000:00010000:2.0:1746144664.655766:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144664.655768:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.655769:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 9 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.655774:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1370050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746791424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144664.655777:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 8 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.655789:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144664.655795:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.656453:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 9 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.656480:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 9 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.656493:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.656494:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327e00/0xa7c849b16e01b03e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f514 expref: 9 pid: 14710 timeout: 743 lvb_type: 0 00010000:00010000:1.0:1746144664.656499:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144664.656506:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144664.656511:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144664.656516:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.656518:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01b022 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f50d expref: 8 pid: 14709 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.656519:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.656524:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.656531:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.656546:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144664.656772:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.656775:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144664.656784:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:1963:x1830964746791552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1031us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.656792:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6056 00000100:00100000:2.0:1746144664.656878:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746791296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1114us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.656885:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6057 00000100:00100000:2.0:1746144664.656977:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791680 00000100:00100000:2.0:1746144664.656981:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791680 00000100:00100000:2.0:1746144664.657002:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10167 00000100:00100000:2.0:1746144664.657006:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746791680:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144664.657031:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.657054:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f54c expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.657098:0:15388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.657106:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.657117:0:15388:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.657124:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.657149:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.657152:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144664.657154:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.657160:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782000, rc 0) 00000100:00100000:2.0:1746144664.657188:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746791680:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 181us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.657193:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10167 00000100:00100000:3.0:1746144664.657424:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1370050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746791424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1651us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.657432:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6058 00000100:00100000:2.0:1746144664.657463:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746790400:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13353us (14342us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.657471:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4654 00002000:00100000:2.0:1746144664.657479:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a51edc00 x1830964746790400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.657487:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51edc00 with x1830964746790400 ext(3145728->4194303) 00002000:00010000:2.0:1746144664.657492:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51edc00 00010000:00010000:3.0:1746144664.657505:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01afd5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4ea expref: 7 pid: 14710 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.657517:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747539840:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.657539:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.657547:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.657552:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14710 initiator: MDT0 00000040:00080000:3.0:1746144664.658195:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2976, 88 off248840 00000004:00080000:3.0:1746144664.658202:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643867066810ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.658258:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2889, 88 off241176 00000004:00080000:3.0:1746144664.658263:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643867128286ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.658275:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2890, 88 off241264 00000004:00080000:3.0:1746144664.658278:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643867143135ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.658306:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2977, 88 off248928 00000004:00080000:3.0:1746144664.660194:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869057547ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660250:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2978, 88 off249016 00000004:00080000:3.0:1746144664.660255:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869120531ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660269:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2891, 88 off241352 00000004:00080000:3.0:1746144664.660271:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643869136846ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.660286:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2892, 88 off241440 00000004:00080000:3.0:1746144664.660289:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643869154561ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.660295:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2893, 88 off241528 00000004:00080000:3.0:1746144664.660298:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643869163346ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.660305:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2979, 88 off249104 00000004:00080000:3.0:1746144664.660307:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869173067ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660314:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2894, 88 off241616 00000004:00080000:3.0:1746144664.660316:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643869181817ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.660322:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2980, 88 off249192 00000004:00080000:3.0:1746144664.660325:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869190415ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660332:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2895, 88 off241704 00000004:00080000:3.0:1746144664.660334:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643869200016ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144664.660341:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2981, 88 off249280 00000004:00080000:3.0:1746144664.660343:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869208500ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660349:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2982, 88 off249368 00000004:00080000:3.0:1746144664.660351:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869216334ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660356:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2983, 88 off249456 00000004:00080000:3.0:1746144664.660359:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869224175ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660366:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2984, 88 off249544 00000004:00080000:3.0:1746144664.660368:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 643869233495ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144664.660374:0:14710:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2896, 88 off241792 00000004:00080000:3.0:1746144664.660377:0:14710:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 643869242341ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144664.661901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.662206:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791808 00000100:00100000:3.0:1746144664.662215:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791808 00000100:00100000:3.0:1746144664.663342:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10168 00000100:00100000:3.0:1746144664.663354:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29284:x1830964746791808:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.663376:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.663494:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f553 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.663555:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.663568:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.663582:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.663585:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144664.663588:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.663594:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e6400, rc 0) 00000100:00100000:3.0:1746144664.663644:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29284:x1830964746791808:12345-192.168.204.23@tcp:101:cat.0 Request processed in 293us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.663650:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10168 00000100:00100000:0.0:1746144664.668339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.668454:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746791936 00000100:00100000:3.0:1746144664.668464:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746791936 00000100:00100000:3.0:1746144664.668509:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10169 00000100:00100000:3.0:1746144664.668518:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+7:29280:x1830964746791936:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.668542:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.668561:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f55a expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.668620:0:15388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.668632:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.668645:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.668648:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144664.668652:0:15388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.668659:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7800, rc 0) 00000100:00100000:3.0:1746144664.668704:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29280:x1830964746791936:12345-192.168.204.23@tcp:101:cat.0 Request processed in 186us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.668710:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10169 00000001:00080000:0.0:1746144664.679037:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944053 is committed 00000001:00080000:0.0:1746144664.679052:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944054 is committed 00000004:00080000:0.0:1746144664.679057:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2081 committed 00000004:00080000:0.0:1746144664.679063:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2165 committed 00000004:00080000:0.0:1746144664.679069:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2164 committed 00000004:00080000:0.0:1746144664.679070:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2163 committed 00000004:00080000:0.0:1746144664.679072:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2162 committed 00000004:00080000:0.0:1746144664.679074:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2080 committed 00000004:00080000:0.0:1746144664.679075:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2161 committed 00000004:00080000:0.0:1746144664.679077:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2079 committed 00000004:00080000:0.0:1746144664.679078:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2160 committed 00010000:00010000:3.0:1746144664.679079:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746144664.679080:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2078 committed 00000004:00080000:0.0:1746144664.679081:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2077 committed 00000004:00080000:0.0:1746144664.679082:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2076 committed 00000004:00080000:0.0:1746144664.679084:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2159 committed 00000004:00080000:0.0:1746144664.679085:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2158 committed 00000004:00080000:0.0:1746144664.679087:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2075 committed 00000004:00080000:0.0:1746144664.679088:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2074 committed 00000004:00080000:0.0:1746144664.679090:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2157 committed 00010000:00010000:3.0:1746144664.679093:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.679096:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746144664.679100:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679111:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679117:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679123:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679130:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679150:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679155:0:14710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679160:0:14710:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679163:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.679183:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.679195:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747540096:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.679243:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747540224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144664.679266:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747540352:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746144664.679273:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.679277:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747540864:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.679288:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746144664.679293:0:14710:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 6 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.679297:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747541376:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.679309:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144664.679310:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144664.679321:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747540736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144664.679330:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747540992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.679339:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.679353:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747539968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.679354:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747541504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.679354:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144664.679367:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747541632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.679374:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.679390:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747540608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.679393:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747540224 00000100:00100000:1.0:1746144664.679394:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747540352 00000100:00100000:2.0:1746144664.679400:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747540224 00000100:00100000:1.0:1746144664.679400:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747540352 00000100:00100000:0.0:1746144664.679402:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.679412:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747541248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.679424:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144664.679438:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747540992 00000100:00100000:1.0:1746144664.679438:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747540736 00000100:00100000:0.0:1746144664.679440:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747541888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679441:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747540992 00000100:00100000:1.0:1746144664.679441:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747540736 00000100:00100000:3.0:1746144664.679447:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747539968 00000100:00100000:3.0:1746144664.679450:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747539968 00000100:00100000:0.0:1746144664.679451:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144664.679457:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747540608 00000100:00100000:2.0:1746144664.679458:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747541248 00000100:00100000:2.0:1746144664.679460:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747541248 00000100:00100000:1.0:1746144664.679460:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747540608 00000100:00100000:3.0:1746144664.679462:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747541888 00000100:00100000:3.0:1746144664.679464:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747541888 00000100:00100000:0.0:1746144664.679464:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144664.679467:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747542016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.679470:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12124 00000100:00100000:2.0:1746144664.679476:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12125 00000100:00100000:1.0:1746144664.679477:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3295:x1830964747540352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144664.679480:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12126 00000100:00100000:2.0:1746144664.679481:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747540224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679481:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144664.679485:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747540736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679493:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747540480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.679494:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747542016 00000100:00100000:2.0:1746144664.679496:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747542016 00000100:00100000:2.0:1746144664.679506:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12127 00000100:00100000:0.0:1746144664.679507:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144664.679510:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3295:x1830964747540992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679514:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747541120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679525:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.679531:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747541760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679536:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747540480 00000100:00100000:2.0:1746144664.679538:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747540480 00000100:00100000:0.0:1746144664.679542:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144664.679548:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747541120 00000100:00100000:0.0:1746144664.679548:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747542272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679549:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747541120 00000100:00100000:2.0:1746144664.679555:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747541760 00000100:00100000:2.0:1746144664.679557:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747541760 00000100:00100000:0.0:1746144664.679559:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144664.679564:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747542272 00000100:00100000:2.0:1746144664.679565:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747542272 00000100:00100000:0.0:1746144664.679566:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746144664.679569:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747542144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679574:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12128 00000100:00100000:2.0:1746144664.679578:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3293:x1830964747539968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679581:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144664.679594:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747542144 00000100:00100000:0.0:1746144664.679597:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747542144 00000100:00100000:0.0:1746144664.679609:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12129 00000100:00100000:0.0:1746144664.679614:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3293:x1830964747540608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679626:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12130 00000100:00100000:1.0:1746144664.679629:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12131 00000100:00100000:0.0:1746144664.679630:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3293:x1830964747541248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.679633:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3293:x1830964747541888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144664.679661:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144664.679665:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00000100:00100000:3.0:1746144664.679667:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3294:x1830964747540736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (327us total) trans 21474840563 rc 0/0 00002000:00010000:2.0:1746144664.679668:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144664.679670:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144664.679671:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144664.679677:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12132 00000100:00100000:3.0:1746144664.679681:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12126 00000100:00100000:0.0:1746144664.679681:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3293:x1830964747542016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679694:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3293:x1830964747539968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (319us total) trans 21474840565 rc 0/0 00000100:00100000:3.0:1746144664.679695:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12133 00000100:00100000:2.0:1746144664.679700:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12128 00000100:00100000:3.0:1746144664.679701:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3296:x1830964747540480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.679711:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12134 00000100:00100000:2.0:1746144664.679716:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3296:x1830964747541120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144664.679716:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12135 00000100:00100000:1.0:1746144664.679721:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3296:x1830964747541760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.679732:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144664.679752:0:10724:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:1.0:1746144664.679757:0:10724:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost00_012' 00002000:00010000:3.0:1746144664.679766:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144664.679769:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144664.679771:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144664.679772:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144664.679774:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144664.679799:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3296:x1830964747540480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (291us total) trans 21474840566 rc 0/0 00000100:00100000:2.0:1746144664.679801:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3296:x1830964747541120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (274us total) trans 21474840567 rc 0/0 00000100:00100000:1.0:1746144664.679802:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3293:x1830964747541888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (349us total) trans 17179873336 rc 0/0 00000100:00100000:3.0:1746144664.679805:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12133 00000100:00100000:2.0:1746144664.679808:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12134 00000100:00100000:1.0:1746144664.679811:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12131 00000100:00100000:2.0:1746144664.679818:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747541632 00000100:00100000:3.0:1746144664.679820:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12136 00000100:00100000:2.0:1746144664.679820:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747541632 00000100:00100000:1.0:1746144664.679823:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12137 00000004:00080000:0.0:1746144664.679824:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eca80/2, rc 0, transno 21474840566 00000100:00100000:3.0:1746144664.679825:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3296:x1830964747542272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.679828:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830964747542144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679832:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12138 00000100:00100000:2.0:1746144664.679836:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+67:3295:x1830964747541632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.679841:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747540480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.679851:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ec700/2, rc 0, transno 21474840567 00000100:00100000:0.0:1746144664.679853:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747541120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.679866:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ef480/2, rc 0, transno 21474840565 00000100:00100000:0.0:1746144664.679868:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747539968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144664.679875:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8dc00/2, rc 0, transno 17179873336 00000100:00100000:0.0:1746144664.679881:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747541888:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144664.679901:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4934944 -> 4934944 00000100:00100000:3.0:1746144664.679902:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:3296:x1830964747542272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (341us total) trans 17179873339 rc 0/0 00002000:00010000:2.0:1746144664.679904:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144665 -> 1746144665 00000100:00100000:1.0:1746144664.679905:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3296:x1830964747542144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (323us total) trans 17179873340 rc 0/0 00002000:00010000:2.0:1746144664.679906:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144665 -> 1746144665 00000100:00100000:3.0:1746144664.679907:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12136 00002000:00010000:2.0:1746144664.679907:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144665 -> 1746144665 00000004:00080000:0.0:1746144664.679907:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8ea00/2, rc 0, transno 17179873340 00002000:00010000:2.0:1746144664.679909:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5615 00000100:00100000:0.0:1746144664.679909:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747542144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144664.679911:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12137 00000004:00080000:0.0:1746144664.679915:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8d500/2, rc 0, transno 17179873339 00000100:00100000:0.0:1746144664.679923:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747542272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144664.679928:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3295:x1830964747541632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (195us total) trans 17179873341 rc 0/0 00000100:00100000:2.0:1746144664.679932:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12138 00000100:00100000:2.0:1746144664.679945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746144664.679963:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ef100/2, rc 0, transno 21474840563 00000100:00100000:2.0:1746144664.679966:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747540736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144664.679969:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3293:x1830964747542016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 286us (485us total) trans 17179873337 rc 0/0 00000100:00100000:2.0:1746144664.679971:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746144664.679972:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3295:x1830964747540992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 461us (617us total) trans 21474840568 rc 0/0 00000100:00100000:0.0:1746144664.679974:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12132 00000100:00100000:2.0:1746144664.679975:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747542400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144664.679977:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12127 00000100:00100000:0.0:1746144664.679983:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747541504 00000100:00100000:0.0:1746144664.679985:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747541504 00000100:00100000:2.0:1746144664.679992:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144664.679997:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3296:x1830964747541760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 276us (453us total) trans 17179873342 rc 0/0 00000100:00100000:0.0:1746144664.679999:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747542400 00000100:00100000:0.0:1746144664.680000:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747542400 00000100:00100000:1.0:1746144664.680003:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12135 00000100:00100000:3.0:1746144664.680006:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12139 00000100:00100000:3.0:1746144664.680021:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3294:x1830964747541504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144664.680024:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12140 00000100:00100000:0.0:1746144664.680029:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3294:x1830964747542400:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144664.680040:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ed180/2, rc 0, transno 21474840568 00000100:00100000:1.0:1746144664.680043:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747540992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144664.680050:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ee300/2, rc 0, transno 17179873341 00000100:00100000:1.0:1746144664.680062:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747541632:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144664.680083:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144664.680086:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144664.680087:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144664.680089:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144664.680089:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144664.680091:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:2.0:1746144664.680091:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746144664.680093:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144664.680095:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:3.0:1746144664.680097:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746144664.680112:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3294:x1830964747542400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (119us total) trans 17179873344 rc 0/0 00000100:00100000:2.0:1746144664.680114:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+62:3294:x1830964747540224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 633us (826us total) trans 21474840569 rc 0/0 00000100:00100000:3.0:1746144664.680119:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3294:x1830964747541504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (172us total) trans 17179873343 rc 0/0 00000100:00100000:0.0:1746144664.680119:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12140 00000100:00100000:2.0:1746144664.680122:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12125 00000100:00100000:3.0:1746144664.680125:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12139 00002000:00010000:0.0:1746144664.680164:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144664.680166:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144664.680168:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144664.680170:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144664 -> 1746144664 00002000:00010000:0.0:1746144664.680172:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2053 00002000:00010000:1.0:1746144664.680179:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144664.680181:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144665 -> 1746144665 00002000:00010000:1.0:1746144664.680182:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144664 -> 1746144664 00002000:00010000:1.0:1746144664.680184:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144665 -> 1746144665 00002000:00010000:1.0:1746144664.680186:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144664.680190:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3293:x1830964747541248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 560us (765us total) trans 17179873338 rc 0/0 00000100:00100000:0.0:1746144664.680195:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12130 00000100:00100000:1.0:1746144664.680202:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3295:x1830964747540352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 726us (891us total) trans 21474840564 rc 0/0 00000100:00100000:1.0:1746144664.680206:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12124 00000004:00080000:0.0:1746144664.680212:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8ca80/2, rc 0, transno 17179873337 00000100:00100000:0.0:1746144664.680215:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747542016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144664.680220:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eea00/2, rc 0, transno 21474840564 00000004:00080000:0.0:1746144664.680222:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ec380/2, rc 0, transno 21474840570 00000100:00100000:1.0:1746144664.680223:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747540352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.680224:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3293:x1830964747540608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 609us (820us total) trans 21474840570 rc 0/0 00000100:00100000:0.0:1746144664.680225:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747540608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144664.680229:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12129 00000004:00080000:0.0:1746144664.680230:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51edf80/2, rc 0, transno 17179873338 00000100:00100000:0.0:1746144664.680232:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747541248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144664.680242:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099b8d180/2, rc 0, transno 17179873342 00000100:00100000:0.0:1746144664.680245:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747541760:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144664.680250:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b813b80/2, rc 0, transno 17179873344 00000100:00100000:2.0:1746144664.680254:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747542400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144664.680260:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eed80/2, rc 0, transno 17179873343 00000100:00100000:2.0:1746144664.680262:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747541504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144664.680268:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ed500/2, rc 0, transno 21474840569 00000100:00100000:2.0:1746144664.680270:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747540224:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144664.680915:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747540096:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.680924:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747540864:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144664.680960:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747541376:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144664.680992:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130326600/0xa7c849b16e01b045 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 299 pid: 14710 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746144664.681002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144664.681007:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.681044:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130327800, rc 0) 00000100:00100000:2.0:1746144664.681048:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792064 00000100:00100000:2.0:1746144664.681051:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792064 00000100:00100000:3.0:1746144664.681073:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746790144:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 37888us (38106us total) trans 8589944054 rc 0/0 00000100:00100000:2.0:1746144664.681074:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4120 00000100:00100000:3.0:1746144664.681079:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10166 00000100:00100000:2.0:1746144664.681080:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:29280:x1830964746792064:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144664.681154:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:29280:x1830964746792064:12345-192.168.204.23@tcp:49:cat.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.681160:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4120 00000100:00100000:3.0:1746144664.681164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.681182:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792192 00000100:00100000:2.0:1746144664.681184:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792192 00000100:00100000:2.0:1746144664.681195:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4121 00000100:00100000:2.0:1746144664.681198:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746792192:12345-192.168.204.23@tcp:49:mirror_io.0 00000100:00100000:3.0:1746144664.681202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.681218:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792320 00000100:00100000:0.0:1746144664.681221:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792320 00000100:00100000:2.0:1746144664.681227:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746792192:12345-192.168.204.23@tcp:49:mirror_io.0 Request processed in 28us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.681230:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4121 00000100:00100000:0.0:1746144664.681237:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4122 00000100:00100000:0.0:1746144664.681242:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d8f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29284:x1830964746792320:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:0.0:1746144664.681283:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d8f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29284:x1830964746792320:12345-192.168.204.23@tcp:49:cat.0 Request processed in 40us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.681289:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4122 00000100:00100000:0.0:1746144664.682860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.682910:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792448 00000100:00100000:2.0:1746144664.682916:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792448 00000100:00100000:2.0:1746144664.682952:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4123 00000100:00100000:2.0:1746144664.682957:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746792448:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:2.0:1746144664.683083:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746792448:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 125us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.683089:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4123 00000100:00100000:2.0:1746144664.689443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.689485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.689561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.689586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.689600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.689613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.689620:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792576 00000100:00100000:2.0:1746144664.689626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.689630:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792576 00000100:00100000:2.0:1746144664.689638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.689652:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792704 00000100:00100000:3.0:1746144664.689657:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792704 00000100:00100000:2.0:1746144664.689664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.689669:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792832 00000100:00100000:1.0:1746144664.689671:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792832 00000100:00100000:3.0:1746144664.689679:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746792960 00000100:00100000:3.0:1746144664.689681:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746792960 00000100:00100000:2.0:1746144664.689682:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793088 00000100:00100000:1.0:1746144664.689684:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793344 00000100:00100000:2.0:1746144664.689686:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793088 00000100:00100000:1.0:1746144664.689686:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793344 00000100:00100000:3.0:1746144664.689692:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793600 00000100:00100000:3.0:1746144664.689694:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793600 00000100:00100000:1.0:1746144664.689695:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793216 00000100:00100000:1.0:1746144664.689697:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793216 00000100:00100000:2.0:1746144664.689701:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793472 00000100:00100000:2.0:1746144664.689703:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793472 00000100:00100000:3.0:1746144664.689708:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12141 00000100:00100000:1.0:1746144664.689715:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12142 00000100:00100000:3.0:1746144664.689716:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29293:x1830964746792576:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.689735:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.689754:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f561 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.689784:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.689793:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.689806:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.689812:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.689814:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.689817:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2949120->3051519] (req 2949120->3051519) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.689848:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.689858:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 23 pid: 4758 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.689870:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747542528:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.689915:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1961:x1830964746792704:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144664.689917:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12143 00000100:00100000:2.0:1746144664.689924:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746792832:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.689925:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.689930:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.689936:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f568 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.689939:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f56f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.689950:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.689950:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.689952:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.689952:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.689953:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 10 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.689958:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.689959:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 49 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.689962:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 10 pid: 10724 timeout: 743 lvb_type: 1 00000100:00100000:3.0:1746144664.689969:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747542656:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.689972:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.689974:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 49 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144664.689978:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12144 00010000:00010000:2.0:1746144664.689982:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782a00, rc 0) 00010000:00010000:1.0:1746144664.689982:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437cc00, rc 0) 00000100:00100000:0.0:1746144664.689991:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746792960:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.689996:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.689997:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144664.690004:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f576 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.690005:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746792832:12345-192.168.204.23@tcp:101:cat.0 Request processed in 82us (444us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144664.690008:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 22 pid: 7257 timeout: 743 lvb_type: 0 00000100:00100000:1.0:1746144664.690022:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746792704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 109us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.690026:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12143 00010000:00010000:0.0:1746144664.690026:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.690027:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144664.690029:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747542784:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.690030:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12142 00010000:00010000:0.0:1746144664.690032:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.690041:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12145 00010000:00010000:0.0:1746144664.690041:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 24 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.690046:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746793344:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144664.690047:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12146 00010000:00010000:0.0:1746144664.690048:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b4400, rc 0) 00000100:00100000:3.0:1746144664.690049:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144664.690052:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1961:x1830964746793088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.690053:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.690057:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.690059:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f58b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.690063:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f57d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.690064:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746792960:12345-192.168.204.23@tcp:101:cat.0 Request processed in 80us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.690068:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12147 00010000:00010000:2.0:1746144664.690069:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.690071:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.690071:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.690072:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144664.690073:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746793600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.690075:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.690076:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 49 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144664.690076:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12144 00010000:00010000:3.0:1746144664.690080:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.690084:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.690085:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 49 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.690087:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f599 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.690087:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12148 00010000:00010000:2.0:1746144664.690090:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782600, rc 0) 00000100:00100000:0.0:1746144664.690092:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746793216:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.690097:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437ce00, rc 0) 00010000:00010000:0.0:1746144664.690097:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.690098:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.690099:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.690102:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f584 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.690104:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 34 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.690105:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746793344:12345-192.168.204.23@tcp:101:cat.0 Request processed in 59us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.690111:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12145 00000100:00100000:1.0:1746144664.690111:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746793088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 59us (510us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144664.690111:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144664.690113:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144664.690113:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746144664.690116:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12146 00010000:00010000:0.0:1746144664.690116:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 35 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144664.690120:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12149 00010000:00010000:3.0:1746144664.690121:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7600, rc 0) 00000100:00100000:2.0:1746144664.690125:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746793472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.690125:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 35 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.690130:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144664.690153:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746793600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 60us (505us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144664.690155:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f592 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.690156:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b4c00, rc 0) 00000100:00100000:3.0:1746144664.690159:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12147 00010000:00010000:2.0:1746144664.690165:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.690166:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144664.690168:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746793216:12345-192.168.204.23@tcp:101:cat.0 Request processed in 76us (528us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144664.690170:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144664.690173:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12148 00010000:00010000:2.0:1746144664.690178:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.690185:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782400, rc 0) 00000100:00100000:2.0:1746144664.690197:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746793472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 72us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.690205:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12149 00000100:00100000:0.0:1746144664.695054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.695086:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747542528:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.695098:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747542656:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.695119:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793728 00000100:00100000:2.0:1746144664.695126:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793728 00010000:00010000:2.0:1746144664.695178:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 24 pid: 4758 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.695250:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6059 00000100:00100000:2.0:1746144664.695258:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746793728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.695272:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144664.695273:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747542784:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.695307:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2949120->3051519] (req 2949120->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.695322:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 24 pid: 4758 timeout: 743 lvb_type: 0 00010000:00010000:3.0:1746144664.695324:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921c6e00, rc 0) 00010000:00010000:2.0:1746144664.695333:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 24 pid: 4758 timeout: 743 lvb_type: 0 00000100:00100000:3.0:1746144664.695371:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29293:x1830964746792576:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5655us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.695378:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12141 00010000:00010000:2.0:1746144664.695384:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7000/0xa7c849b16e01afdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4f1 expref: 24 pid: 4758 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.695396:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.695423:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746793728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 166us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.695429:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6059 00000100:00100000:0.0:1746144664.697098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.697294:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793856 00000100:00100000:2.0:1746144664.697301:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793856 00010000:00010000:2.0:1746144664.697323:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 11 pid: 10724 timeout: 743 lvb_type: 1 00000100:00100000:2.0:1746144664.697372:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6060 00000100:00100000:2.0:1746144664.697378:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746793856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.697389:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.697450:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 11 pid: 10724 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.697460:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 11 pid: 10724 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.697477:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b9800/0xa7c849b16e01b076 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f545 expref: 11 pid: 10724 timeout: 743 lvb_type: 1 00010000:00010000:2.0:1746144664.697487:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.697529:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746793856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 150us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.697535:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6060 00000100:00100000:0.0:1746144664.697624:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.697660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.697701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.697757:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746794240 00000100:00100000:3.0:1746144664.697761:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746794240 00002000:00100000:3.0:1746144664.697791:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b812d80 x1830964746794240/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.697801:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b812d80 with x1830964746794240 ext(4194304->4935679) 00002000:00010000:3.0:1746144664.697805:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b812d80 00000100:00100000:3.0:1746144664.697816:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746794496 00000100:00100000:3.0:1746144664.697818:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746794496 00002000:00100000:3.0:1746144664.697830:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b811f80 x1830964746794496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.697837:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b811f80 with x1830964746794496 ext(4194304->4935679) 00002000:00010000:3.0:1746144664.697840:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b811f80 00000100:00100000:3.0:1746144664.697851:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4655 00000100:00100000:3.0:1746144664.697856:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746794240:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.698342:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4656 00000100:00100000:0.0:1746144664.698355:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746794496:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.698909:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746793984 00000100:00100000:2.0:1746144664.698913:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746793984 00010000:00010000:2.0:1746144664.698930:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 23 pid: 7257 timeout: 743 lvb_type: 0 00000100:00100000:2.0:1746144664.698963:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6061 00000100:00100000:2.0:1746144664.698969:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746793984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.698978:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.698993:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 23 pid: 7257 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.699003:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 23 pid: 7257 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.699028:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7e00/0xa7c849b16e01afce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4e3 expref: 23 pid: 7257 timeout: 743 lvb_type: 0 00010000:00010000:2.0:1746144664.699040:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.699042:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.699049:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.699056:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.699086:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.699096:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747542912:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.699191:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.704994:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747542912:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.705029:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.705078:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746793984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6107us (7941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.705088:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6061 00000100:00100000:0.0:1746144664.705576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.705860:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746794752 00000100:00100000:2.0:1746144664.705867:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746794752 00002000:00100000:2.0:1746144664.705904:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2949120->2953215) req@ffff88009b811c00 x1830964746794752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.705913:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b811c00 with x1830964746794752 ext(2949120->2953215) 00002000:00010000:2.0:1746144664.705918:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b811c00 00000100:00100000:2.0:1746144664.705935:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4657 00000100:00100000:2.0:1746144664.705942:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746794752:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.706110:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746794752:12345-192.168.204.23@tcp:3:cat.0 Request processed in 168us (534us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.706116:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4657 00002000:00100000:2.0:1746144664.706120:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2949120->2953215) req@ffff88009b811c00 x1830964746794752/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.706127:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b811c00 with x1830964746794752 ext(2949120->2953215) 00002000:00010000:2.0:1746144664.706129:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b811c00 00000100:00100000:2.0:1746144664.709076:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746794496:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10716us (11362us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144664.709092:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4656 00002000:00100000:2.0:1746144664.709103:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b811f80 x1830964746794496/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.709112:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b811f80 with x1830964746794496 ext(4194304->4935679) 00002000:00010000:2.0:1746144664.709118:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b811f80 00000100:00100000:3.0:1746144664.710476:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746794240:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12614us (12809us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144664.710486:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4655 00002000:00100000:3.0:1746144664.710496:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b812d80 x1830964746794240/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.710503:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b812d80 with x1830964746794240 ext(4194304->4935679) 00002000:00010000:3.0:1746144664.710507:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b812d80 00000100:00100000:0.0:1746144664.716091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.716175:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746795008 00000100:00100000:3.0:1746144664.716185:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746795008 00002000:00100000:3.0:1746144664.716234:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3047424->3051519) req@ffff88009b812300 x1830964746795008/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.716243:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b812300 with x1830964746795008 ext(3047424->3051519) 00002000:00010000:3.0:1746144664.716248:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b812300 00000100:00100000:3.0:1746144664.716274:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4658 00000100:00100000:3.0:1746144664.716282:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746795008:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144664.716478:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746795008:12345-192.168.204.23@tcp:3:cat.0 Request processed in 197us (398us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144664.716485:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4658 00002000:00100000:3.0:1746144664.716490:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3047424->3051519) req@ffff88009b812300 x1830964746795008/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.716497:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b812300 with x1830964746795008 ext(3047424->3051519) 00002000:00010000:3.0:1746144664.716500:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b812300 00000100:00100000:0.0:1746144664.716610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.717864:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746795136 00000100:00100000:3.0:1746144664.717871:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746795136 00000100:00100000:3.0:1746144664.717898:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12150 00000100:00100000:3.0:1746144664.717903:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746795136:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.717916:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.717933:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b0d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5a0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.717979:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747543040:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144664.718064:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144664.719263:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1746144664.720785:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144664 -> 1746144665 00000100:00100000:3.0:1746144664.720816:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747543040:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144664.720853:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b0d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5a0 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.720867:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b0d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5a0 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.720933:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6200, rc 0) 00000100:00100000:3.0:1746144664.720995:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746795136:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3090us (4383us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144664.721004:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12150 00000100:00100000:0.0:1746144664.723038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.723099:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746795392 00000100:00100000:2.0:1746144664.723107:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746795392 00000100:00100000:2.0:1746144664.723195:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4124 00000100:00100000:2.0:1746144664.723202:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29293:x1830964746795392:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144664.723480:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29293:x1830964746795392:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 277us (450us total) trans 8589944055 rc 0/0 00000100:00100000:2.0:1746144664.723487:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4124 00000100:00100000:0.0:1746144664.728624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.728807:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746795520 00000100:00100000:3.0:1746144664.728818:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746795520 00000100:00100000:3.0:1746144664.728878:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12151 00000100:00100000:3.0:1746144664.728887:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746795520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.728907:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.728925:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b0d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5a7 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144664.729001:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747543168:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144664.729721:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.732077:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747543168:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144664.732112:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b0d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5a7 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.732126:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b0d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5a7 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.732170:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7800, rc 0) 00000100:00100000:3.0:1746144664.733357:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746795520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4466us (4738us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144664.733366:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12151 00000100:00100000:0.0:1746144664.739712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.739781:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746795776 00000100:00100000:1.0:1746144664.739792:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746795776 00000100:00100000:1.0:1746144664.739856:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4125 00000100:00100000:1.0:1746144664.739865:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+7:29280:x1830964746795776:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144664.741791:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29280:x1830964746795776:12345-192.168.204.23@tcp:35:cat.0 Request processed in 1919us (2081us total) trans 8589944056 rc 0/0 00000100:00100000:1.0:1746144664.741802:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4125 00000100:00100000:0.0:1746144664.811576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.811854:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746795904 00000100:00100000:3.0:1746144664.811863:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746795904 00000100:00100000:3.0:1746144664.811913:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12152 00000100:00100000:3.0:1746144664.811920:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:29291:x1830964746795904:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.811941:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.811961:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5ae expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.811991:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.812003:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144664.812004:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144664.812016:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2211840->3145727] (req 2211840->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.812045:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.812058:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 21 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144664.812070:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747543296:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144664.813395:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.816973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.817043:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746796032 00000100:00100000:2.0:1746144664.817050:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746796032 00002000:00100000:2.0:1746144664.817094:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2949120->3051519) req@ffff88009f16bb80 x1830964746796032/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.817103:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16bb80 with x1830964746796032 ext(2949120->3051519) 00010000:00010000:2.0:1746144664.817112:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 22 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.817126:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 22 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746144664.817132:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16bb80 00000100:00100000:2.0:1746144664.817185:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 927 00000100:00100000:2.0:1746144664.817191:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746796032:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144664.817462:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747543296:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.817491:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2211840->3145727] (req 2211840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.817505:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6600, rc 0) 00000100:00100000:3.0:1746144664.817531:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:29291:x1830964746795904:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5610us (5964us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.817537:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12152 00000100:00100000:2.0:1746144664.820794:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746796032:12345-192.168.204.23@tcp:4:cat.0 Request processed in 3591us (3820us total) trans 21474840571 rc 0/0 00000100:00100000:2.0:1746144664.820808:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 927 00002000:00100000:2.0:1746144664.820820:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2949120->3051519) req@ffff88009f16bb80 x1830964746796032/t21474840571(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.820829:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16bb80 with x1830964746796032 ext(2949120->3051519) 00010000:00010000:2.0:1746144664.820840:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.820854:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746144664.820861:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16bb80 00000100:00100000:0.0:1746144664.822717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.822822:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746796160 00000100:00100000:2.0:1746144664.822831:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746796160 00010000:00010000:2.0:1746144664.822864:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144664.822902:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6062 00000100:00100000:2.0:1746144664.822910:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746796160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.822925:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.822947:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.822958:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.822981:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800921c6e00/0xa7c849b16e01b092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2949120->3051519) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f561 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.823021:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.823024:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.823031:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 22 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.823044:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 22 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.823080:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 22 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.823092:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747543424:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.823197:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.824688:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747543424:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.824708:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.824746:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746796160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1837us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.824755:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6062 00000100:00100000:0.0:1746144664.825594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.825678:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746796416 00000100:00100000:2.0:1746144664.825683:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746796416 00002000:00100000:2.0:1746144664.825716:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2211840->2215935) req@ffff88009f16a680 x1830964746796416/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.825725:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a680 with x1830964746796416 ext(2211840->2215935) 00002000:00010000:2.0:1746144664.825729:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16a680 00000100:00100000:2.0:1746144664.825771:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4659 00000100:00100000:2.0:1746144664.825776:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746796416:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144664.825944:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746796416:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 166us (350us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144664.825952:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4659 00002000:00100000:2.0:1746144664.825957:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2211840->2215935) req@ffff88009f16a680 x1830964746796416/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.825964:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a680 with x1830964746796416 ext(2211840->2215935) 00002000:00010000:2.0:1746144664.825967:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16a680 00000100:00100000:0.0:1746144664.838105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.838182:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746796544 00000100:00100000:3.0:1746144664.838192:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746796544 00000100:00100000:0.0:1746144664.838206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.838243:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746796800 00000100:00100000:3.0:1746144664.838246:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746796800 00000100:00100000:3.0:1746144664.838270:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10170 00000100:00100000:3.0:1746144664.838278:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29300:x1830964746796800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.838304:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144664.838308:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12153 00000100:00100000:1.0:1746144664.838316:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+34:29291:x1830964746796544:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.838323:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b0e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5bc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.838323:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.838334:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5b5 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.838359:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 48 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.838366:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.838377:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.838381:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.838383:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144664.838385:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3239935] (req 3145728->3239935) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 35 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.838414:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.838425:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144664.838430:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144664.838437:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747543552:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.838439:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.838451:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.838461:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.838466:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.838470:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144664.838528:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.838537:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 10 pid: 8389 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144664.838544:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747543680:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144664.838571:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 48 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.838582:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144664.838582:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 48 pid: 4760 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144664.838590:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144664.838590:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747543808:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.838596:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.838603:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000100:00100000:1.0:1746144664.838605:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8480 going to sleep for 11 seconds 00010000:00010000:3.0:1746144664.839103:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839111:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839117:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839122:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.839126:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839131:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839165:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.839168:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144664.839172:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839177:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b102 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839193:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839198:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839203:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839207:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.839209:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839213:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839219:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.839220:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.839222:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839227:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b0f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839232:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839236:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839240:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839244:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a7a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.839245:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839249:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839252:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea000) 00010000:00010000:3.0:1746144664.839254:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.839255:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839259:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b0fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.839291:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b0e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5bc expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.839298:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b0e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5bc expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.839304:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7000, rc 0) 00000100:00100000:3.0:1746144664.839342:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29300:x1830964746796800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1064us (1135us total) trans 8589944057 rc 301/301 00000100:00100000:3.0:1746144664.839349:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10170 00000100:00100000:0.0:1746144664.841929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.842117:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747543552:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.842128:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747543680:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144664.842184:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747543808:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.842275:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746796928 00000100:00100000:2.0:1746144664.842282:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746796928 00010000:00010000:1.0:1746144664.842286:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3239935] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 35 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.842304:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305ff800, rc 0) 00010000:00010000:2.0:1746144664.842314:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 11 pid: 8389 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746144664.842341:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6063 00000100:00100000:1.0:1746144664.842347:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:29291:x1830964746796544:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4031us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.842348:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746796928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144664.842354:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12153 00010000:00010000:2.0:1746144664.842362:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.842385:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 11 pid: 8389 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144664.842395:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 11 pid: 8389 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144664.842420:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c19c000/0xa7c849b16e01b061 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f53e expref: 11 pid: 8389 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144664.842435:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.842456:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746796928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.842465:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6063 00000100:00100000:0.0:1746144664.842959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.842996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.843044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.843064:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746797056 00000100:00100000:0.0:1746144664.843068:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746797056 00010000:00010000:0.0:1746144664.843090:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 49 pid: 4760 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144664.843106:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746797440 00000100:00100000:0.0:1746144664.843108:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746797440 00010000:00010000:0.0:1746144664.843117:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144664.843128:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6064 00000100:00100000:0.0:1746144664.843156:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1962:x1830964746797056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.843164:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.843176:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 49 pid: 4760 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144664.843184:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 49 pid: 4760 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144664.843197:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942f0e00/0xa7c849b16e01afb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4d5 expref: 49 pid: 4760 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144664.843221:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144664.843242:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1962:x1830964746797056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144664.843248:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6064 00000100:00100000:0.0:1746144664.843260:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6065 00000100:00100000:0.0:1746144664.843266:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1371850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746797440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144664.843273:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144664.843280:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144664.843444:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746797312 00000100:00100000:1.0:1746144664.843448:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746797312 00000100:00100000:1.0:1746144664.843478:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4126 00000100:00100000:1.0:1746144664.843483:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29300:x1830964746797312:12345-192.168.204.23@tcp:35:cat.0 00010000:00010000:0.0:1746144664.843493:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144664.843529:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942f1000/0xa7c849b16e01afc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f4dc expref: 35 pid: 4758 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144664.843545:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.843548:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144664.843554:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.843562:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.843600:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.843612:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747543936:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144664.843861:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144664.844020:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29300:x1830964746797312:12345-192.168.204.23@tcp:35:cat.0 Request processed in 536us (1022us total) trans 8589944058 rc 0/0 00000100:00100000:1.0:1746144664.844026:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4126 00000100:00100000:0.0:1746144664.847407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.847431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.847523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.847686:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746797824 00000100:00100000:1.0:1746144664.847695:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746797824 00002000:00100000:1.0:1746144664.847745:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3235840->3239935) req@ffff88009f16b480 x1830964746797824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.847755:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16b480 with x1830964746797824 ext(3235840->3239935) 00002000:00010000:1.0:1746144664.847760:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16b480 00000100:00100000:1.0:1746144664.847782:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4660 00000100:00100000:1.0:1746144664.847789:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746797824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144664.847981:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746797824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 192us (457us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144664.847988:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4660 00002000:00100000:1.0:1746144664.847994:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3235840->3239935) req@ffff88009f16b480 x1830964746797824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/4536 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.848001:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16b480 with x1830964746797824 ext(3235840->3239935) 00002000:00010000:1.0:1746144664.848004:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16b480 00000100:00100000:3.0:1746144664.848099:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746798080 00000100:00100000:3.0:1746144664.848103:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746798080 00000100:00100000:3.0:1746144664.848124:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746797568 00000100:00100000:3.0:1746144664.848126:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746797568 00000100:00100000:3.0:1746144664.848157:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10171 00000100:00100000:3.0:1746144664.848162:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29301:x1830964746798080:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144664.848178:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.848196:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01b110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5ca expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.848297:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848311:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144664.848358:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10172 00000100:00100000:0.0:1746144664.848470:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29300:x1830964746797568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144664.848478:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144664.848481:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747543936:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144664.848488:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5000/0xa7c849b16e01b11e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5c3 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.848500:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.848526:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1371850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+34:1960:x1830964746797440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5260us (5481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.848535:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6065 00010000:00010000:0.0:1746144664.848545:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.848554:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.848563:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144664.848589:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848609:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848615:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848709:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848803:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848810:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848816:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.848823:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.848898:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848906:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848911:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848917:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.848921:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.848927:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144664.848955:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:0.0:1746144664.848962:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144664.848975:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144664.849468:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5000/0xa7c849b16e01b11e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 306 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.849484:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 305 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144664.849491:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144664.849493:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144664.849496:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b5600, rc 0) 00000100:00100000:1.0:1746144664.849705:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29300:x1830964746797568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1338us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144664.849711:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10172 00010000:00010000:3.0:1746144664.849850:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.849853:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144664.849856:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849861:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b133 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849873:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849877:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849882:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849885:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.849887:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849891:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849896:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.849897:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.849899:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849902:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6800/0xa7c849b16e01b117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849907:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849913:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849917:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849920:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a7a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.849921:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849925:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849929:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea200) 00010000:00010000:3.0:1746144664.849930:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.849932:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849935:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7a00/0xa7c849b16e01b12c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.849964:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01b110 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ca expref: 304 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.849970:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01b110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ca expref: 304 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.849976:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7400, rc 0) 00000100:00100000:3.0:1746144664.850000:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29301:x1830964746798080:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1837us (2602us total) trans 8589944059 rc 301/301 00000100:00100000:3.0:1746144664.850019:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10171 00000100:00100000:0.0:1746144664.851353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.851448:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746798336 00000100:00100000:1.0:1746144664.851456:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746798336 00000100:00100000:1.0:1746144664.851504:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4127 00000100:00100000:1.0:1746144664.851511:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29291:x1830964746798336:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144664.851688:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29291:x1830964746798336:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 177us (339us total) trans 8589944060 rc 0/0 00000100:00100000:1.0:1746144664.851697:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4127 00000100:00100000:0.0:1746144664.852296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.852704:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746798464 00000100:00100000:1.0:1746144664.852708:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746798464 00000100:00100000:1.0:1746144664.852965:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12154 00000100:00100000:1.0:1746144664.852972:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746798464:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.852986:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.853005:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305ff400/0xa7c849b16e01b141 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5d1 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.853068:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747544064:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144664.854344:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.854631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.854729:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746798592 00000100:00100000:2.0:1746144664.854735:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746798592 00000100:00100000:2.0:1746144664.854768:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12155 00000100:00100000:2.0:1746144664.854773:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746798592:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.854786:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.854800:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135782200/0xa7c849b16e01b148 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5d8 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.854833:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747544192:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144664.854879:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144664.859361:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747544192:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144664.859406:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135782200/0xa7c849b16e01b148 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5d8 expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.859422:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135782200/0xa7c849b16e01b148 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5d8 expref: 24 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144664.859469:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782200, rc 0) 00000100:00100000:2.0:1746144664.859552:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746798592:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4773us (4918us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144664.859562:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12155 00000100:00100000:1.0:1746144664.860406:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747544064:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144664.860430:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305ff400/0xa7c849b16e01b141 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5d1 expref: 49 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.860440:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305ff400/0xa7c849b16e01b141 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5d1 expref: 49 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.860449:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305ff400, rc 0) 00000100:00100000:1.0:1746144664.860488:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746798464:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7516us (8191us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144664.860494:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12154 00000100:00100000:0.0:1746144664.863474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.863821:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746798848 00000100:00100000:3.0:1746144664.863830:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746798848 00000100:00100000:3.0:1746144664.863909:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10173 00000100:00100000:3.0:1746144664.863917:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29305:x1830964746798848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.863945:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.863965:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b14f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5df expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.864444:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864458:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864469:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864480:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864486:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864491:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864601:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864609:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864616:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144664.864624:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144664.864702:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864709:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864715:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864721:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.864725:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864731:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864741:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144664.864744:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144664.864748:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864753:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b164 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864766:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864771:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864779:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864782:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.864784:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864789:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864794:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144664.864796:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.864799:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864803:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864809:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864814:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864818:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864822:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a7800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144664.864824:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864828:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864836:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaf00) 00010000:00010000:3.0:1746144664.864838:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144664.864840:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864844:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b15d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144664.864878:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b14f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5df expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.864885:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b14f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5df expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.864892:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6c00, rc 0) 00000100:00100000:3.0:1746144664.864947:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:29305:x1830964746798848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1031us (1487us total) trans 8589944061 rc 301/301 00000100:00100000:3.0:1746144664.864954:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10173 00000100:00100000:0.0:1746144664.871805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.871850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.872814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.872886:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746799104 00000100:00100000:2.0:1746144664.872897:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746799104 00000100:00100000:0.0:1746144664.873179:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746799360 00000100:00100000:0.0:1746144664.873182:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746799360 00002000:00100000:0.0:1746144664.873210:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f16a300 x1830964746799360/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.873220:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a300 with x1830964746799360 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.873225:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16a300 00000100:00100000:0.0:1746144664.873259:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746799744 00000100:00100000:0.0:1746144664.873262:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746799744 00002000:00100000:0.0:1746144664.873274:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f168a80 x1830964746799744/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.873281:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168a80 with x1830964746799744 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.873284:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168a80 00000100:00100000:0.0:1746144664.873297:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4661 00000100:00100000:1.0:1746144664.873395:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4662 00000100:00100000:3.0:1746144664.873510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.873536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.873547:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746799872 00000100:00100000:3.0:1746144664.873550:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746799872 00002000:00100000:3.0:1746144664.873566:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee09500 x1830964746799872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.873574:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09500 with x1830964746799872 ext(1048576->2097151) 00002000:00010000:3.0:1746144664.873577:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09500 00000100:00100000:3.0:1746144664.873587:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4663 00000100:00100000:3.0:1746144664.873592:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1962:x1830964746799872:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144664.874517:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f16aa00 x1830964746799104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.874524:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16aa00 with x1830964746799104 ext(0->1048575) 00002000:00010000:2.0:1746144664.874527:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16aa00 00000100:00100000:2.0:1746144664.874553:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4664 00000100:00100000:2.0:1746144664.874559:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+50:1962:x1830964746799104:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.876368:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746799360:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.876427:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746799744:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.877646:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746800000 00000100:00100000:2.0:1746144664.877655:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746800000 00000100:00100000:2.0:1746144664.877709:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10174 00000100:00100000:2.0:1746144664.877715:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:29305:x1830964746800000:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.877734:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.877754:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b172 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5e6 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.877832:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.877844:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.877854:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144664.877877:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00000004:00200000:2.0:1746144664.877881:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144664.877894:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144664.877915:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b172 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.877937:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.877943:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144664.877946:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144664.877949:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783c00, rc 0) 00000100:00100000:2.0:1746144664.877977:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:29305:x1830964746800000:12345-192.168.204.23@tcp:101:cat.0 Request processed in 263us (4468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.877983:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10174 00000100:00100000:3.0:1746144664.888077:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+50:1962:x1830964746799872:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14469us (14525us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.888091:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4663 00002000:00100000:3.0:1746144664.888104:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ee09500 x1830964746799872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.888114:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee09500 with x1830964746799872 ext(1048576->2097151) 00002000:00010000:3.0:1746144664.888121:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee09500 00000100:00100000:2.0:1746144664.895506:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1962:x1830964746799104:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20932us (23697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.895518:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4664 00002000:00100000:2.0:1746144664.895532:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f16aa00 x1830964746799104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.895542:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16aa00 with x1830964746799104 ext(0->1048575) 00002000:00010000:2.0:1746144664.895548:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16aa00 00000100:00100000:3.0:1746144664.897726:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746799360:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24412us (25869us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.897737:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4661 00002000:00100000:3.0:1746144664.897747:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f16a300 x1830964746799360/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.897756:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16a300 with x1830964746799360 ext(1048576->2097151) 00002000:00010000:3.0:1746144664.897761:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16a300 00000100:00100000:1.0:1746144664.901071:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746799744:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27652us (28241us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144664.901084:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4662 00002000:00100000:1.0:1746144664.901099:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f168a80 x1830964746799744/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.901108:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168a80 with x1830964746799744 ext(1048576->2097151) 00002000:00010000:1.0:1746144664.901115:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168a80 00000100:00100000:0.0:1746144664.905922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.906025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.906048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.906086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.906106:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746800256 00000100:00100000:2.0:1746144664.906116:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746800256 00000100:00100000:0.0:1746144664.906124:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746800512 00000100:00100000:0.0:1746144664.906127:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746800512 00002000:00100000:2.0:1746144664.906187:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fd91180 x1830964746800256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.906198:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91180 with x1830964746800256 ext(0->1048575) 00000100:00100000:1.0:1746144664.906200:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746800768 00002000:00010000:2.0:1746144664.906204:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd91180 00000100:00100000:1.0:1746144664.906204:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746800768 00000100:00100000:2.0:1746144664.906225:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801024 00000100:00100000:2.0:1746144664.906227:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801024 00002000:00100000:0.0:1746144664.906304:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fd90e00 x1830964746800512/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.906322:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fd90a80 x1830964746800768/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.906329:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90a80 with x1830964746800768 ext(1048576->2097151) 00002000:00010000:1.0:1746144664.906333:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd90a80 00000100:00100000:1.0:1746144664.906354:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4665 00000100:00100000:1.0:1746144664.906361:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746800256:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:2.0:1746144664.907098:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fd90380 x1830964746801024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.907106:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90380 with x1830964746801024 ext(1048576->2097151) 00002000:00010000:2.0:1746144664.907109:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd90380 00000100:00100000:2.0:1746144664.907147:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4666 00000100:00100000:2.0:1746144664.907155:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746800768:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.907697:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4667 00000100:00100000:1.0:1746144664.907704:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+36:1961:x1830964746801024:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:0.0:1746144664.910862:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90e00 with x1830964746800512 ext(1048576->2097151) 00002000:00010000:0.0:1746144664.910872:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd90e00 00000100:00100000:3.0:1746144664.911041:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4668 00000100:00100000:3.0:1746144664.911055:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746800512:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.916751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.916800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.916830:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801152 00000100:00100000:1.0:1746144664.916841:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801152 00000100:00100000:1.0:1746144664.916881:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801280 00000100:00100000:1.0:1746144664.916883:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801280 00000100:00100000:1.0:1746144664.916916:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12156 00000100:00100000:1.0:1746144664.916923:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746801152:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144664.916941:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.916960:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305fec00/0xa7c849b16e01b180 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5ed expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144664.917022:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747544320:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144664.917108:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.917393:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12157 00000100:00100000:3.0:1746144664.917400:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746801280:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.917409:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.917421:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130326000/0xa7c849b16e01b187 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5f4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144664.917441:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+36:1961:x1830964746800256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11080us (11529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.917446:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747544448:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144664.917449:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4665 00002000:00100000:0.0:1746144664.917458:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fd91180 x1830964746800256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.917467:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91180 with x1830964746800256 ext(0->1048575) 00002000:00010000:0.0:1746144664.917471:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd91180 00000100:00100000:3.0:1746144664.917479:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144664.931890:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747544320:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144664.931931:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305fec00/0xa7c849b16e01b180 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ed expref: 49 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144664.931947:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305fec00/0xa7c849b16e01b180 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ed expref: 49 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144664.932039:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747544448:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144664.932064:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130326000/0xa7c849b16e01b187 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5f4 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.932074:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130326000/0xa7c849b16e01b187 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5f4 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144664.932099:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130326000, rc 0) 00010000:00010000:1.0:1746144664.932099:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305fec00, rc 0) 00000100:00100000:3.0:1746144664.932181:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746801280:12345-192.168.204.23@tcp:101:cat.0 Request processed in 14779us (15378us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144664.932190:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12157 00000100:00100000:1.0:1746144664.932198:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1963:x1830964746801152:12345-192.168.204.23@tcp:101:cat.0 Request processed in 15271us (15453us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144664.932206:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12156 00000100:00100000:2.0:1746144664.932874:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746800768:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25718us (26822us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.932883:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4666 00002000:00100000:2.0:1746144664.932892:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fd90a80 x1830964746800768/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.932901:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90a80 with x1830964746800768 ext(1048576->2097151) 00002000:00010000:2.0:1746144664.932906:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd90a80 00000100:00100000:0.0:1746144664.936191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.936566:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746801024:12345-192.168.204.23@tcp:3:cat.0 Request processed in 28860us (30477us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144664.936578:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4667 00002000:00100000:1.0:1746144664.936590:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fd90380 x1830964746801024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.936599:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90380 with x1830964746801024 ext(1048576->2097151) 00002000:00010000:1.0:1746144664.936604:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd90380 00000100:00100000:2.0:1746144664.936685:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801408 00000100:00100000:2.0:1746144664.936693:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801408 00000100:00100000:2.0:1746144664.936738:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12158 00000100:00100000:2.0:1746144664.936744:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:29300:x1830964746801408:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.936760:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.936777:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f5fb expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.936805:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.936814:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.936816:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.936819:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 49 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.936848:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 33 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.936860:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 33 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144664.936872:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747544576:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.936926:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144664.940326:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746800512:12345-192.168.204.23@tcp:3:cat.0 Request processed in 29264us (34288us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144664.940337:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4668 00002000:00100000:3.0:1746144664.940348:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fd90e00 x1830964746800512/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.940358:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90e00 with x1830964746800512 ext(1048576->2097151) 00002000:00010000:3.0:1746144664.940363:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd90e00 00000100:00100000:0.0:1746144664.943755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.943944:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747544576:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144664.943975:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 49 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.943996:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7e00, rc 0) 00000100:00100000:2.0:1746144664.944060:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:29300:x1830964746801408:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7314us (7876us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.944070:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12158 00000100:00100000:3.0:1746144664.944389:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801536 00000100:00100000:3.0:1746144664.944396:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801536 00002000:00100000:3.0:1746144664.944433:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3239935) req@ffff88009fd91880 x1830964746801536/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.944441:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91880 with x1830964746801536 ext(3145728->3239935) 00010000:00010000:3.0:1746144664.944448:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 34 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144664.944461:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 34 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144664.944467:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd91880 00000100:00100000:3.0:1746144664.944496:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 928 00000100:00100000:3.0:1746144664.944503:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+34:1962:x1830964746801536:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144664.947164:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+36:1962:x1830964746801536:12345-192.168.204.23@tcp:4:cat.0 Request processed in 2621us (3378us total) trans 17179873345 rc 0/0 00000100:00100000:3.0:1746144664.947176:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 928 00002000:00100000:3.0:1746144664.947188:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3239935) req@ffff88009fd91880 x1830964746801536/t17179873345(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.947197:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91880 with x1830964746801536 ext(3145728->3239935) 00010000:00010000:3.0:1746144664.947207:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144664.947223:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144664.947229:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd91880 00000100:00100000:0.0:1746144664.949908:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.950016:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801664 00000100:00100000:2.0:1746144664.950025:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801664 00010000:00010000:2.0:1746144664.950062:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144664.950103:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6066 00000100:00100000:2.0:1746144664.950111:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+36:1963:x1830964746801664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144664.950125:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144664.950178:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.950191:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.950214:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305ff800/0xa7c849b16e01b0ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5b5 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.950238:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.950240:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.950248:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.950255:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.950408:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144664.950422:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747544704:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144664.950515:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.953338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.954035:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746801792 00000100:00100000:2.0:1746144664.954048:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746801792 00000100:00100000:2.0:1746144664.954111:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12159 00000100:00100000:2.0:1746144664.954119:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+36:29305:x1830964746801792:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.954169:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.954188:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f602 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.954285:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.954288:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144664.954296:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.954311:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.954322:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6a00, rc 0) 00000100:00100000:2.0:1746144664.954365:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+37:29305:x1830964746801792:12345-192.168.204.23@tcp:101:cat.0 Request processed in 247us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.954371:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12159 00000100:00100000:2.0:1746144664.955982:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747544704:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144664.956049:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144664.956170:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+36:1963:x1830964746801664:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6058us (6271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144664.956179:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6066 00000100:00100000:0.0:1746144664.961384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144664.961473:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746802048 00000100:00100000:3.0:1746144664.961482:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746802048 00002000:00100000:3.0:1746144664.961530:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fd92300 x1830964746802048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144664.961540:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd92300 with x1830964746802048 ext(2097152->3145727) 00002000:00010000:3.0:1746144664.961547:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd92300 00000100:00100000:3.0:1746144664.961726:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4669 00000100:00100000:3.0:1746144664.961736:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1960:x1830964746802048:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.971341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.971375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.971407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144664.971434:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746802432 00000100:00100000:0.0:1746144664.971443:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746802432 00002000:00100000:0.0:1746144664.971501:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fd93480 x1830964746802432/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.971512:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd93480 with x1830964746802432 ext(2097152->3145727) 00002000:00010000:0.0:1746144664.971519:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd93480 00000100:00100000:0.0:1746144664.971536:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746802560 00000100:00100000:0.0:1746144664.971538:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746802560 00002000:00100000:0.0:1746144664.971550:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd93b80 x1830964746802560/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.971556:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd93b80 with x1830964746802560 ext(3145728->4194303) 00002000:00010000:0.0:1746144664.971559:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd93b80 00000100:00100000:0.0:1746144664.971582:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746802944 00000100:00100000:0.0:1746144664.971584:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746802944 00002000:00100000:0.0:1746144664.971597:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (4079616->4194303) req@ffff88009fd92680 x1830964746802944/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.971604:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd92680 with x1830964746802944 ext(4079616->4194303) 00002000:00010000:0.0:1746144664.971607:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd92680 00000100:00100000:0.0:1746144664.971620:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4670 00000100:00100000:0.0:1746144664.971627:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+37:1961:x1830964746802432:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144664.973054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.973125:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746802816 00000100:00100000:1.0:1746144664.973160:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746802816 00002000:00100000:1.0:1746144664.973198:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->4079615) req@ffff88009fd90700 x1830964746802816/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 504/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.973208:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90700 with x1830964746802816 ext(2097152->4079615) 00002000:00010000:1.0:1746144664.973213:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd90700 00000100:00100000:1.0:1746144664.973245:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4671 00000100:00100000:1.0:1746144664.973252:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+38:1961:x1830964746802560:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.974075:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4672 00000100:00100000:2.0:1746144664.974086:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746802944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144664.974349:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4673 00000100:00100000:1.0:1746144664.974357:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746802816:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144664.976649:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1960:x1830964746802048:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14904us (15511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.976660:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4669 00002000:00100000:2.0:1746144664.976670:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fd92300 x1830964746802048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.976680:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd92300 with x1830964746802048 ext(2097152->3145727) 00002000:00010000:2.0:1746144664.976686:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd92300 00000100:00100000:2.0:1746144664.981717:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+38:1961:x1830964746802432:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10076us (10373us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.981730:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4670 00002000:00100000:2.0:1746144664.981744:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fd93480 x1830964746802432/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.981753:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd93480 with x1830964746802432 ext(2097152->3145727) 00002000:00010000:2.0:1746144664.981759:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd93480 00000100:00100000:0.0:1746144664.984313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144664.984397:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746803200 00000100:00100000:2.0:1746144664.984407:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746803200 00000100:00100000:2.0:1746144664.985221:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12160 00000100:00100000:2.0:1746144664.985232:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29300:x1830964746803200:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144664.985254:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144664.985273:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f609 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.985303:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.985315:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.985317:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144664.985320:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.985349:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144664.985361:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144664.985372:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747544832:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144664.985451:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144664.987822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.988648:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746803456 00000100:00100000:1.0:1746144664.988657:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746803456 00000100:00100000:1.0:1746144664.989924:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10175 00000100:00100000:1.0:1746144664.989936:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:29307:x1830964746803456:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144664.989958:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144664.989979:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01b1a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f610 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.990101:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.990115:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.990125:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.990267:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.990274:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.990281:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991209:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991219:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991226:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:1.0:1746144664.991236:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144664.991323:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991329:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991335:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991341:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942f1000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144664.991344:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991351:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991362:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144664.991364:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144664.991368:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.991377:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1000/0xa7c849b16e01b1b8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144664.992115:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+36:1961:x1830964746802560:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18857us (20732us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144664.992126:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4671 00002000:00100000:2.0:1746144664.992150:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fd93b80 x1830964746802560/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.992161:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd93b80 with x1830964746802560 ext(3145728->4194303) 00002000:00010000:2.0:1746144664.992166:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd93b80 00010000:00010000:1.0:1746144664.992340:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992346:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992351:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992356:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135782200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144664.992358:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992366:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992375:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144664.992377:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144664.992380:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992384:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01b1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992399:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992403:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992408:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992413:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942f0e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144664.992415:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992419:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992424:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f1d9200) 00010000:00010000:1.0:1746144664.992426:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144664.992428:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992432:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f0e00/0xa7c849b16e01b1b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144664.992474:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01b1a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f610 expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.992481:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01b1a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f610 expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144664.992488:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428b000, rc 0) 00000100:00100000:1.0:1746144664.992516:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:29307:x1830964746803456:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2583us (4702us total) trans 8589944062 rc 301/301 00000100:00100000:1.0:1746144664.992522:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10175 00000100:00100000:3.0:1746144664.995992:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747544832:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144664.996039:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.996058:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7800, rc 0) 00000100:00100000:3.0:1746144664.996330:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29300:x1830964746803200:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11098us (12025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.996339:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12160 00000100:00100000:1.0:1746144664.996789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.996829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144664.996866:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746803584 00000100:00100000:1.0:1746144664.996873:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746803584 00002000:00100000:1.0:1746144664.996916:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2211840->3145727) req@ffff88012e12e680 x1830964746803584/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1746144675 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144664.996926:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12e680 with x1830964746803584 ext(2211840->3145727) 00010000:00010000:1.0:1746144664.996934:0:21597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 27 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144664.996947:0:21597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 27 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144664.996954:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e12e680 00000100:00100000:1.0:1746144664.996973:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 929 00000100:00100000:1.0:1746144664.996980:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746803584:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144664.997047:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746802944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22963us (25637us total) trans 0 rc 114688/114688 00000100:00100000:2.0:1746144664.997055:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4672 00002000:00100000:2.0:1746144664.997061:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (4079616->4194303) req@ffff88009fd92680 x1830964746802944/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 114688/114688 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144664.997069:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd92680 with x1830964746802944 ext(4079616->4194303) 00010000:00010000:2.0:1746144664.997074:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144664.997084:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746144664.997090:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd92680 00000100:00100000:0.0:1746144664.997590:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746802816:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23233us (24541us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144664.997598:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4673 00002000:00100000:0.0:1746144664.997604:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->4079615) req@ffff88009fd90700 x1830964746802816/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 504/440 e 0 to 0 dl 1746144675 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144664.997611:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd90700 with x1830964746802816 ext(2097152->4079615) 00010000:00010000:0.0:1746144664.997615:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144664.997625:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:0.0:1746144664.997631:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd90700 00000100:00100000:3.0:1746144664.997845:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746803712 00000100:00100000:3.0:1746144664.997849:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746803712 00000100:00100000:3.0:1746144664.997876:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12161 00000100:00100000:3.0:1746144664.997882:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:29305:x1830964746803712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144664.997891:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144664.997906:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f617 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.997926:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144664.997931:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.997941:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144664.997954:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130327c00, rc 0) 00000100:00100000:3.0:1746144664.997973:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:29305:x1830964746803712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 91us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144664.997979:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12161 00000100:00100000:1.0:1746144665.015422:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746803584:12345-192.168.204.23@tcp:4:cat.0 Request processed in 18428us (18619us total) trans 21474840572 rc 0/0 00000100:00100000:1.0:1746144665.015435:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 929 00002000:00100000:1.0:1746144665.015449:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2211840->3145727) req@ffff88012e12e680 x1830964746803584/t21474840572(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1746144675 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.015459:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12e680 with x1830964746803584 ext(2211840->3145727) 00010000:00010000:1.0:1746144665.015470:0:21597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.015488:0:21597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144665.015496:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e12e680 00000100:00100000:0.0:1746144665.022058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.023183:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746803840 00000100:00100000:2.0:1746144665.023195:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746803840 00010000:00010000:2.0:1746144665.023238:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.023269:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6067 00000100:00100000:2.0:1746144665.023277:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746803840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.023292:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144665.023317:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.023330:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.023350:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b0df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2211840->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5ae expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.023379:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.023382:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.023390:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.023398:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.023406:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.023407:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.023410:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.023416:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.023447:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.023459:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747544960:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.023543:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.023551:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747545088:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.023567:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.024037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.024226:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746803968 00000100:00100000:3.0:1746144665.024230:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746803968 00000100:00100000:3.0:1746144665.024261:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12162 00000100:00100000:3.0:1746144665.024266:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:29301:x1830964746803968:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.024281:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.024297:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f61e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.024317:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.024326:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 35 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.024333:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 50 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.024337:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.024339:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.024341:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [258048->1048575] (req 258048->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 50 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.024364:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 50 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.024374:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 50 pid: 4758 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.024383:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545216:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.024426:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 35 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.024434:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 35 pid: 29370 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.024442:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545344:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.024463:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.024470:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 9 pid: 10724 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.024477:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545472:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.024490:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.027175:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747544960:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.027191:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747545088:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.027211:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.027253:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746803840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3976us (5207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.027263:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6067 00000100:00100000:0.0:1746144665.032231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.032264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.032323:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746804352 00000100:00100000:0.0:1746144665.032329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.032333:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746804352 00002000:00100000:2.0:1746144665.032383:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f434380 x1830964746804352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746144665.032386:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746804608 00000100:00100000:0.0:1746144665.032389:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746804608 00002000:00100000:2.0:1746144665.032399:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434380 with x1830964746804352 ext(3145728->4194303) 00002000:00010000:2.0:1746144665.032406:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434380 00010000:00010000:0.0:1746144665.032422:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 51 pid: 4758 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746144665.032432:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746804224 00000100:00100000:2.0:1746144665.032434:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746804224 00000100:00100000:0.0:1746144665.032442:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6068 00002000:00100000:2.0:1746144665.032444:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f434e00 x1830964746804224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746144665.032449:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+51:1963:x1830964746804608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746144665.032451:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434e00 with x1830964746804224 ext(2097152->3145727) 00002000:00010000:2.0:1746144665.032453:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434e00 00000100:00100000:2.0:1746144665.032463:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4674 00010000:00010000:0.0:1746144665.032463:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144665.032466:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746804352:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:0.0:1746144665.032485:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 51 pid: 4758 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746144665.032497:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 51 pid: 4758 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746144665.032520:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.032558:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+51:1963:x1830964746804608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.032566:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6068 00000100:00100000:0.0:1746144665.032671:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4675 00000100:00100000:0.0:1746144665.032677:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746804224:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:3.0:1746144665.034860:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437cc00/0xa7c849b16e01b099 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f568 expref: 50 pid: 4758 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.034895:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545216:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.034909:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545344:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.034917:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545472:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.034950:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [258048->1048575] (req 258048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 49 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.034963:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782200, rc 0) 00000100:00100000:3.0:1746144665.034993:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:29301:x1830964746803968:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10725us (10955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.035000:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12162 00000100:00100000:2.0:1746144665.037975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.038015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.038030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.038054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.038077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.038103:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746805120 00000100:00100000:2.0:1746144665.038112:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746805120 00002000:00100000:2.0:1746144665.038170:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d1c00 x1830964746805120/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.038179:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1c00 with x1830964746805120 ext(2097152->3145727) 00002000:00010000:2.0:1746144665.038184:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d1c00 00000100:00100000:2.0:1746144665.038213:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746805248 00000100:00100000:2.0:1746144665.038216:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746805248 00002000:00100000:2.0:1746144665.038227:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008c7d2680 x1830964746805248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.038239:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2680 with x1830964746805248 ext(3145728->4194303) 00002000:00010000:2.0:1746144665.038241:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d2680 00000100:00100000:2.0:1746144665.038249:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746805504 00000100:00100000:2.0:1746144665.038250:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746805504 00002000:00100000:2.0:1746144665.038259:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d1180 x1830964746805504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.038265:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1180 with x1830964746805504 ext(3145728->4194303) 00002000:00010000:2.0:1746144665.038268:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d1180 00000100:00100000:2.0:1746144665.038278:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4676 00000100:00100000:2.0:1746144665.038285:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746805120:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144665.038324:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746804736 00000100:00100000:0.0:1746144665.038328:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746804736 00010000:00010000:0.0:1746144665.038355:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00000100:00100000:2.0:1746144665.038390:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746805632 00000100:00100000:2.0:1746144665.038393:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746805632 00010000:00010000:2.0:1746144665.038406:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 36 pid: 29370 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.038415:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4677 00000100:00100000:2.0:1746144665.038421:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6069 00000100:00100000:3.0:1746144665.038422:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746805248:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144665.038425:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746804736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.038434:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144665.038453:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144665.038464:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144665.038488:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7b8600/0xa7c849b16e01b053 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f522 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144665.038505:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.038540:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746804736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 114us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.038545:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6069 00000100:00100000:2.0:1746144665.038559:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6070 00000100:00100000:2.0:1746144665.038563:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+36:1962:x1830964746805632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.038569:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144665.038575:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 36 pid: 29370 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144665.038582:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 36 pid: 29370 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144665.038591:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b4c00/0xa7c849b16e01b0c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f584 expref: 36 pid: 29370 timeout: 744 lvb_type: 1 00010000:00010000:2.0:1746144665.038599:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.038601:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.038607:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 49 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.038614:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 49 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.038760:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 49 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.038772:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747545600:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.038815:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.039624:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4678 00000100:00100000:3.0:1746144665.039632:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1960:x1830964746805504:12345-192.168.204.23@tcp:3:multiop.0 00000100:00080000:0.0:1746144665.040858:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144665.044891:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746804224:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12199us (12610us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144665.044903:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4675 00002000:00100000:0.0:1746144665.044916:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009f434e00 x1830964746804224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.044930:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434e00 with x1830964746804224 ext(2097152->3145727) 00002000:00010000:0.0:1746144665.044936:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434e00 00000100:00100000:0.0:1746144665.054067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.054402:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747545600:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.054426:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.054468:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746805632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 15904us (16389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.054479:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6070 00000100:00100000:2.0:1746144665.054566:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746804352:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22098us (22350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.054575:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4674 00000100:00100000:1.0:1746144665.054579:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746805888 00002000:00100000:2.0:1746144665.054585:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f434380 x1830964746804352/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144665.054585:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746805888 00002000:00100000:2.0:1746144665.054593:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434380 with x1830964746804352 ext(3145728->4194303) 00002000:00010000:2.0:1746144665.054598:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434380 00002000:00100000:1.0:1746144665.054618:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (258048->262143) req@ffff88009f434a80 x1830964746805888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.054624:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434a80 with x1830964746805888 ext(258048->262143) 00002000:00010000:1.0:1746144665.054627:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f434a80 00000100:00100000:1.0:1746144665.054645:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4679 00000100:00100000:1.0:1746144665.054652:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+51:1960:x1830964746805888:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144665.055010:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+51:1960:x1830964746805888:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 350us (946us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144665.055017:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4679 00002000:00100000:1.0:1746144665.055022:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (258048->262143) req@ffff88009f434a80 x1830964746805888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.055028:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434a80 with x1830964746805888 ext(258048->262143) 00002000:00010000:1.0:1746144665.055031:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f434a80 00000100:00100000:3.0:1746144665.060647:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746805248:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 22210us (22600us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.060660:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4677 00002000:00100000:3.0:1746144665.060675:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88008c7d2680 x1830964746805248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.060684:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d2680 with x1830964746805248 ext(3145728->4194303) 00002000:00010000:3.0:1746144665.060690:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d2680 00000100:00100000:3.0:1746144665.065280:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1960:x1830964746805504:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 25636us (27211us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.065294:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4678 00002000:00100000:3.0:1746144665.065306:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88008c7d1180 x1830964746805504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.065314:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1180 with x1830964746805504 ext(3145728->4194303) 00002000:00010000:3.0:1746144665.065320:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d1180 00000100:00100000:0.0:1746144665.068737:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.068895:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806016 00000100:00100000:3.0:1746144665.068904:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806016 00000100:00100000:3.0:1746144665.068947:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12163 00000100:00100000:3.0:1746144665.068954:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746806016:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.068972:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.068991:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e01b1d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f625 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.069064:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545728:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144665.069170:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.069171:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746805120:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 30884us (31164us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.069179:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4676 00002000:00100000:2.0:1746144665.069189:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88008c7d1c00 x1830964746805120/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.069198:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1c00 with x1830964746805120 ext(2097152->3145727) 00002000:00010000:2.0:1746144665.069202:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c7d1c00 00002000:00010000:3.0:1746144665.075347:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144664 -> 1746144665 00002000:00010000:3.0:1746144665.075356:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144664 -> 1746144665 00002000:00010000:3.0:1746144665.075358:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144664 -> 1746144665 00000100:00100000:3.0:1746144665.075386:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747545728:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.075428:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e01b1d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f625 expref: 36 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.075443:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4efba00/0xa7c849b16e01b1d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f625 expref: 36 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.077233:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4efba00, rc 0) 00000100:00100000:3.0:1746144665.077362:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746806016:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8403us (8630us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.077373:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12163 00000100:00100000:0.0:1746144665.078753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.078825:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806144 00000100:00100000:3.0:1746144665.078834:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806144 00000100:00100000:3.0:1746144665.078873:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12164 00000100:00100000:3.0:1746144665.078881:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29301:x1830964746806144:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.078899:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.078923:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f62c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.078954:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.078965:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.078972:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.078979:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.078981:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.078984:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.079028:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.079039:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.079051:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747545856:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.080309:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.080323:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 24 pid: 8450 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.080333:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747545984:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.081293:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.081305:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 9 pid: 10724 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.081315:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747546112:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.081550:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.082268:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747545856:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.082789:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747545984:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144665.083275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.083481:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747546112:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.083512:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.083530:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4efb000, rc 0) 00000100:00100000:2.0:1746144665.083563:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29301:x1830964746806144:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4683us (4814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.083572:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12164 00000100:00100000:3.0:1746144665.083646:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806272 00000100:00100000:3.0:1746144665.083653:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806272 00010000:00010000:3.0:1746144665.083682:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00000100:00100000:3.0:1746144665.083705:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6071 00000100:00100000:3.0:1746144665.083711:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746806272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.083723:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.083745:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746144665.083754:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746144665.083774:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135782a00/0xa7c849b16e01b0a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f56f expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746144665.083791:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.083808:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746806272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 97us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.083813:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6071 00000100:00100000:0.0:1746144665.084097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.084165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.084319:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806528 00000100:00100000:1.0:1746144665.084323:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806528 00010000:00010000:1.0:1746144665.084346:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.084360:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806400 00000100:00100000:1.0:1746144665.084362:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806400 00010000:00010000:1.0:1746144665.084371:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.084383:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6072 00000100:00100000:1.0:1746144665.084389:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1371450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746806528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.084396:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.084407:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.084414:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.084426:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8c00/0xa7c849b16e01b068 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f529 expref: 10 pid: 10724 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.084437:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.084457:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1371450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746806528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.084462:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6072 00000100:00100000:1.0:1746144665.084493:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6073 00000100:00100000:1.0:1746144665.084498:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746806400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.084503:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.084510:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.084519:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.084529:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135782600/0xa7c849b16e01b0ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f58b expref: 25 pid: 8450 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.084543:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.084545:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.084551:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.084559:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.084587:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.084598:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747546240:192.168.204.23@tcp:105: 00000100:00080000:0.0:1746144665.085274:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144665.085309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.085388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.085423:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806656 00000100:00100000:3.0:1746144665.085427:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806656 00000100:00100000:3.0:1746144665.085450:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12165 00000100:00100000:3.0:1746144665.085456:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746806656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.085470:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.085482:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c198c00/0xa7c849b16e01b1e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f633 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.085509:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747546368:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144665.085536:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.085637:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.085799:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746806912 00000100:00100000:2.0:1746144665.085802:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746806912 00002000:00100000:2.0:1746144665.085829:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f435500 x1830964746806912/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.085838:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435500 with x1830964746806912 ext(4194304->4935679) 00002000:00010000:2.0:1746144665.085842:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435500 00000100:00100000:2.0:1746144665.085859:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4680 00000100:00100000:2.0:1746144665.085863:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746806912:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.091255:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746806912:12345-192.168.204.23@tcp:3:cat.0 Request processed in 5378us (5854us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144665.091266:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4680 00002000:00100000:2.0:1746144665.091279:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f435500 x1830964746806912/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.091289:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435500 with x1830964746806912 ext(4194304->4935679) 00002000:00010000:2.0:1746144665.091295:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435500 00000100:00100000:1.0:1746144665.092727:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747546240:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144665.092749:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.092783:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746806400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 8283us (8616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.092792:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6073 00000100:00100000:0.0:1746144665.093554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.093814:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746807168 00000100:00100000:2.0:1746144665.093822:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746807168 00002000:00100000:2.0:1746144665.093863:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1167360->1171455) req@ffff88009f437480 x1830964746807168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.093873:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437480 with x1830964746807168 ext(1167360->1171455) 00002000:00010000:2.0:1746144665.093877:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437480 00002000:00010000:3.0:1746144665.093981:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144664 -> 1746144665 00002000:00010000:3.0:1746144665.093985:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144664 -> 1746144665 00002000:00010000:3.0:1746144665.093987:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144664 -> 1746144665 00000100:00100000:3.0:1746144665.094018:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747546368:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.094048:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c198c00/0xa7c849b16e01b1e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f633 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.094059:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c198c00/0xa7c849b16e01b1e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f633 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.094083:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c198c00, rc 0) 00000100:00100000:3.0:1746144665.094123:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746806656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8666us (8813us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.094129:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12165 00000100:00100000:2.0:1746144665.094584:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4681 00000100:00100000:2.0:1746144665.094594:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746807168:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144665.094727:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746807168:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 135us (1176us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.094732:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4681 00002000:00100000:2.0:1746144665.094738:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1167360->1171455) req@ffff88009f437480 x1830964746807168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.094745:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437480 with x1830964746807168 ext(1167360->1171455) 00002000:00010000:2.0:1746144665.094748:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437480 00000100:00100000:0.0:1746144665.097917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.097956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.099178:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746807296 00000100:00100000:1.0:1746144665.099189:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746807296 00000100:00100000:1.0:1746144665.099243:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746807424 00000100:00100000:1.0:1746144665.099245:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746807424 00000100:00100000:1.0:1746144665.099262:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12166 00000100:00100000:1.0:1746144665.099268:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746807296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144665.099287:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.099306:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009297be00/0xa7c849b16e01b1e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f63a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.099362:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747546496:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144665.099437:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.099570:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12167 00000100:00100000:3.0:1746144665.099578:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746807424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.099585:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.099596:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009437c600/0xa7c849b16e01b1f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f641 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.099623:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747546624:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144665.099647:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.099916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.100232:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746807680 00000100:00100000:2.0:1746144665.100237:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746807680 00000100:00100000:2.0:1746144665.100264:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4128 00000100:00100000:2.0:1746144665.100270:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29301:x1830964746807680:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144665.100464:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29301:x1830964746807680:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 194us (547us total) trans 8589944063 rc 0/0 00000100:00100000:2.0:1746144665.100470:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4128 00000100:00100000:2.0:1746144665.104921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.105247:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746807936 00000100:00100000:0.0:1746144665.105257:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746807936 00002000:00100000:0.0:1746144665.105309:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88008c7d1880 x1830964746807936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.105319:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1880 with x1830964746807936 ext(4194304->4935679) 00002000:00010000:0.0:1746144665.105326:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d1880 00000100:00100000:2.0:1746144665.106364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.106447:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747546624:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.106484:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009437c600/0xa7c849b16e01b1f0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f641 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.106498:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009437c600/0xa7c849b16e01b1f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f641 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.106512:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437c600, rc 0) 00000100:00100000:2.0:1746144665.106576:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746807424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6998us (8616us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.106584:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12167 00000100:00100000:2.0:1746144665.106610:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808064 00000100:00100000:2.0:1746144665.106614:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808064 00000100:00100000:2.0:1746144665.106640:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12168 00000100:00100000:2.0:1746144665.106647:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:29307:x1830964746808064:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144665.106661:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.106674:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f648 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.106697:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.106704:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.106711:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.106712:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.106715:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2502656->3145727] (req 2502656->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.106744:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.106756:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 25 pid: 8450 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.106767:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747546752:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.106814:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.106817:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747546496:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.106822:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 23 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.106828:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747546880:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144665.106839:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009297be00/0xa7c849b16e01b1e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f63a expref: 36 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144665.106841:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144665.106848:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009297be00/0xa7c849b16e01b1e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f63a expref: 36 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.106861:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009297be00, rc 0) 00000100:00100000:1.0:1746144665.106881:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746807296:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7613us (8973us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144665.106887:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12166 00000100:00100000:3.0:1746144665.106926:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4682 00000100:00100000:3.0:1746144665.106935:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746807936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.108486:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747546752:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.108499:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747546880:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.108519:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2502656->3145727] (req 2502656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.108533:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6400, rc 0) 00000100:00100000:2.0:1746144665.108562:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:29307:x1830964746808064:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1915us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.108572:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12168 00000100:00100000:0.0:1746144665.112231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.113054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.113102:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808192 00000100:00100000:2.0:1746144665.113127:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808192 00000100:00100000:2.0:1746144665.113201:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12169 00000100:00100000:2.0:1746144665.113210:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746808192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.113231:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.113251:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6800/0xa7c849b16e01b1fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f64f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.113307:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747547008:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144665.113377:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.114161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.114173:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808448 00000100:00100000:0.0:1746144665.114176:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808448 00000100:00100000:1.0:1746144665.114280:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808576 00000100:00100000:1.0:1746144665.114285:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808576 00010000:00010000:1.0:1746144665.114306:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 26 pid: 8450 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.114338:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6074 00000100:00100000:1.0:1746144665.114344:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746808576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.114355:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.114380:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 26 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.114396:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 26 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.114418:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130327c00/0xa7c849b16e01b1c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f617 expref: 26 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.114433:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.114460:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746808576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 116us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.114467:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6074 00000100:00100000:1.0:1746144665.114512:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.115312:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808320 00000100:00100000:2.0:1746144665.115317:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808320 00000100:00100000:2.0:1746144665.115960:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12170 00000100:00100000:2.0:1746144665.115967:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746808448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.115985:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.115998:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b205 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f65d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.116024:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.116033:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b205 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f65d expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.116042:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6200/0xa7c849b16e01b205 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f65d expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.116059:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6200, rc 0) 00000100:00100000:2.0:1746144665.116096:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746808448:12345-192.168.204.23@tcp:101:cat.0 Request processed in 129us (1936us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.116102:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12170 00000100:00100000:1.0:1746144665.116468:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12171 00000100:00100000:1.0:1746144665.116478:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746808320:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144665.116493:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.116501:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009297b000/0xa7c849b16e01b20c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f656 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.116541:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747547136:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144665.116591:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.117031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.117111:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808704 00000100:00100000:3.0:1746144665.117116:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808704 00010000:00010000:3.0:1746144665.117156:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 24 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.117181:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6075 00000100:00100000:3.0:1746144665.117187:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746808704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.117195:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.117216:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 24 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.117225:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 24 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.117241:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7800/0xa7c849b16e01b19c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f609 expref: 24 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.117257:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.117259:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.117265:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.117273:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.117293:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.117300:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747547264:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.118158:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747547008:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144665.118168:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746144665.118185:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6800/0xa7c849b16e01b1fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f64f expref: 36 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.118196:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6800/0xa7c849b16e01b1fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f64f expref: 36 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.118206:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6800, rc 0) 00000100:00100000:2.0:1746144665.118229:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:1961:x1830964746808192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5020us (6008us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.118236:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12169 00000100:00100000:0.0:1746144665.118413:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747547136:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144665.118433:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009297b000/0xa7c849b16e01b20c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f656 expref: 25 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144665.118442:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009297b000/0xa7c849b16e01b20c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f656 expref: 25 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144665.118453:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009297b000, rc 0) 00000100:00100000:0.0:1746144665.118472:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746808320:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1998us (3960us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144665.118478:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12171 00000100:00100000:2.0:1746144665.118610:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746807936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11676us (13701us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144665.118618:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4682 00002000:00100000:2.0:1746144665.118627:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88008c7d1880 x1830964746807936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.118635:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d1880 with x1830964746807936 ext(4194304->4935679) 00002000:00010000:2.0:1746144665.118640:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c7d1880 00000100:00100000:3.0:1746144665.119629:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747547264:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.119644:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.119679:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746808704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2492us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.119687:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6075 00000100:00100000:0.0:1746144665.120171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.120217:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746808960 00000100:00100000:2.0:1746144665.120223:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746808960 00002000:00100000:2.0:1746144665.120252:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2502656->2506751) req@ffff880093763100 x1830964746808960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.120259:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763100 with x1830964746808960 ext(2502656->2506751) 00002000:00010000:2.0:1746144665.120264:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093763100 00000100:00100000:2.0:1746144665.120291:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4683 00000100:00100000:2.0:1746144665.120297:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746808960:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.120461:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:1963:x1830964746808960:12345-192.168.204.23@tcp:3:cat.0 Request processed in 164us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.120466:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4683 00002000:00100000:2.0:1746144665.120471:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2502656->2506751) req@ffff880093763100 x1830964746808960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.120480:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763100 with x1830964746808960 ext(2502656->2506751) 00002000:00010000:2.0:1746144665.120482:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093763100 00000100:00100000:0.0:1746144665.123725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.124348:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746809344 00000100:00100000:1.0:1746144665.124358:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746809344 00000100:00100000:1.0:1746144665.124416:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4129 00000100:00100000:1.0:1746144665.124425:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:29305:x1830964746809344:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144665.124466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.124487:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746809088 00000100:00100000:2.0:1746144665.124491:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746809088 00000100:00100000:2.0:1746144665.124516:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12172 00000100:00100000:2.0:1746144665.124521:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746809088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.124534:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.124552:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b213 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f664 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.124610:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747547392:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144665.124694:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.125041:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:29305:x1830964746809344:12345-192.168.204.23@tcp:35:cat.0 Request processed in 617us (1334us total) trans 8589944064 rc 0/0 00000100:00100000:1.0:1746144665.125049:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4129 00000100:00100000:2.0:1746144665.126124:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747547392:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.126167:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b213 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f664 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.126179:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b213 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f664 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.126188:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6c00, rc 0) 00000100:00100000:2.0:1746144665.126213:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746809088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1691us (1746us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.126219:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12172 00000100:00100000:2.0:1746144665.129331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.129389:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746809472 00000100:00100000:0.0:1746144665.129399:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746809472 00000100:00100000:2.0:1746144665.129400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.129443:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746809600 00000100:00100000:0.0:1746144665.129445:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746809600 00000100:00100000:1.0:1746144665.129449:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12173 00000100:00100000:2.0:1746144665.129459:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12174 00000100:00100000:1.0:1746144665.129459:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746809472:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144665.129466:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+35:29307:x1830964746809600:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144665.129477:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.129477:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.129494:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f672 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.129494:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009297b000/0xa7c849b16e01b221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f66b expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.129520:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.129528:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.129533:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.129535:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.129539:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.129548:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747547520:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.129559:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.129570:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.129578:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747547648:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.130291:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8480 going to sleep for 11 seconds 00010000:00010000:2.0:1746144665.130412:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.130422:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 48 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.130431:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747547776:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.130484:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099519000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.131635:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747547648:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.131646:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747547776:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.131673:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->3227647] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.131687:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6200, rc 0) 00000100:00100000:3.0:1746144665.131718:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+36:29307:x1830964746809600:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2252us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.131725:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12174 00000100:00100000:1.0:1746144665.131924:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747547520:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144665.131946:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009297b000/0xa7c849b16e01b221 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f66b expref: 24 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.131956:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009297b000/0xa7c849b16e01b221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f66b expref: 24 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.131965:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009297b000, rc 0) 00000100:00100000:1.0:1746144665.131993:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746809472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2536us (2672us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144665.131999:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12173 00000100:00100000:0.0:1746144665.138955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.138991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.139024:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746809728 00000100:00100000:0.0:1746144665.139033:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746809728 00010000:00010000:0.0:1746144665.139075:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144665.139103:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746809856 00000100:00100000:0.0:1746144665.139105:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746809856 00010000:00010000:0.0:1746144665.139117:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 49 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144665.139161:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6076 00000100:00100000:0.0:1746144665.139169:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+36:1960:x1830964746809728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.139183:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.139204:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.139215:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.139237:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6a00/0xa7c849b16e01b195 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f602 expref: 36 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.139252:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.139295:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746809728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.139302:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6076 00000100:00100000:0.0:1746144665.139317:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6077 00000100:00100000:0.0:1746144665.139322:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+49:1961:x1830964746809856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.139328:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.139335:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 49 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.139344:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 49 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.139355:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01b18e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5fb expref: 49 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.139363:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.139366:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.139373:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.139381:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.139410:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 34 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.139423:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093760380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747547904:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.139476:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.144202:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093760380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747547904:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144665.144229:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.144374:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+48:1961:x1830964746809856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5050us (5380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.144386:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6077 00000100:00100000:0.0:1746144665.144965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.145507:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746810112 00000100:00100000:0.0:1746144665.145513:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746810112 00002000:00100000:0.0:1746144665.145552:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3227647) req@ffff880093760380 x1830964746810112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.145562:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760380 with x1830964746810112 ext(3223552->3227647) 00002000:00010000:0.0:1746144665.145567:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093760380 00000100:00100000:0.0:1746144665.145588:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4684 00000100:00100000:0.0:1746144665.145594:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746810112:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.145724:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+35:1960:x1830964746810112:12345-192.168.204.23@tcp:3:cat.0 Request processed in 130us (760us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144665.145730:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4684 00002000:00100000:0.0:1746144665.145736:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3223552->3227647) req@ffff880093760380 x1830964746810112/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.145742:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760380 with x1830964746810112 ext(3223552->3227647) 00002000:00010000:0.0:1746144665.145746:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093760380 00000100:00100000:1.0:1746144665.149844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.149876:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746810368 00000100:00100000:1.0:1746144665.149885:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746810368 00000100:00100000:1.0:1746144665.149932:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4130 00000100:00100000:1.0:1746144665.149940:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:29307:x1830964746810368:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144665.150701:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:29307:x1830964746810368:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 760us (862us total) trans 8589944065 rc 0/0 00000100:00100000:1.0:1746144665.150708:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4130 00000100:00100000:1.0:1746144665.221019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.221420:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746810624 00000100:00100000:2.0:1746144665.221429:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746810624 00000100:00100000:2.0:1746144665.221482:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10176 00000100:00100000:2.0:1746144665.221492:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29314:x1830964746810624:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144665.221516:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.221535:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7200/0xa7c849b16e01b228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f679 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.221640:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221653:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221665:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221679:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221684:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221689:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221787:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221795:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221800:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144665.221809:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:2.0:1746144665.221884:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221891:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221896:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221905:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144665.221908:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221915:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221925:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144665.221927:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144665.221931:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221935:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6e00/0xa7c849b16e01b23d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221947:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221952:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221956:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221959:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a7000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144665.221961:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221964:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221969:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144665.221971:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144665.221974:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221978:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b22f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221984:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221989:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221994:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.221997:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a6600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144665.222009:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.222014:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.222019:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f3c3600) 00010000:00010000:2.0:1746144665.222021:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144665.222023:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.222028:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a6600/0xa7c849b16e01b236 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144665.222058:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7200/0xa7c849b16e01b228 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f679 expref: 306 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.222065:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a7200/0xa7c849b16e01b228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f679 expref: 306 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.222073:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7200, rc 0) 00000100:00100000:2.0:1746144665.222120:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29314:x1830964746810624:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 630us (1117us total) trans 8589944066 rc 301/301 00000100:00100000:2.0:1746144665.222126:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10176 00000100:00100000:0.0:1746144665.251618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.251704:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746810752 00000100:00100000:2.0:1746144665.251714:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746810752 00000100:00100000:2.0:1746144665.251835:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12175 00000100:00100000:2.0:1746144665.251845:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29314:x1830964746810752:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144665.251865:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.251884:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f680 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.251914:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.251923:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.251925:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.251928:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.252046:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.252059:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 23 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.252078:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747548032:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.252277:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800995199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.255226:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747548032:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.255263:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.255279:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6c00, rc 0) 00000100:00100000:3.0:1746144665.255323:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29314:x1830964746810752:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3479us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.255331:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12175 00000100:00100000:0.0:1746144665.255665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.255727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.255751:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746810880 00000100:00100000:0.0:1746144665.255757:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746810880 00002000:00100000:0.0:1746144665.255794:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2502656->3145727) req@ffff880093763800 x1830964746810880/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.255802:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763800 with x1830964746810880 ext(2502656->3145727) 00010000:00010000:0.0:1746144665.255808:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.255820:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 24 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:0.0:1746144665.255825:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093763800 00000100:00100000:0.0:1746144665.255842:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 930 00000100:00100000:0.0:1746144665.255849:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746810880:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144665.256499:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746811136 00000100:00100000:3.0:1746144665.256503:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746811136 00000100:00100000:3.0:1746144665.256530:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10177 00000100:00100000:3.0:1746144665.256535:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:29320:x1830964746811136:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.256552:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.256568:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6600/0xa7c849b16e01b252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f687 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.256661:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256674:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256690:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256704:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256710:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256715:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256823:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256831:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256836:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144665.256844:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144665.256918:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256924:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256929:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256934:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144665.256938:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256950:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256960:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144665.256963:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144665.256966:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256971:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01b267 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256982:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256986:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256990:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.256993:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144665.256995:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257009:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257015:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144665.257017:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144665.257019:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257023:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5a00/0xa7c849b16e01b259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257030:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257035:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257040:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257044:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144665.257046:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257050:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257055:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea400) 00010000:00010000:3.0:1746144665.257056:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144665.257058:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257062:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01b260 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144665.257092:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6600/0xa7c849b16e01b252 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f687 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.257098:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921c6600/0xa7c849b16e01b252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f687 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.257104:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921c6600, rc 0) 00000100:00100000:3.0:1746144665.257131:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:29320:x1830964746811136:12345-192.168.204.23@tcp:101:cat.0 Request processed in 595us (1403us total) trans 8589944067 rc 301/301 00000100:00100000:3.0:1746144665.257154:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10177 00000100:00100000:2.0:1746144665.261887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.261907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.261943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.262209:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746811264 00000100:00100000:3.0:1746144665.262220:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746811264 00000100:00100000:3.0:1746144665.262267:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746811392 00000100:00100000:3.0:1746144665.262269:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746811392 00000100:00100000:3.0:1746144665.262293:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746811520 00000100:00100000:3.0:1746144665.262295:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746811520 00000100:00100000:3.0:1746144665.262309:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12176 00000100:00100000:3.0:1746144665.262318:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1963:x1830964746811264:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144665.262319:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12177 00000100:00100000:2.0:1746144665.262336:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746811392:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.262337:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.262345:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.262355:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092459600/0xa7c849b16e01b275 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f68e expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.262356:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01b27c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f695 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.262407:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747548288:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144665.262407:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747548160:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144665.262765:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12178 00000100:00100000:0.0:1746144665.262773:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746811520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144665.262780:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144665.262789:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305ff200/0xa7c849b16e01b283 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f69c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.262813:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747548416:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144665.263118:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.263208:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.263448:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.264486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.264580:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746811776 00000100:00100000:3.0:1746144665.264587:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746811776 00000100:00100000:3.0:1746144665.264621:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10178 00000100:00100000:3.0:1746144665.264627:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29321:x1830964746811776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.264645:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.264659:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e01b28a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6a3 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.264762:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264776:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264786:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264797:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264803:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264808:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264905:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264913:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.264918:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144665.264926:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:3.0:1746144665.264994:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265010:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265016:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265022:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144665.265026:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265031:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265041:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144665.265044:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144665.265048:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265053:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5400/0xa7c849b16e01b29f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265064:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265068:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265072:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265076:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144665.265078:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265082:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265086:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144665.265088:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144665.265089:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265093:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5a00/0xa7c849b16e01b291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265097:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265101:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265106:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265110:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0a5c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144665.265111:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265115:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265119:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaf00) 00010000:00010000:3.0:1746144665.265120:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144665.265122:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265125:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5c00/0xa7c849b16e01b298 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144665.265169:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e01b28a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6a3 expref: 307 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.265175:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a4600/0xa7c849b16e01b28a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6a3 expref: 307 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.265181:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a4600, rc 0) 00000100:00100000:3.0:1746144665.265210:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29321:x1830964746811776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 583us (727us total) trans 8589944068 rc 301/301 00000100:00100000:3.0:1746144665.265215:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10178 00002000:00010000:3.0:1746144665.268793:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2053 -> 2057 00000100:00100000:3.0:1746144665.268809:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747548288:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.268843:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092459600/0xa7c849b16e01b275 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f68e expref: 36 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.268856:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092459600/0xa7c849b16e01b275 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f68e expref: 36 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.268866:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092459600, rc 0) 00000100:00100000:3.0:1746144665.268909:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+35:1963:x1830964746811264:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6591us (7026us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.268918:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12176 00000100:00100000:1.0:1746144665.269081:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747548416:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144665.269099:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305ff200/0xa7c849b16e01b283 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f69c expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.269108:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305ff200/0xa7c849b16e01b283 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f69c expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.269116:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305ff200, rc 0) 00000100:00100000:1.0:1746144665.269159:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746811520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6387us (7214us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144665.269165:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12178 00000100:00100000:3.0:1746144665.271079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.271239:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812032 00000100:00100000:0.0:1746144665.271248:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812032 00000100:00100000:0.0:1746144665.271288:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4131 00000100:00100000:0.0:1746144665.271295:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29321:x1830964746812032:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144665.271361:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746810880:12345-192.168.204.23@tcp:4:cat.0 Request processed in 15511us (15696us total) trans 21474840573 rc 0/0 00000100:00100000:2.0:1746144665.271370:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 930 00002000:00100000:2.0:1746144665.271380:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2502656->3145727) req@ffff880093763800 x1830964746810880/t21474840573(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.271388:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093763800 with x1830964746810880 ext(2502656->3145727) 00010000:00010000:2.0:1746144665.271397:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 28 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.271408:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 28 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746144665.271416:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093763800 00000100:00100000:0.0:1746144665.271454:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29321:x1830964746812032:12345-192.168.204.23@tcp:35:cat.0 Request processed in 159us (384us total) trans 8589944069 rc 0/0 00000100:00100000:0.0:1746144665.271460:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4131 00000100:00100000:2.0:1746144665.271858:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747548160:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.271894:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01b27c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f695 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.271904:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7400/0xa7c849b16e01b27c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f695 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.271913:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7400, rc 0) 00000100:00100000:2.0:1746144665.271950:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746811392:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9625us (10040us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.271955:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12177 00000001:00080000:3.0:1746144665.274743:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873338 is committed 00000001:00080000:3.0:1746144665.274760:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873344 is committed 00000001:00080000:3.0:1746144665.274782:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873304 is committed 00000001:00080000:3.0:1746144665.274798:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873282 is committed 00000001:00080000:3.0:1746144665.274813:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873264 is committed 00000001:00080000:3.0:1746144665.274860:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873303 is committed 00000001:00080000:3.0:1746144665.274933:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873326 is committed 00000001:00080000:3.0:1746144665.274938:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873325 is committed 00000001:00080000:3.0:1746144665.274957:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873284 is committed 00000001:00080000:3.0:1746144665.274986:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873345 is committed 00000100:00100000:0.0:1746144665.276638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.276675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.276698:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812160 00000100:00100000:0.0:1746144665.276702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.276706:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812160 00000100:00100000:1.0:1746144665.276714:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812288 00000100:00100000:1.0:1746144665.276719:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812288 00000100:00100000:2.0:1746144665.276770:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12179 00000100:00100000:1.0:1746144665.276776:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12180 00000100:00100000:2.0:1746144665.276778:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746812160:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144665.276782:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746812288:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144665.276794:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.276795:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.276811:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7c00/0xa7c849b16e01b2b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6aa expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.276811:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009297a600/0xa7c849b16e01b2ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6b1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.276847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.276862:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747548544:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144665.276862:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747548672:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144665.276934:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.277681:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812544 00000100:00100000:3.0:1746144665.277685:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812544 00000100:00100000:3.0:1746144665.277710:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12181 00000100:00100000:3.0:1746144665.277716:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+7:29320:x1830964746812544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.277724:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.277733:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6b8 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.277754:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.277761:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.277763:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.277766:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.277785:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.277796:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 21 pid: 8450 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.277805:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747548800:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.277900:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.277906:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812416 00000100:00100000:0.0:1746144665.277909:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812416 00010000:00010000:0.0:1746144665.277928:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144665.277952:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6078 00000100:00100000:0.0:1746144665.277957:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746812416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.277966:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.277988:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.278007:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 26 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.278026:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.278028:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.278035:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.278043:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.278071:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.278079:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093760000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747548928:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.278100:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.278254:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.279209:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093760000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747548928:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144665.279224:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.279249:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746812416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1291us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.279257:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6078 00010000:00010000:1.0:1746144665.279363:0:8450:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88012e12ce00 x1830964747548672) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 25 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.279386:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6400/0xa7c849b16e01b1f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f648 expref: 25 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.279396:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747548672:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144665.279417:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009297a600/0xa7c849b16e01b2ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b1 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.279427:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009297a600/0xa7c849b16e01b2ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b1 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.279434:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009297a600, rc 0) 00000100:00100000:1.0:1746144665.279467:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746812288:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2686us (2792us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144665.279473:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12180 00002000:00010000:2.0:1746144665.279654:0:29370:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144665 -> 1746144666 00002000:00010000:2.0:1746144665.279670:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5615 -> 5617 00000100:00100000:2.0:1746144665.279676:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747548544:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.279701:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7c00/0xa7c849b16e01b2b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6aa expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.279710:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7c00/0xa7c849b16e01b2b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6aa expref: 21 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.279717:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7c00, rc 0) 00000100:00100000:2.0:1746144665.279738:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746812160:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2963us (3107us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.279744:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12179 00000100:00100000:0.0:1746144665.280384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.280431:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812800 00000100:00100000:2.0:1746144665.280436:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812800 00002000:00100000:2.0:1746144665.280472:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3858432->3862527) req@ffff880093760000 x1830964746812800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.280482:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760000 with x1830964746812800 ext(3858432->3862527) 00002000:00010000:2.0:1746144665.280487:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093760000 00000100:00100000:2.0:1746144665.280509:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4685 00000100:00100000:2.0:1746144665.280517:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746812800:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144665.281087:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747548800:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144665.281108:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.281119:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092459800, rc 0) 00000100:00100000:0.0:1746144665.281183:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+8:29320:x1830964746812544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3467us (4335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.281189:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12181 00000100:00100000:2.0:1746144665.281212:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746812800:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 696us (828us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.281217:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4685 00002000:00100000:2.0:1746144665.281222:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3858432->3862527) req@ffff880093760000 x1830964746812800/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.281229:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760000 with x1830964746812800 ext(3858432->3862527) 00002000:00010000:2.0:1746144665.281232:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093760000 00000100:00100000:0.0:1746144665.281346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.281424:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746812928 00000100:00100000:2.0:1746144665.281428:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746812928 00002000:00100000:2.0:1746144665.281445:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (258048->1048575) req@ffff880093761f80 x1830964746812928/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.281452:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761f80 with x1830964746812928 ext(258048->1048575) 00010000:00010000:2.0:1746144665.281457:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 20 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.281466:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 20 pid: 8450 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746144665.281472:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093761f80 00000100:00100000:2.0:1746144665.281490:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 931 00000100:00100000:2.0:1746144665.281495:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746812928:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:2.0:1746144665.288169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.288216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.288431:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746813312 00000100:00100000:0.0:1746144665.288441:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746813312 00000100:00100000:1.0:1746144665.288477:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746813184 00000100:00100000:1.0:1746144665.288482:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746813184 00000100:00100000:0.0:1746144665.288878:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12182 00000100:00100000:1.0:1746144665.288880:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10179 00000100:00100000:0.0:1746144665.288886:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29321:x1830964746813312:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144665.288888:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:29323:x1830964746813184:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144665.288904:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144665.288904:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.288921:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ae00/0xa7c849b16e01b2c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6bf expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.288921:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6c6 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.288947:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144665.288952:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.288963:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.288973:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305fea00, rc 0) 00000100:00100000:0.0:1746144665.289025:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29321:x1830964746813312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 140us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.289032:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12182 00010000:00010000:1.0:1746144665.289044:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289056:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289067:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289079:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289085:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289089:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144665.289438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144665.289622:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289630:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289635:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.289643:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9129248 00010000:00010000:1.0:1746144665.289716:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289723:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289731:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289736:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009297aa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.289740:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289746:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289755:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.289758:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144665.289761:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289766:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009297aa00/0xa7c849b16e01b2de lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289778:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289782:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289786:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289790:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009297a200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.289792:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289797:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289806:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144665.289809:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.289811:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289815:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a200/0xa7c849b16e01b2d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289822:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289826:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289842:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289847:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009297ba00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.289849:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289853:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289859:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35dc00) 00010000:00010000:1.0:1746144665.289861:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.289863:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289867:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ba00/0xa7c849b16e01b2d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.289900:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ae00/0xa7c849b16e01b2c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6bf expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.289907:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009297ae00/0xa7c849b16e01b2c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6bf expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.289913:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009297ae00, rc 0) 00000100:00100000:3.0:1746144665.290031:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746813440 00000100:00100000:3.0:1746144665.290037:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746813440 00000100:00100000:3.0:1746144665.290059:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12183 00000100:00100000:3.0:1746144665.290065:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29314:x1830964746813440:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.290072:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.290080:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6cd expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.290096:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.290108:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.290110:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.290112:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4206591] (req 4194304->4206591) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.290157:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.290167:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 7 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.290178:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747549056:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.290538:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+16:29323:x1830964746813184:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1649us (2378us total) trans 8589944070 rc 301/301 00000100:00100000:1.0:1746144665.290545:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10179 00000100:00100000:3.0:1746144665.290642:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.293725:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747549056:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.293762:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4206591] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.293779:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092459a00, rc 0) 00000100:00100000:3.0:1746144665.293819:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29314:x1830964746813440:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3754us (4381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.293827:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12183 00000100:00100000:0.0:1746144665.294016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.294039:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746813568 00000100:00100000:2.0:1746144665.294046:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746813568 00002000:00100000:2.0:1746144665.294097:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3227647) req@ffff88012b1cf100 x1830964746813568/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.294106:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf100 with x1830964746813568 ext(3145728->3227647) 00010000:00010000:2.0:1746144665.294112:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 8 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.294123:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 8 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:2.0:1746144665.294129:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1cf100 00000100:00100000:2.0:1746144665.294975:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 932 00000100:00100000:2.0:1746144665.294988:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+8:1962:x1830964746813568:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144665.298655:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746813568:12345-192.168.204.23@tcp:4:cat.0 Request processed in 3659us (4626us total) trans 17179873346 rc 0/0 00000100:00100000:3.0:1746144665.298669:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 932 00002000:00100000:3.0:1746144665.298688:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3227647) req@ffff88012b1cf100 x1830964746813568/t17179873346(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.298697:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf100 with x1830964746813568 ext(3145728->3227647) 00010000:00010000:3.0:1746144665.298708:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 10 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.298721:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 10 pid: 8453 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.298728:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1cf100 00000100:00100000:2.0:1746144665.300506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.300576:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746813696 00000100:00100000:0.0:1746144665.300587:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746813696 00010000:00010000:0.0:1746144665.300624:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 10 pid: 8453 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144665.300648:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6079 00000100:00100000:0.0:1746144665.300655:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746813696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.300671:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.300691:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 10 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.300701:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 10 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.300724:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6200/0xa7c849b16e01b21a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3227647) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f672 expref: 10 pid: 8453 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.300744:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.300746:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.300753:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.300761:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.300793:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.300805:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747549184:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.301799:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.305465:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746812928:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 23957us (24106us total) trans 17179873347 rc 0/0 00000100:00100000:1.0:1746144665.305479:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 931 00002000:00100000:1.0:1746144665.305492:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (258048->1048575) req@ffff880093761f80 x1830964746812928/t17179873347(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.305502:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761f80 with x1830964746812928 ext(258048->1048575) 00010000:00010000:1.0:1746144665.305513:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.305530:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144665.305536:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093761f80 00000100:00100000:0.0:1746144665.307959:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747549184:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144665.307982:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.308314:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013643d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746813696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7657us (7811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.308326:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6079 00000100:00100000:3.0:1746144665.308562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.308763:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746813952 00000100:00100000:1.0:1746144665.308771:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746813952 00002000:00100000:1.0:1746144665.308811:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4202496->4206591) req@ffff88009ee0b100 x1830964746813952/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.308826:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b100 with x1830964746813952 ext(4202496->4206591) 00002000:00010000:1.0:1746144665.308831:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0b100 00000100:00100000:1.0:1746144665.308846:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4686 00000100:00100000:1.0:1746144665.308853:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746813952:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144665.309027:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746813952:12345-192.168.204.23@tcp:3:cat.0 Request processed in 174us (465us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144665.309033:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4686 00002000:00100000:1.0:1746144665.309038:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4202496->4206591) req@ffff88009ee0b100 x1830964746813952/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.309044:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b100 with x1830964746813952 ext(4202496->4206591) 00002000:00010000:1.0:1746144665.309046:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee0b100 00000100:00100000:0.0:1746144665.311912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.312272:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746814080 00000100:00100000:2.0:1746144665.312281:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746814080 00010000:00010000:2.0:1746144665.312331:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.312359:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6080 00000100:00100000:2.0:1746144665.312367:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746814080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.312381:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144665.312399:0:15951:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144665 -> 1746144666 00010000:00010000:2.0:1746144665.312405:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.312416:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.312438:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01b1cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 258048->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f61e expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.312786:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.312788:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.312796:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.312805:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.312814:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.312815:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.312817:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.312823:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.312856:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.312869:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747549312:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.313182:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.313190:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747549440:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.313368:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.320774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.320983:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746814336 00000100:00100000:1.0:1746144665.320993:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746814336 00000100:00100000:2.0:1746144665.321319:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747549312:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144665.321359:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4132 00000100:00100000:1.0:1746144665.321370:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29314:x1830964746814336:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144665.321656:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747549440:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.321688:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.321744:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746814080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9378us (9842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.321753:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6080 00000100:00100000:1.0:1746144665.322655:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29314:x1830964746814336:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1286us (1889us total) trans 8589944071 rc 0/0 00000100:00100000:1.0:1746144665.322662:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4132 00000100:00100000:0.0:1746144665.323885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.324423:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746814592 00000100:00100000:3.0:1746144665.324432:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746814592 00002000:00100000:3.0:1746144665.324469:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b1ced80 x1830964746814592/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.324479:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ced80 with x1830964746814592 ext(0->1048575) 00002000:00010000:3.0:1746144665.324484:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1ced80 00000100:00100000:3.0:1746144665.324513:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4687 00000100:00100000:3.0:1746144665.324520:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746814592:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.330242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.330309:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746814848 00000100:00100000:1.0:1746144665.330318:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746814848 00002000:00100000:1.0:1746144665.330369:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b1cca80 x1830964746814848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.330379:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cca80 with x1830964746814848 ext(0->1048575) 00000100:00100000:0.0:1746144665.330382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:1.0:1746144665.330387:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1cca80 00000100:00100000:1.0:1746144665.330552:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746815104 00000100:00100000:1.0:1746144665.330555:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746815104 00002000:00100000:1.0:1746144665.330570:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1171456->2097151) req@ffff88012b1cf800 x1830964746815104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.330577:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf800 with x1830964746815104 ext(1171456->2097151) 00002000:00010000:1.0:1746144665.330580:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf800 00000100:00100000:1.0:1746144665.330601:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4688 00000100:00100000:1.0:1746144665.330608:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746814848:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.330728:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4689 00000100:00100000:0.0:1746144665.330735:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746815104:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144665.332490:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1960:x1830964746814592:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7964us (8602us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.332499:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4687 00002000:00100000:3.0:1746144665.332507:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b1ced80 x1830964746814592/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.332515:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ced80 with x1830964746814592 ext(0->1048575) 00002000:00010000:3.0:1746144665.332521:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1ced80 00000100:00100000:2.0:1746144665.343230:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746815104:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12484us (12836us total) trans 0 rc 925696/925696 00000100:00100000:2.0:1746144665.343242:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4689 00002000:00100000:2.0:1746144665.343254:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1171456->2097151) req@ffff88012b1cf800 x1830964746815104/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 925696/925696 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.343264:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cf800 with x1830964746815104 ext(1171456->2097151) 00002000:00010000:2.0:1746144665.343270:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1cf800 00000100:00100000:0.0:1746144665.349204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.349301:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746815232 00000100:00100000:3.0:1746144665.349311:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746815232 00000100:00100000:3.0:1746144665.349360:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12184 00000100:00100000:3.0:1746144665.349368:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+25:29320:x1830964746815232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.349387:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.349407:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6d4 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.349438:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.349446:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.349448:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.349451:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.349483:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.349495:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 23 pid: 8450 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.349508:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747549568:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.349588:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.349725:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746814848:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19116us (19493us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144665.349734:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4688 00002000:00100000:0.0:1746144665.349743:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b1cca80 x1830964746814848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.349752:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cca80 with x1830964746814848 ext(0->1048575) 00002000:00010000:0.0:1746144665.349757:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1cca80 00000100:00100000:0.0:1746144665.354379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.354562:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747549568:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.354601:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.354624:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273400, rc 0) 00000100:00100000:3.0:1746144665.354677:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:29320:x1830964746815232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5308us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.354685:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12184 00000100:00100000:1.0:1746144665.354802:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746815360 00000100:00100000:1.0:1746144665.354814:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746815360 00002000:00100000:1.0:1746144665.354873:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1171455) req@ffff88012b1ce680 x1830964746815360/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.355462:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ce680 with x1830964746815360 ext(1048576->1171455) 00010000:00010000:1.0:1746144665.355472:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.355487:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 24 pid: 8450 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144665.355493:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1ce680 00000100:00100000:1.0:1746144665.355537:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 933 00000100:00100000:1.0:1746144665.355549:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746815360:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144665.361078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.361175:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746815488 00000100:00100000:3.0:1746144665.361192:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746815488 00000100:00100000:3.0:1746144665.361275:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12185 00000100:00100000:3.0:1746144665.361286:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29321:x1830964746815488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.361310:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.361332:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6db expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.361367:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.361375:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.361388:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.361400:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273a00, rc 0) 00000100:00100000:3.0:1746144665.361482:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29321:x1830964746815488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 196us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.361489:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12185 00000100:00100000:1.0:1746144665.364098:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746815360:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8540us (9718us total) trans 21474840574 rc 0/0 00000100:00100000:1.0:1746144665.364116:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 933 00002000:00100000:1.0:1746144665.364130:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1171455) req@ffff88012b1ce680 x1830964746815360/t21474840574(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.364171:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1ce680 with x1830964746815360 ext(1048576->1171455) 00010000:00010000:1.0:1746144665.364183:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 27 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.364198:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 27 pid: 8450 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144665.364205:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1ce680 00000100:00100000:0.0:1746144665.367358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.367432:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746815616 00000100:00100000:2.0:1746144665.367442:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746815616 00010000:00010000:2.0:1746144665.367499:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 27 pid: 8450 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.367543:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6081 00000100:00100000:2.0:1746144665.367553:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746815616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.367569:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144665.367589:0:15951:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144665 -> 1746144666 00010000:00010000:2.0:1746144665.367596:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 27 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.367608:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 27 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.367633:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4efb000/0xa7c849b16e01b1db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f62c expref: 27 pid: 8450 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.367668:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.367670:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.367679:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.367688:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.367695:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.367697:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.367700:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.368045:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.368089:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.368104:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747549696:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.370557:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.370578:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747549824:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.370608:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.375301:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747549696:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144665.375304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.375314:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747549824:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144665.375343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144665.375350:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.375395:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746815616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7844us (8049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.375405:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6081 00000100:00100000:0.0:1746144665.375821:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746815872 00000100:00100000:0.0:1746144665.375831:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746815872 00002000:00100000:0.0:1746144665.375878:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012e12ce00 x1830964746815872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.375888:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ce00 with x1830964746815872 ext(1048576->2097151) 00002000:00010000:0.0:1746144665.375894:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12ce00 00000100:00100000:0.0:1746144665.375921:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816128 00000100:00100000:0.0:1746144665.375924:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816128 00000100:00100000:3.0:1746144665.375930:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4690 00002000:00100000:0.0:1746144665.375937:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012e12f100 x1830964746816128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746144665.375941:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746815872:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:0.0:1746144665.375944:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12f100 with x1830964746816128 ext(1048576->2097151) 00002000:00010000:0.0:1746144665.375947:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12f100 00000100:00100000:0.0:1746144665.375966:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4691 00000100:00100000:0.0:1746144665.375972:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746816128:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.388603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.388676:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816256 00000100:00100000:1.0:1746144665.388690:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816256 00000100:00100000:1.0:1746144665.388752:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12186 00000100:00100000:1.0:1746144665.388761:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:29323:x1830964746816256:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144665.388781:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.388799:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6e2 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.388831:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 5 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.388839:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 10 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.388847:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.388854:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.388856:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.388860:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 10 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.388894:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 22 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.388907:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 22 pid: 4758 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.388920:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747549952:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144665.389045:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 10 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.389055:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 10 pid: 8388 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.389064:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550080:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144665.389519:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 5 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.389533:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 5 pid: 8389 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.389540:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550208:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.389695:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.390840:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746815872:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14895us (15532us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.390852:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4690 00002000:00100000:3.0:1746144665.390864:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012e12ce00 x1830964746815872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.390873:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ce00 with x1830964746815872 ext(1048576->2097151) 00002000:00010000:3.0:1746144665.390878:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12ce00 00000100:00100000:0.0:1746144665.395942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.396115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.396154:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816384 00000100:00100000:0.0:1746144665.396163:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816384 00010000:00010000:0.0:1746144665.396205:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 6 pid: 8389 timeout: 744 lvb_type: 1 00000100:00100000:0.0:1746144665.396233:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816512 00000100:00100000:0.0:1746144665.396235:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816512 00010000:00010000:0.0:1746144665.396246:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 11 pid: 8388 timeout: 744 lvb_type: 1 00000100:00100000:0.0:1746144665.396261:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6082 00000100:00100000:0.0:1746144665.396268:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746816384:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.396280:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144665.396291:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6083 00000100:00100000:3.0:1746144665.396299:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746816512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1746144665.396301:0:7309:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:3.0:1746144665.396307:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.396308:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 6 pid: 8389 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746144665.396316:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 11 pid: 8388 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746144665.396319:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 6 pid: 8389 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.396336:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747549952:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.396349:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550080:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.396358:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550208:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.396402:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 11 pid: 8388 timeout: 744 lvb_type: 1 00010000:00010000:0.0:1746144665.396425:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c19c600/0xa7c849b16e01b06f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f537 expref: 6 pid: 8389 timeout: 744 lvb_type: 1 00010000:00010000:3.0:1746144665.396430:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7600/0xa7c849b16e01b0bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f599 expref: 11 pid: 8388 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.396433:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 11 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.396443:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144665.396446:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87400, rc 0) 00010000:00010000:3.0:1746144665.396447:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.396487:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746816512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 189us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.396487:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+10:29323:x1830964746816256:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7727us (7894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.396487:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1962:x1830964746816384:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 219us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.396493:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6083 00000100:00100000:1.0:1746144665.396493:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12186 00000100:00100000:0.0:1746144665.396496:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6082 00000100:00100000:0.0:1746144665.396547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.396587:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746816128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20614us (21242us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.396595:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4691 00002000:00100000:2.0:1746144665.396604:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012e12f100 x1830964746816128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.396612:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12f100 with x1830964746816128 ext(1048576->2097151) 00002000:00010000:2.0:1746144665.396617:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12f100 00000100:00100000:0.0:1746144665.397128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.397340:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816640 00000100:00100000:1.0:1746144665.397344:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816640 00010000:00010000:1.0:1746144665.397358:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 23 pid: 4758 timeout: 744 lvb_type: 1 00000100:00100000:1.0:1746144665.397375:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6084 00000100:00100000:1.0:1746144665.397742:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746816640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.397753:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.397766:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 23 pid: 4758 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.397777:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 23 pid: 4758 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.397791:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437ce00/0xa7c849b16e01b0b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f57d expref: 23 pid: 4758 timeout: 744 lvb_type: 1 00010000:00010000:1.0:1746144665.397817:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.397818:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.397825:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.397834:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.397864:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.397875:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747550336:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144665.397933:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.398168:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816768 00000100:00100000:2.0:1746144665.398172:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816768 00000100:00100000:2.0:1746144665.398207:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12187 00000100:00100000:2.0:1746144665.398213:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29321:x1830964746816768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.398227:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.398239:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6e9 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.398255:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.398261:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.398264:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.398266:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.398283:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 8 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.398294:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 8 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.398303:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550464:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.398345:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.400878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.400938:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746816896 00000100:00100000:3.0:1746144665.400945:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746816896 00000100:00100000:3.0:1746144665.401153:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12188 00000100:00100000:3.0:1746144665.401161:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+9:29320:x1830964746816896:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.401177:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.401192:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6f0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.401194:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747550336:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144665.401213:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144665.401216:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.401220:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.401220:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550464:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.401231:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 10 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.401241:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4272800, rc 0) 00010000:00010000:2.0:1746144665.401245:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.401255:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6400, rc 0) 00000100:00100000:1.0:1746144665.401256:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746816640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3874us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.401259:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+10:29320:x1830964746816896:12345-192.168.204.23@tcp:101:cat.0 Request processed in 100us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.401265:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12188 00000100:00100000:1.0:1746144665.401265:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6084 00000100:00100000:2.0:1746144665.401275:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29321:x1830964746816768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3063us (4146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.401281:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12187 00000100:00100000:2.0:1746144665.403127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.403179:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746817152 00000100:00100000:0.0:1746144665.403186:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746817152 00002000:00100000:0.0:1746144665.403229:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->1511423) req@ffff880099b8e300 x1830964746817152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.403239:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8e300 with x1830964746817152 ext(1507328->1511423) 00010000:00010000:0.0:1746144665.403246:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 10 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.403260:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 10 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:0.0:1746144665.403271:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099b8e300 00000100:00100000:0.0:1746144665.403965:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 934 00000100:00100000:0.0:1746144665.403976:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746817152:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144665.404204:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746817152:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 230us (1084us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144665.404211:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 934 00002000:00100000:0.0:1746144665.404217:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->1511423) req@ffff880099b8e300 x1830964746817152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.404225:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8e300 with x1830964746817152 ext(1507328->1511423) 00010000:00010000:0.0:1746144665.404231:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 10 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.404244:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 10 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:0.0:1746144665.404250:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099b8e300 00000100:00100000:1.0:1746144665.410357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.410944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.411018:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746817536 00000100:00100000:2.0:1746144665.411029:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746817536 00000100:00100000:3.0:1746144665.411054:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746817408 00000100:00100000:3.0:1746144665.411059:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746817408 00000100:00100000:2.0:1746144665.411090:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12189 00002000:00100000:3.0:1746144665.411093:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->2097151) req@ffff88012e12d180 x1830964746817408/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746144665.411100:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+11:29323:x1830964746817536:12345-192.168.204.23@tcp:101:multiop.0 00002000:00100000:3.0:1746144665.411103:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12d180 with x1830964746817408 ext(1507328->2097151) 00010000:00010000:3.0:1746144665.411113:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 11 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.411116:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.411127:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 11 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.411147:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6f7 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144665.411156:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e12d180 00010000:00010000:2.0:1746144665.411178:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.411180:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 935 00010000:00010000:2.0:1746144665.411185:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746144665.411187:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746817408:12345-192.168.204.23@tcp:4:multiop.0 00010000:00010000:2.0:1746144665.411187:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.411190:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2220031] (req 2097152->2220031) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.411220:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.411230:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 22 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.411307:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550592:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.411589:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.415213:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747550592:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.415260:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2220031] (req 2097152->2220031) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.415282:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6600, rc 0) 00000100:00100000:2.0:1746144665.415333:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+13:29323:x1830964746817536:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4235us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.415342:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12189 00000100:00100000:0.0:1746144665.416018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.423888:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746817664 00000100:00100000:1.0:1746144665.423905:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746817664 00002000:00100000:1.0:1746144665.423964:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4206591) req@ffff88009f435180 x1830964746817664/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 12776/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.423975:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435180 with x1830964746817664 ext(4194304->4206591) 00010000:00010000:1.0:1746144665.423985:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 23 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.424008:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 23 pid: 29370 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144665.424016:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f435180 00000100:00100000:1.0:1746144665.424044:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 936 00000100:00100000:1.0:1746144665.424053:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746817664:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144665.424549:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746817664:12345-192.168.204.23@tcp:4:cat.0 Request processed in 495us (8531us total) trans 17179873349 rc 0/0 00000100:00100000:1.0:1746144665.424555:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 936 00002000:00100000:1.0:1746144665.424562:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4206591) req@ffff88009f435180 x1830964746817664/t17179873349(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 12776/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.424569:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435180 with x1830964746817664 ext(4194304->4206591) 00010000:00010000:1.0:1746144665.424573:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 25 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.424581:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 25 pid: 29370 timeout: 744 lvb_type: 0 00002000:00010000:1.0:1746144665.424588:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f435180 00000100:00100000:3.0:1746144665.424915:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746817408:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 13726us (14567us total) trans 17179873348 rc 0/0 00000100:00100000:3.0:1746144665.424923:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 935 00002000:00100000:3.0:1746144665.424929:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1507328->2097151) req@ffff88012e12d180 x1830964746817408/t17179873348(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.424936:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12d180 with x1830964746817408 ext(1507328->2097151) 00010000:00010000:3.0:1746144665.424942:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.424951:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.424956:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e12d180 00000100:00100000:0.0:1746144665.428381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.428783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.428850:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746817792 00000100:00100000:2.0:1746144665.428861:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746817792 00000100:00100000:1.0:1746144665.428864:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746817920 00000100:00100000:1.0:1746144665.428868:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746817920 00010000:00010000:2.0:1746144665.428900:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 25 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.428900:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.428942:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6085 00000100:00100000:1.0:1746144665.428949:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746817920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.428964:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144665.428982:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144664 -> 1746144666 00002000:00010000:1.0:1746144665.428985:0:16008:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144664 -> 1746144666 00010000:00010000:1.0:1746144665.428990:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.429010:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.429033:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87400/0xa7c849b16e01b301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e2 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.429052:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.429054:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.429061:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.429070:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.429078:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.429079:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144665.429083:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 12 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.429090:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 12 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.429121:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 12 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.429161:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747550720:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.429216:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6086 00000100:00100000:2.0:1746144665.429226:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746817792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.429235:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144665.429245:0:7100:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144665 -> 1746144666 00010000:00010000:1.0:1746144665.429247:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144665.429248:0:7100:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144665 -> 1746144666 00010000:00010000:2.0:1746144665.429252:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 25 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.429256:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747550848:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.429261:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 25 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.429274:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092459a00/0xa7c849b16e01b2ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6cd expref: 25 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.429275:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746144665.429297:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.429299:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.429304:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.429311:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.429329:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.429338:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747550976:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.429362:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.433053:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747550720:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144665.433066:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747550848:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144665.433088:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.433128:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746817920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4179us (4345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.433159:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6085 00000100:00100000:2.0:1746144665.434347:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747550976:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.434379:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.434423:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746817792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5199us (6051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.434431:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6086 00000100:00100000:0.0:1746144665.437824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.437873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.437939:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746818176 00000100:00100000:3.0:1746144665.437948:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746818432 00000100:00100000:1.0:1746144665.437949:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746818176 00000100:00100000:3.0:1746144665.437952:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746818432 00002000:00100000:3.0:1746144665.437993:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093760e00 x1830964746818432/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.437993:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2215936->2220031) req@ffff880093761c00 x1830964746818176/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.438012:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760e00 with x1830964746818432 ext(1048576->2097151) 00002000:00100000:1.0:1746144665.438012:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761c00 with x1830964746818176 ext(2215936->2220031) 00002000:00010000:3.0:1746144665.438017:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093760e00 00002000:00010000:1.0:1746144665.438017:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093761c00 00000100:00100000:1.0:1746144665.438051:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4692 00000100:00100000:1.0:1746144665.438059:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746818176:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144665.438289:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746818176:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 230us (474us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144665.438302:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4692 00002000:00100000:1.0:1746144665.438308:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2215936->2220031) req@ffff880093761c00 x1830964746818176/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.438315:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093761c00 with x1830964746818176 ext(2215936->2220031) 00002000:00010000:1.0:1746144665.438328:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093761c00 00000100:00100000:3.0:1746144665.438505:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4693 00000100:00100000:3.0:1746144665.438511:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746818432:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144665.444943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.445019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.445025:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746818688 00000100:00100000:2.0:1746144665.445036:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746818688 00000100:00100000:2.0:1746144665.445112:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4133 00000100:00100000:2.0:1746144665.445122:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:29323:x1830964746818688:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144665.445243:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746818944 00000100:00100000:3.0:1746144665.445248:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746818944 00002000:00100000:3.0:1746144665.445278:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093762680 x1830964746818944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.445288:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762680 with x1830964746818944 ext(1048576->2097151) 00002000:00010000:3.0:1746144665.445294:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093762680 00000100:00100000:3.0:1746144665.445323:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4694 00000100:00100000:3.0:1746144665.445329:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746818944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.445651:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:29323:x1830964746818688:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 530us (718us total) trans 8589944072 rc 0/0 00000100:00100000:2.0:1746144665.445658:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4133 00000100:00100000:0.0:1746144665.455810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.457107:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746819200 00000100:00100000:1.0:1746144665.457121:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746819200 00000100:00100000:1.0:1746144665.457229:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10180 00000100:00100000:1.0:1746144665.457239:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29326:x1830964746819200:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144665.457267:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.457287:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a000/0xa7c849b16e01b31d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f6fe expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.457404:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457419:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457431:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457444:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457450:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457455:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457559:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457567:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457573:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.457581:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144665.457661:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457667:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457672:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457678:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304b400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.457681:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457689:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457698:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.457701:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144665.457705:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457710:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304b400/0xa7c849b16e01b332 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457735:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457741:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457745:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457749:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304ac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.457751:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457755:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457761:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144665.457762:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.457765:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457769:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457777:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457782:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457786:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457790:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304a200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.457792:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457796:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457801:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35df00) 00010000:00010000:1.0:1746144665.457803:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.457805:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.457809:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01b32b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000100:00100000:3.0:1746144665.458912:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746818432:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 20393us (21031us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.458924:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4693 00002000:00100000:3.0:1746144665.458936:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093760e00 x1830964746818432/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.458945:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760e00 with x1830964746818432 ext(1048576->2097151) 00002000:00010000:3.0:1746144665.458950:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093760e00 00010000:00010000:1.0:1746144665.461382:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a000/0xa7c849b16e01b31d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6fe expref: 310 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.461397:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a000/0xa7c849b16e01b31d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6fe expref: 310 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.461412:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a000, rc 0) 00000100:00100000:1.0:1746144665.461493:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29326:x1830964746819200:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4253us (5692us total) trans 8589944073 rc 301/301 00000100:00100000:1.0:1746144665.461501:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10180 00000100:00100000:3.0:1746144665.464992:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746818944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19650us (19960us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.465017:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4694 00002000:00100000:3.0:1746144665.465031:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880093762680 x1830964746818944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.465041:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762680 with x1830964746818944 ext(1048576->2097151) 00002000:00010000:3.0:1746144665.465047:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093762680 00000100:00100000:0.0:1746144665.468556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.468794:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746819456 00000100:00100000:3.0:1746144665.468803:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746819456 00002000:00100000:3.0:1746144665.468851:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2220032->3145727) req@ffff880093e31500 x1830964746819456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.468860:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31500 with x1830964746819456 ext(2220032->3145727) 00002000:00010000:3.0:1746144665.468865:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e31500 00000100:00100000:3.0:1746144665.468897:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4695 00000100:00100000:3.0:1746144665.468904:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746819456:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144665.480832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.480921:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746819584 00000100:00100000:2.0:1746144665.480931:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746819584 00000100:00100000:2.0:1746144665.481006:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12190 00000100:00100000:2.0:1746144665.481016:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29321:x1830964746819584:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.481035:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.481054:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f705 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.481088:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.481100:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.481102:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.481105:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.481149:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.481159:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.481170:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551104:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.481248:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.484278:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746819456:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15367us (15726us total) trans 0 rc 925696/925696 00000100:00100000:3.0:1746144665.484287:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4695 00002000:00100000:3.0:1746144665.484296:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2220032->3145727) req@ffff880093e31500 x1830964746819456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 925696/925696 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.484304:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31500 with x1830964746819456 ext(2220032->3145727) 00010000:00010000:3.0:1746144665.484312:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.484324:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.484330:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e31500 00000100:00100000:0.0:1746144665.484391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.484435:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746819712 00000100:00100000:3.0:1746144665.484441:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746819712 00002000:00100000:3.0:1746144665.484466:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2220031) req@ffff880093e32d80 x1830964746819712/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.484478:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32d80 with x1830964746819712 ext(2097152->2220031) 00010000:00010000:3.0:1746144665.484483:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.484491:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 12 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.484496:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e32d80 00000100:00100000:3.0:1746144665.484508:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 937 00000100:00100000:3.0:1746144665.484514:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746819712:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144665.484871:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551104:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.484911:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.484929:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7800, rc 0) 00000100:00100000:2.0:1746144665.484971:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29321:x1830964746819584:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3958us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.484979:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12190 00000100:00100000:3.0:1746144665.493372:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746819712:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8845us (8974us total) trans 17179873350 rc 0/0 00000100:00100000:3.0:1746144665.493385:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 937 00002000:00100000:3.0:1746144665.493398:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2220031) req@ffff880093e32d80 x1830964746819712/t17179873350(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.493407:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32d80 with x1830964746819712 ext(2097152->2220031) 00010000:00010000:3.0:1746144665.493421:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.493437:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.493443:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e32d80 00000100:00100000:0.0:1746144665.494093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.494152:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746819840 00000100:00100000:2.0:1746144665.494161:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746819840 00000100:00100000:2.0:1746144665.494219:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12191 00000100:00100000:2.0:1746144665.494227:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:29320:x1830964746819840:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.494248:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.494263:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f70c expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.494289:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.494296:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.494297:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.494300:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.494329:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.494339:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 25 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.494349:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747551232:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.494513:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.499530:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747551232:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.499573:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.499588:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7000, rc 0) 00000100:00100000:2.0:1746144665.499633:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:29320:x1830964746819840:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5408us (5542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.499641:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12191 00000100:00100000:0.0:1746144665.500381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.500415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.500480:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746819968 00000100:00100000:2.0:1746144665.500486:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746819968 00010000:00010000:2.0:1746144665.500521:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.500544:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746820096 00000100:00100000:3.0:1746144665.500549:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746820096 00000100:00100000:2.0:1746144665.500555:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6087 00000100:00100000:2.0:1746144665.500565:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746819968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746144665.500579:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3858432->4194303) req@ffff880093e31180 x1830964746820096/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746144665.500581:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746144665.500587:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31180 with x1830964746820096 ext(3858432->4194303) 00010000:00010000:3.0:1746144665.500593:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 26 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.500602:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 26 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.500604:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.500608:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e31180 00010000:00010000:2.0:1746144665.500613:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.500632:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 938 00010000:00010000:2.0:1746144665.500635:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6600/0xa7c849b16e01b316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2220031) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f7 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.500637:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746820096:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:2.0:1746144665.500650:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.500652:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.500659:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.500668:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.500696:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.500708:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747551360:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.500768:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.505661:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747551360:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.505697:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.505752:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746819968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5187us (5369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.505763:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6087 00000100:00100000:3.0:1746144665.507919:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746820096:12345-192.168.204.23@tcp:4:cat.0 Request processed in 7273us (7494us total) trans 21474840575 rc 0/0 00000100:00100000:3.0:1746144665.507931:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 938 00000100:00100000:0.0:1746144665.508524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:3.0:1746144665.508581:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3858432->4194303) req@ffff880093e31180 x1830964746820096/t21474840575(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.508593:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31180 with x1830964746820096 ext(3858432->4194303) 00010000:00010000:3.0:1746144665.508604:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.508620:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00002000:00010000:3.0:1746144665.508626:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e31180 00000100:00100000:3.0:1746144665.508740:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746820352 00000100:00100000:3.0:1746144665.508748:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746820352 00002000:00100000:3.0:1746144665.508778:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093e30a80 x1830964746820352/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.508785:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30a80 with x1830964746820352 ext(2097152->3145727) 00002000:00010000:3.0:1746144665.508789:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30a80 00000100:00100000:3.0:1746144665.508816:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4696 00000100:00100000:3.0:1746144665.508823:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746820352:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.511911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.512175:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746820480 00000100:00100000:3.0:1746144665.512183:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746820480 00010000:00010000:3.0:1746144665.512220:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.512261:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6088 00000100:00100000:3.0:1746144665.512273:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746820480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.512286:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144665.512307:0:7100:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144665 -> 1746144666 00002000:00010000:3.0:1746144665.512310:0:7100:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144665 -> 1746144666 00010000:00010000:3.0:1746144665.512315:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.512332:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.512356:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6c00/0xa7c849b16e01b24b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f680 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.512387:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.512389:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.512396:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.512406:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.512441:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.512452:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747551488:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.512521:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.518328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.518507:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746820736 00000100:00100000:1.0:1746144665.518516:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746820736 00002000:00100000:1.0:1746144665.518564:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093e31880 x1830964746820736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.518574:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31880 with x1830964746820736 ext(2097152->3145727) 00002000:00010000:1.0:1746144665.518579:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e31880 00000100:00100000:2.0:1746144665.518687:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747551488:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.518707:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.518757:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746820480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6488us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.518767:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6088 00000100:00100000:1.0:1746144665.519129:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4697 00000100:00100000:1.0:1746144665.519155:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746820736:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.523054:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746820352:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14218us (14519us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.523067:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4696 00002000:00100000:2.0:1746144665.523079:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093e30a80 x1830964746820352/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.523089:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30a80 with x1830964746820352 ext(2097152->3145727) 00002000:00010000:2.0:1746144665.523095:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30a80 00000100:00100000:1.0:1746144665.527294:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746820736:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8127us (8963us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144665.527307:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4697 00002000:00100000:1.0:1746144665.527317:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093e31880 x1830964746820736/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.527327:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31880 with x1830964746820736 ext(2097152->3145727) 00002000:00010000:1.0:1746144665.527333:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e31880 00000100:00100000:0.0:1746144665.529061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.529192:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746820864 00000100:00100000:2.0:1746144665.529201:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746820864 00000100:00100000:2.0:1746144665.529259:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12192 00000100:00100000:2.0:1746144665.529268:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29321:x1830964746820864:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.529288:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.529308:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f713 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.529337:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.529340:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.529347:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 28 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.529362:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 28 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.529372:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7600, rc 0) 00000100:00100000:2.0:1746144665.529427:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29321:x1830964746820864:12345-192.168.204.23@tcp:101:cat.0 Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.529432:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12192 00000100:00100000:0.0:1746144665.534676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.534875:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746820992 00000100:00100000:2.0:1746144665.534886:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746820992 00000100:00100000:2.0:1746144665.534941:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12193 00000100:00100000:2.0:1746144665.534949:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+13:29320:x1830964746820992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.534969:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.534987:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f71a expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.535023:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.535024:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.535032:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.535047:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.535057:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7400, rc 0) 00000100:00100000:2.0:1746144665.535113:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+14:29320:x1830964746820992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 164us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.535119:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12193 00000100:00100000:0.0:1746144665.541250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.541292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.541569:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746821248 00000100:00100000:1.0:1746144665.541580:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746821248 00002000:00100000:1.0:1746144665.541630:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093e30700 x1830964746821248/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.541640:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30700 with x1830964746821248 ext(3145728->4194303) 00002000:00010000:1.0:1746144665.541646:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30700 00000100:00100000:1.0:1746144665.542361:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746821504 00000100:00100000:1.0:1746144665.542367:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746821504 00002000:00100000:1.0:1746144665.542388:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093e32680 x1830964746821504/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.542395:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32680 with x1830964746821504 ext(3145728->4194303) 00002000:00010000:1.0:1746144665.542399:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e32680 00000100:00100000:2.0:1746144665.542440:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4698 00000100:00100000:2.0:1746144665.542464:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746821248:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.542556:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4699 00000100:00100000:0.0:1746144665.542564:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746821504:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.552555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.552593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.552623:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746821760 00000100:00100000:2.0:1746144665.552632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.552633:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746821760 00000100:00100000:2.0:1746144665.552656:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746822016 00000100:00100000:2.0:1746144665.552660:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746822016 00002000:00100000:3.0:1746144665.552679:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880099b8e680 x1830964746821760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.552680:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880099b8c380 x1830964746822016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.552689:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8e680 with x1830964746821760 ext(2097152->3145727) 00002000:00100000:2.0:1746144665.552689:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8c380 with x1830964746822016 ext(3145728->4194303) 00002000:00010000:3.0:1746144665.552695:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8e680 00002000:00010000:2.0:1746144665.552695:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8c380 00000100:00100000:2.0:1746144665.552717:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746822272 00000100:00100000:2.0:1746144665.552720:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746822272 00002000:00100000:2.0:1746144665.552734:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880099b8ed80 x1830964746822272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.552741:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ed80 with x1830964746822272 ext(3145728->4194303) 00002000:00010000:2.0:1746144665.552744:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8ed80 00000100:00100000:3.0:1746144665.553109:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4700 00000100:00100000:3.0:1746144665.553117:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746822016:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.553661:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4701 00000100:00100000:2.0:1746144665.553675:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746821760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.555907:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4702 00000100:00100000:2.0:1746144665.555932:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746822272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144665.558506:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746821504:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15933us (17201us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.558517:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4699 00002000:00100000:3.0:1746144665.558529:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093e32680 x1830964746821504/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.558539:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32680 with x1830964746821504 ext(3145728->4194303) 00002000:00010000:3.0:1746144665.558545:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e32680 00000100:00100000:3.0:1746144665.566609:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1963:x1830964746821248:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24149us (25358us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.566621:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4698 00002000:00100000:3.0:1746144665.566633:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093e30700 x1830964746821248/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.566642:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30700 with x1830964746821248 ext(3145728->4194303) 00002000:00010000:3.0:1746144665.566649:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30700 00000100:00100000:3.0:1746144665.573615:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746821760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19933us (21056us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144665.573628:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4701 00002000:00100000:3.0:1746144665.573645:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880099b8e680 x1830964746821760/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.573654:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8e680 with x1830964746821760 ext(2097152->3145727) 00002000:00010000:3.0:1746144665.573661:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8e680 00000100:00100000:0.0:1746144665.578623:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.579938:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746822528 00000100:00100000:3.0:1746144665.579951:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746822528 00002000:00100000:3.0:1746144665.580007:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093e30380 x1830964746822528/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.580016:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30380 with x1830964746822528 ext(4194304->4935679) 00002000:00010000:3.0:1746144665.580022:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30380 00000100:00100000:3.0:1746144665.580045:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4703 00000100:00100000:3.0:1746144665.580053:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746822528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.581773:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746822272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25849us (29132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.581782:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4702 00002000:00100000:2.0:1746144665.581791:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880099b8ed80 x1830964746822272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.581799:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ed80 with x1830964746822272 ext(3145728->4194303) 00002000:00010000:2.0:1746144665.581804:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8ed80 00000100:00100000:3.0:1746144665.583823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.583868:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746822784 00000100:00100000:1.0:1746144665.583877:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746822784 00000100:00100000:1.0:1746144665.583919:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10181 00000100:00100000:1.0:1746144665.583926:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:29329:x1830964746822784:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144665.583949:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.583967:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01b35c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f721 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.584077:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584089:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584100:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584111:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584116:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584120:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144665.584224:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746822016:12345-192.168.204.23@tcp:3:cat.0 Request processed in 31107us (31628us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144665.584233:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4700 00002000:00100000:0.0:1746144665.584241:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880099b8c380 x1830964746822016/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746144665.584244:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00002000:00100000:0.0:1746144665.584249:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8c380 with x1830964746822016 ext(3145728->4194303) 00010000:00010000:1.0:1746144665.584252:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00002000:00010000:0.0:1746144665.584253:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099b8c380 00010000:00010000:1.0:1746144665.584257:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.584265:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144665.584343:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584350:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584356:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584362:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.584366:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584372:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584383:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.584386:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144665.584391:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584396:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b371 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584416:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584421:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584426:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584430:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4865c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.584432:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584436:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584441:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144665.584443:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.584446:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584449:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584456:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584461:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584465:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584469:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.584472:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584476:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584481:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d900) 00010000:00010000:1.0:1746144665.584483:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.584485:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584489:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b36a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.584520:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01b35c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f721 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.584528:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01b35c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f721 expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.584535:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4865800, rc 0) 00000100:00100000:1.0:1746144665.584565:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:29329:x1830964746822784:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 638us (750us total) trans 8589944074 rc 301/301 00000100:00100000:1.0:1746144665.584571:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10181 00000100:00100000:2.0:1746144665.591184:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746822528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11080us (12521us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144665.591197:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4703 00002000:00100000:2.0:1746144665.591213:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093e30380 x1830964746822528/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.591222:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30380 with x1830964746822528 ext(4194304->4935679) 00002000:00010000:2.0:1746144665.591229:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e30380 00000100:00100000:0.0:1746144665.593869:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.596079:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823040 00000100:00100000:2.0:1746144665.596093:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823040 00002000:00100000:2.0:1746144665.596193:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093e32a00 x1830964746823040/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.596202:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32a00 with x1830964746823040 ext(4194304->4935679) 00002000:00010000:2.0:1746144665.596208:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e32a00 00000100:00100000:2.0:1746144665.596231:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4704 00000100:00100000:2.0:1746144665.596239:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746823040:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.597677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.597765:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823296 00000100:00100000:3.0:1746144665.597771:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823296 00000100:00100000:3.0:1746144665.597804:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4134 00000100:00100000:3.0:1746144665.597811:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:29320:x1830964746823296:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144665.598029:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:29320:x1830964746823296:12345-192.168.204.23@tcp:35:cat.0 Request processed in 218us (358us total) trans 8589944075 rc 0/0 00000100:00100000:3.0:1746144665.598036:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4134 00000100:00100000:2.0:1746144665.605325:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746823040:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9075us (11453us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144665.605340:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4704 00002000:00100000:2.0:1746144665.605353:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093e32a00 x1830964746823040/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.605362:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e32a00 with x1830964746823040 ext(4194304->4935679) 00002000:00010000:2.0:1746144665.605367:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e32a00 00000100:00100000:0.0:1746144665.605645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.605827:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823424 00000100:00100000:2.0:1746144665.605836:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823424 00000100:00100000:2.0:1746144665.605878:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12194 00000100:00100000:2.0:1746144665.605886:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29326:x1830964746823424:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144665.605901:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.605917:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f728 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.605944:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.605952:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.605958:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.605960:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.605963:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [303104->1048575] (req 303104->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.606002:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.606018:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 26 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.606030:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551616:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144665.606100:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.606108:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 13 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.606115:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.606288:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.610719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.610749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.610782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.610806:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823552 00000100:00100000:0.0:1746144665.610814:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823552 00000100:00100000:0.0:1746144665.610851:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12195 00000100:00100000:0.0:1746144665.610859:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746823552:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144665.610879:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144665.610898:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd86a00/0xa7c849b16e01b386 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f72f expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.610920:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.610931:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd86a00/0xa7c849b16e01b386 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f72f expref: 28 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144665.610941:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86a00/0xa7c849b16e01b386 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f72f expref: 28 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144665.610954:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd86a00, rc 0) 00000100:00100000:0.0:1746144665.611004:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746823552:12345-192.168.204.23@tcp:101:cat.0 Request processed in 145us (221us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144665.611010:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12195 00000100:00100000:1.0:1746144665.611030:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823680 00000100:00100000:1.0:1746144665.611034:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823680 00010000:00010000:1.0:1746144665.611053:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.611069:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823808 00000100:00100000:1.0:1746144665.611071:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823808 00010000:00010000:1.0:1746144665.611081:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.611093:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6089 00000100:00100000:1.0:1746144665.611097:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746823680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144665.611098:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6090 00000100:00100000:0.0:1746144665.611103:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746823808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.611107:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.611108:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.611126:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.611126:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.611160:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:2.0:1746144665.611391:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551616:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.611400:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551744:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144665.611984:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.612009:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092459800/0xa7c849b16e01b2bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6b8 expref: 14 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.612019:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.612041:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746823808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 938us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.612046:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6090 00010000:00010000:1.0:1746144665.612495:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305fea00/0xa7c849b16e01b2c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6c6 expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:2.0:1746144665.612499:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [303104->1048575] (req 303104->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.612507:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.612508:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.612515:0:22208:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.612527:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.612775:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.612801:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746823680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1702us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.612807:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6089 00010000:00010000:2.0:1746144665.613161:0:22208:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.613176:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551872:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.613275:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.614018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.614121:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746823936 00000100:00100000:2.0:1746144665.614127:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746823936 00000100:00100000:2.0:1746144665.614314:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12196 00000100:00100000:2.0:1746144665.614324:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746823936:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.614338:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.614350:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdadc00/0xa7c849b16e01b38d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f736 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.614381:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747552000:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144665.614636:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.615770:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747551872:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.615791:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdac400, rc 0) 00000100:00100000:2.0:1746144665.615832:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29326:x1830964746823424:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 9945us (10186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.615839:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12194 00002000:00010000:3.0:1746144665.616165:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144665 -> 1746144666 00002000:00010000:3.0:1746144665.616169:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144665 -> 1746144666 00000100:00100000:3.0:1746144665.616190:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747552000:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.616211:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdadc00/0xa7c849b16e01b38d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f736 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.616223:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdadc00/0xa7c849b16e01b38d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f736 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.616242:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdadc00, rc 0) 00000100:00100000:3.0:1746144665.616267:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746823936:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1946us (2250us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.616273:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12196 00000100:00100000:0.0:1746144665.619432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.619557:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746824192 00000100:00100000:2.0:1746144665.619566:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746824192 00002000:00100000:2.0:1746144665.619627:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (303104->307199) req@ffff88009a2e8e00 x1830964746824192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.619643:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e8e00 with x1830964746824192 ext(303104->307199) 00002000:00010000:2.0:1746144665.619648:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2e8e00 00000100:00100000:2.0:1746144665.619680:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4705 00000100:00100000:2.0:1746144665.619689:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746824192:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.619863:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746824192:12345-192.168.204.23@tcp:3:cat.0 Request processed in 175us (441us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.619870:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4705 00002000:00100000:2.0:1746144665.619876:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (303104->307199) req@ffff88009a2e8e00 x1830964746824192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.619883:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e8e00 with x1830964746824192 ext(303104->307199) 00002000:00010000:2.0:1746144665.619885:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2e8e00 00000100:00100000:1.0:1746144665.628781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.630518:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746824320 00000100:00100000:3.0:1746144665.630532:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746824320 00000100:00100000:3.0:1746144665.630596:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12197 00000100:00100000:3.0:1746144665.630605:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29326:x1830964746824320:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.630627:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.630648:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f73d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.630680:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.630689:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.630695:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.630697:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.630701:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.630732:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.630749:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.630761:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747552128:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.630852:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.630859:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 26 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.630866:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747552256:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.630881:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.634071:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747552128:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.634087:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747552256:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.634118:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1236991] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.634165:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7ec00, rc 0) 00000100:00100000:3.0:1746144665.634207:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29326:x1830964746824320:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3603us (5437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.634216:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12197 00000100:00100000:0.0:1746144665.635628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.635800:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746824448 00000100:00100000:1.0:1746144665.635809:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746824448 00010000:00010000:1.0:1746144665.635844:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:1.0:1746144665.635882:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6091 00000100:00100000:1.0:1746144665.635890:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746824448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.635905:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.635928:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.635939:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.635960:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b2fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6db expref: 29 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:1.0:1746144665.636101:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.636157:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746824448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 242us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.636164:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6091 00000100:00100000:1.0:1746144665.636537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.636573:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746824576 00000100:00100000:0.0:1746144665.636576:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746824576 00010000:00010000:0.0:1746144665.636591:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 27 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144665.636606:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6092 00000100:00100000:0.0:1746144665.636611:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746824576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.636618:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.636628:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 27 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.636638:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 27 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.636651:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b2f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6d4 expref: 27 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:0.0:1746144665.636673:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.636675:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.636681:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.636690:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.636806:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.636819:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a2e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747552384:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.637152:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800998526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.640942:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a2e9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747552384:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.640968:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.641034:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746824576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4421us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.641048:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6092 00000100:00100000:0.0:1746144665.641938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.642783:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746824832 00000100:00100000:2.0:1746144665.642792:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746824832 00002000:00100000:2.0:1746144665.642855:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1232896->1236991) req@ffff88009a2e9880 x1830964746824832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.642865:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9880 with x1830964746824832 ext(1232896->1236991) 00002000:00010000:2.0:1746144665.642870:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9880 00000100:00100000:2.0:1746144665.642889:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4706 00000100:00100000:2.0:1746144665.642900:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746824832:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.643305:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746824832:12345-192.168.204.23@tcp:3:cat.0 Request processed in 407us (1369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.643312:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4706 00002000:00100000:2.0:1746144665.643317:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1232896->1236991) req@ffff88009a2e9880 x1830964746824832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.643324:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9880 with x1830964746824832 ext(1232896->1236991) 00002000:00010000:2.0:1746144665.643327:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9880 00000100:00100000:0.0:1746144665.648304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.648380:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825088 00000100:00100000:3.0:1746144665.648391:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825088 00000100:00100000:0.0:1746144665.648412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.648455:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12198 00000100:00100000:3.0:1746144665.648468:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:29329:x1830964746825088:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.648489:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.648509:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f744 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.648543:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.648552:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.648559:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.648560:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.648564:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2797568->3145727] (req 2797568->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.648594:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.648605:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.648617:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747552512:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.648700:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 24 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.648713:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 24 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.648721:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747552640:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.648738:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.648780:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825216 00000100:00100000:1.0:1746144665.648785:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825216 00000100:00100000:1.0:1746144665.648822:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4135 00000100:00100000:1.0:1746144665.648829:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29326:x1830964746825216:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144665.649336:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29326:x1830964746825216:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 506us (922us total) trans 8589944076 rc 0/0 00000100:00100000:1.0:1746144665.649343:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4135 00000100:00100000:3.0:1746144665.653630:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747552512:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.653642:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747552640:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.653676:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2797568->3145727] (req 2797568->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.653692:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f800, rc 0) 00000100:00100000:3.0:1746144665.653742:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:29329:x1830964746825088:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5272us (5442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.653750:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12198 00000100:00100000:0.0:1746144665.654464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.654847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.654918:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825344 00000100:00100000:3.0:1746144665.654925:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825344 00010000:00010000:3.0:1746144665.654954:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.654983:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825472 00000100:00100000:3.0:1746144665.654985:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825472 00010000:00010000:3.0:1746144665.655002:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 25 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.655019:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6093 00000100:00100000:3.0:1746144665.655025:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746825344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.655039:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.655063:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.655073:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.655095:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7400/0xa7c849b16e01b355 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f71a expref: 14 pid: 29370 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.655109:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.655129:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746825344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.655154:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6093 00000100:00100000:3.0:1746144665.655197:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6094 00000100:00100000:3.0:1746144665.655203:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746825472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.655208:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.655216:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 25 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.655224:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 25 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.655235:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7800/0xa7c849b16e01b340 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f705 expref: 25 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.655247:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.655249:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.655255:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.655262:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.655292:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.655472:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747552768:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.655920:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.661766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.661823:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747552768:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.661848:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.662024:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746825472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6818us (7174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.662034:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6094 00000100:00100000:2.0:1746144665.662173:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825728 00000100:00100000:2.0:1746144665.662180:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825728 00002000:00100000:2.0:1746144665.662234:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2797568->2801663) req@ffff88009a2ea680 x1830964746825728/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.662243:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2ea680 with x1830964746825728 ext(2797568->2801663) 00002000:00010000:2.0:1746144665.662248:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2ea680 00000100:00100000:2.0:1746144665.662263:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4707 00000100:00100000:2.0:1746144665.662269:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746825728:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144665.662426:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746825728:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 156us (671us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.662431:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4707 00002000:00100000:2.0:1746144665.662436:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2797568->2801663) req@ffff88009a2ea680 x1830964746825728/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.662443:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2ea680 with x1830964746825728 ext(2797568->2801663) 00002000:00010000:2.0:1746144665.662445:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2ea680 00000100:00100000:0.0:1746144665.668564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.668741:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825856 00000100:00100000:3.0:1746144665.668751:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825856 00000100:00100000:3.0:1746144665.668848:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12199 00000100:00100000:3.0:1746144665.668856:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:29329:x1830964746825856:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.668877:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.668896:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f74b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.668936:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.668945:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.668951:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.668953:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.668956:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2326527] (req 2097152->2326527) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.669000:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.669011:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.669023:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747552896:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.669181:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.669193:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.669202:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747553024:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.669234:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.670396:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747552896:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.670406:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747553024:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.670429:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->2326527] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.670442:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e200, rc 0) 00000100:00100000:3.0:1746144665.670482:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:29329:x1830964746825856:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1625us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.670488:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12199 00000100:00100000:0.0:1746144665.673918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.674640:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746825984 00000100:00100000:3.0:1746144665.674651:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746825984 00010000:00010000:3.0:1746144665.674692:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:0.0:1746144665.674770:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.675041:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746826112 00000100:00100000:3.0:1746144665.675045:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746826112 00010000:00010000:3.0:1746144665.675058:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00000100:00100000:3.0:1746144665.675088:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6095 00000100:00100000:3.0:1746144665.675094:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746825984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.675108:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.675153:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.675169:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.675192:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7600/0xa7c849b16e01b34e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f713 expref: 28 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.675212:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.675252:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746825984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 159us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.675258:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6095 00000100:00100000:3.0:1746144665.675274:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6096 00000100:00100000:3.0:1746144665.675278:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746826112:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.675287:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.675293:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.675302:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.675313:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a7000/0xa7c849b16e01b347 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f70c expref: 27 pid: 22208 timeout: 744 lvb_type: 0 00010000:00010000:3.0:1746144665.675321:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.675323:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.675330:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.675338:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.675370:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.675382:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747553152:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.675437:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.676555:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747553152:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.676571:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.676590:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746826112:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1311us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.676597:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6096 00000100:00100000:0.0:1746144665.678027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.678117:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746826368 00000100:00100000:1.0:1746144665.678123:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746826368 00002000:00100000:1.0:1746144665.678187:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2322432->2326527) req@ffff88009a2eb480 x1830964746826368/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.678198:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2eb480 with x1830964746826368 ext(2322432->2326527) 00002000:00010000:1.0:1746144665.678202:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2eb480 00000100:00100000:1.0:1746144665.678547:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4708 00000100:00100000:1.0:1746144665.678553:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746826368:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144665.678816:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746826368:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 263us (795us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144665.678820:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4708 00002000:00100000:1.0:1746144665.678824:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2322432->2326527) req@ffff88009a2eb480 x1830964746826368/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.678829:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2eb480 with x1830964746826368 ext(2322432->2326527) 00002000:00010000:1.0:1746144665.678831:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2eb480 00000100:00100000:0.0:1746144665.681816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.681910:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746826624 00000100:00100000:1.0:1746144665.681923:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746826624 00000100:00100000:1.0:1746144665.681979:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4136 00000100:00100000:1.0:1746144665.681986:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:29329:x1830964746826624:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144665.682350:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:29329:x1830964746826624:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 363us (542us total) trans 8589944077 rc 0/0 00000100:00100000:1.0:1746144665.682357:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4136 00000100:00100000:0.0:1746144665.685213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.685287:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746826880 00000100:00100000:1.0:1746144665.685298:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746826880 00000100:00100000:1.0:1746144665.685370:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4137 00000100:00100000:1.0:1746144665.685379:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29287:x1830964746826880:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00080000:0.0:1746144665.685493:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144665.685623:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746826880:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 245us (499us total) trans 8589944078 rc 0/0 00000100:00100000:1.0:1746144665.685630:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4137 00000100:00100000:0.0:1746144665.686803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.686892:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746827136 00000100:00100000:1.0:1746144665.686897:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746827136 00000100:00100000:1.0:1746144665.686931:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4138 00000100:00100000:1.0:1746144665.686938:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29287:x1830964746827136:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:1.0:1746144665.687064:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29287:x1830964746827136:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 126us (263us total) trans 8589944079 rc 0/0 00000100:00100000:1.0:1746144665.687070:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4138 00010000:00010000:0.0:1746144665.721653:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144665.776341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.777815:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746827392 00000100:00100000:1.0:1746144665.777826:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746827392 00000100:00100000:1.0:1746144665.777890:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10182 00000100:00100000:1.0:1746144665.777899:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29336:x1830964746827392:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144665.777925:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.777949:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01b3a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f752 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.778083:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778097:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778108:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778121:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778126:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778132:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778237:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b3be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778243:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b3be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778247:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b3be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.778254:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144665.778329:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778335:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778340:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778345:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.778348:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778354:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778363:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144665.778365:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.778370:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778378:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b3b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778404:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778409:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778413:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778417:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4865200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.778419:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778424:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778431:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35df00) 00010000:00010000:1.0:1746144665.778433:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.778435:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778439:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b3b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.778474:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865800/0xa7c849b16e01b3a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f752 expref: 313 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.778487:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b3be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f752 expref: 312 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.778498:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.778500:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144665.778502:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864e00, rc 0) 00000100:00100000:1.0:1746144665.779100:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:29336:x1830964746827392:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1200us (2768us total) trans 8589944080 rc 0/0 00000100:00100000:1.0:1746144665.779107:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10182 00000100:00100000:2.0:1746144665.784423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.784635:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746827520 00000100:00100000:3.0:1746144665.784645:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746827520 00000100:00100000:3.0:1746144665.784706:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 642 00000100:00100000:3.0:1746144665.784715:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:1963:x1830964746827520:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.784733:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.784758:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b3be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f752 expref: 312 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.784792:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144665.784797:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144665.784841:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1963:x1830964746827520:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.784849:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 642 00000100:00100000:0.0:1746144665.795274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.795344:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746827776 00000100:00100000:2.0:1746144665.795354:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746827776 00002000:00100000:2.0:1746144665.795415:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1429504->1433599) req@ffff88009a2e9180 x1830964746827776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.795424:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9180 with x1830964746827776 ext(1429504->1433599) 00002000:00010000:2.0:1746144665.795430:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9180 00000100:00100000:2.0:1746144665.795462:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4709 00000100:00100000:2.0:1746144665.795472:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746827776:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144665.795663:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746827776:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 193us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144665.795670:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4709 00002000:00100000:2.0:1746144665.795675:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1429504->1433599) req@ffff88009a2e9180 x1830964746827776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.795683:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9180 with x1830964746827776 ext(1429504->1433599) 00002000:00010000:2.0:1746144665.795686:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9180 00000100:00100000:0.0:1746144665.800469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.800670:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746828032 00000100:00100000:1.0:1746144665.800681:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746828032 00002000:00100000:1.0:1746144665.800737:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1744896->1748991) req@ffff88009a2e9500 x1830964746828032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.800747:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9500 with x1830964746828032 ext(1744896->1748991) 00002000:00010000:1.0:1746144665.800752:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9500 00000100:00100000:1.0:1746144665.800790:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4710 00000100:00100000:1.0:1746144665.800799:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746828032:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144665.801299:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746828032:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 500us (841us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144665.801306:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4710 00002000:00100000:1.0:1746144665.801311:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1744896->1748991) req@ffff88009a2e9500 x1830964746828032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.801317:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9500 with x1830964746828032 ext(1744896->1748991) 00002000:00010000:1.0:1746144665.801319:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9500 00000100:00100000:0.0:1746144665.804326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.804392:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746828288 00000100:00100000:1.0:1746144665.804403:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746828288 00000100:00100000:1.0:1746144665.804687:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4139 00000100:00100000:1.0:1746144665.804697:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29336:x1830964746828288:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144665.804950:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:29336:x1830964746828288:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 255us (634us total) trans 8589944081 rc 0/0 00000100:00100000:1.0:1746144665.804957:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4139 00000100:00100000:0.0:1746144665.828788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.828866:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746828544 00000100:00100000:1.0:1746144665.828876:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746828544 00000100:00100000:1.0:1746144665.829068:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10183 00000100:00100000:1.0:1746144665.829078:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:29340:x1830964746828544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144665.829106:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.829125:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e01b3cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f759 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.829286:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829300:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829608:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829623:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829629:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829634:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829750:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865600/0xa7c849b16e01b3e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829759:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865600/0xa7c849b16e01b3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829765:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865600/0xa7c849b16e01b3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.829774:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144665.829862:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829869:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829876:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829881:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4865a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.829885:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829891:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829902:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144665.829904:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.829909:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829914:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b3d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829948:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829953:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829958:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829962:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.829964:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829969:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829975:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d900) 00010000:00010000:1.0:1746144665.829977:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.829979:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.829983:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b3da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.830369:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865e00/0xa7c849b16e01b3cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f759 expref: 23 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.830382:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865600/0xa7c849b16e01b3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f759 expref: 22 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.830388:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.830390:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144665.830393:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4865600, rc 0) 00000100:00100000:1.0:1746144665.830461:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:29340:x1830964746828544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1384us (1683us total) trans 8589944082 rc 0/0 00000100:00100000:1.0:1746144665.830468:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10183 00000100:00100000:0.0:1746144665.834751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.834792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.834837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.835182:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746828800 00000100:00100000:3.0:1746144665.835200:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746828800 00000100:00100000:2.0:1746144665.835217:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746828672 00000100:00100000:2.0:1746144665.835222:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746828672 00000100:00100000:3.0:1746144665.835254:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12200 00000100:00100000:3.0:1746144665.835262:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746828800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.835283:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.835302:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01b3ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f767 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.835313:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746828928 00000100:00100000:1.0:1746144665.835319:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746828928 00000100:00100000:1.0:1746144665.835354:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 643 00000100:00100000:1.0:1746144665.835360:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746828928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144665.835361:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747553280:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144665.835373:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.835395:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865600/0xa7c849b16e01b3e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f759 expref: 22 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.835410:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.835414:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.835456:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746828928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 96us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.835462:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 643 00000100:00100000:3.0:1746144665.835567:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.835623:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12201 00000100:00100000:2.0:1746144665.835632:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746828672:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.835641:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.835658:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdad600/0xa7c849b16e01b3f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f760 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.835687:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747553408:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144665.835726:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1240 going to sleep for 11 seconds 00002000:00010000:3.0:1746144665.839533:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144665 -> 1746144666 00002000:00010000:3.0:1746144665.839540:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144665 -> 1746144666 00000100:00100000:3.0:1746144665.839565:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747553280:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.839597:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01b3ef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f767 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.839610:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01b3ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f767 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.839634:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f000, rc 0) 00000100:00100000:2.0:1746144665.839748:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747553408:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.839778:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdad600/0xa7c849b16e01b3f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f760 expref: 14 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.839793:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad600/0xa7c849b16e01b3f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f760 expref: 14 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.839809:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdad600, rc 0) 00000100:00100000:2.0:1746144665.839846:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746828672:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4215us (5051us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.839854:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12201 00000100:00100000:3.0:1746144665.840010:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746828800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4748us (5268us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.840016:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12200 00000100:00100000:1.0:1746144665.840640:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.840889:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829056 00000100:00100000:3.0:1746144665.840897:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829056 00000100:00100000:3.0:1746144665.840942:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12202 00000100:00100000:3.0:1746144665.840950:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746829056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.840966:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144665.841103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.841168:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829184 00000100:00100000:2.0:1746144665.841172:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829184 00000100:00100000:2.0:1746144665.841204:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12203 00000100:00100000:2.0:1746144665.841209:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746829184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.841211:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b3fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f76e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.841217:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.841226:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdadc00/0xa7c849b16e01b404 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f775 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.841258:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747553664:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144665.841258:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747553536:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144665.841690:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.841690:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.842279:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.842319:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829312 00000100:00100000:2.0:1746144665.842323:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829312 00000100:00100000:2.0:1746144665.842362:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12204 00000100:00100000:2.0:1746144665.842370:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+13:29340:x1830964746829312:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144665.842380:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144665.842389:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f77c expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.842408:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.842416:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.842417:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144665.842421:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.842443:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.842455:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 25 pid: 22208 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144665.842464:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747553792:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.842591:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1000 going to sleep for 11 seconds 00002000:00010000:2.0:1746144665.843763:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144665 -> 1746144666 00000100:00100000:2.0:1746144665.843790:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747553536:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144665.843821:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdadc00/0xa7c849b16e01b404 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f775 expref: 28 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.843834:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdadc00/0xa7c849b16e01b404 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f775 expref: 28 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144665.843851:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdadc00, rc 0) 00000100:00100000:2.0:1746144665.843896:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746829184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2685us (2792us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144665.843904:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12203 00000100:00100000:3.0:1746144665.844312:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747553664:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.844335:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b3fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f76e expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.844344:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b3fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f76e expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.844352:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e000, rc 0) 00000100:00100000:3.0:1746144665.844510:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746829056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3559us (3871us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.844516:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12202 00000100:00100000:3.0:1746144665.844571:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747553792:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.844590:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.844602:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdad400, rc 0) 00000100:00100000:3.0:1746144665.844808:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:29340:x1830964746829312:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2438us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.844814:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12204 00000100:00100000:0.0:1746144665.846291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.846442:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829440 00000100:00100000:2.0:1746144665.846451:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829440 00002000:00100000:2.0:1746144665.846502:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (303104->1048575) req@ffff8800a50e1880 x1830964746829440/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.846511:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e1880 with x1830964746829440 ext(303104->1048575) 00010000:00010000:2.0:1746144665.846520:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 24 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144665.846533:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 24 pid: 22208 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144665.846539:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a50e1880 00000100:00100000:2.0:1746144665.846568:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 939 00000100:00100000:2.0:1746144665.846576:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746829440:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:2.0:1746144665.851725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.851901:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829568 00000100:00100000:3.0:1746144665.851912:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829568 00000100:00100000:3.0:1746144665.851971:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12205 00000100:00100000:3.0:1746144665.851980:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29343:x1830964746829568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.852012:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.852031:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f783 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.852060:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.852066:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 27 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.852079:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 27 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.852089:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f600, rc 0) 00000100:00100000:3.0:1746144665.852601:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29343:x1830964746829568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 621us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.852608:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12205 00000100:00100000:2.0:1746144665.856921:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746829440:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 10334us (10624us total) trans 17179873351 rc 0/0 00000100:00100000:2.0:1746144665.856934:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 939 00002000:00100000:2.0:1746144665.856948:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (303104->1048575) req@ffff8800a50e1880 x1830964746829440/t17179873351(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.856966:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e1880 with x1830964746829440 ext(303104->1048575) 00010000:00010000:2.0:1746144665.856976:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144665.856998:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144665.857006:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a50e1880 00000100:00100000:0.0:1746144665.860961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.861078:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829696 00000100:00100000:3.0:1746144665.861089:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829696 00010000:00010000:3.0:1746144665.861131:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144665.861194:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6097 00000100:00100000:3.0:1746144665.861202:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746829696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.861222:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.861246:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144665.861258:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144665.861283:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdac400/0xa7c849b16e01b37f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 303104->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f728 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144665.861306:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.861308:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.861316:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.861325:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.861334:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.861335:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.861338:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.861344:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.861375:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.861390:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747553920:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.861477:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 13 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.861484:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747554048:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.861500:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144665.866480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.866591:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747553920:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.866602:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747554048:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144665.866623:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.866737:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746829952 00000100:00100000:2.0:1746144665.866745:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746829952 00002000:00100000:2.0:1746144665.866808:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800943f9500 x1830964746829952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.866817:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9500 with x1830964746829952 ext(0->1048575) 00002000:00010000:2.0:1746144665.866823:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9500 00000100:00100000:2.0:1746144665.866845:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4711 00000100:00100000:2.0:1746144665.866855:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746829952:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144665.868362:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746829696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7151us (7403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.868375:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6097 00000100:00100000:1.0:1746144665.872573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.872612:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746830336 00000100:00100000:1.0:1746144665.872620:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746830336 00002000:00100000:1.0:1746144665.872666:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800943f9f80 x1830964746830336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.872676:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9f80 with x1830964746830336 ext(0->1048575) 00002000:00010000:1.0:1746144665.872682:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9f80 00000100:00100000:1.0:1746144665.872711:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4712 00000100:00100000:1.0:1746144665.872718:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746830336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144665.878201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.879997:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746830464 00000100:00100000:2.0:1746144665.880011:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746830464 00002000:00100000:2.0:1746144665.880078:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1236992->2097151) req@ffff88009ee0b800 x1830964746830464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 504/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.880089:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b800 with x1830964746830464 ext(1236992->2097151) 00002000:00010000:2.0:1746144665.880095:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee0b800 00000100:00100000:2.0:1746144665.880128:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4713 00000100:00100000:2.0:1746144665.880149:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746830464:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144665.889803:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746829952:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22938us (23324us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.889817:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4711 00002000:00100000:2.0:1746144665.889830:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800943f9500 x1830964746829952/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.889839:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9500 with x1830964746829952 ext(0->1048575) 00002000:00010000:2.0:1746144665.889845:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9500 00000100:00100000:1.0:1746144665.893384:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746830336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20655us (20810us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144665.893396:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4712 00002000:00100000:1.0:1746144665.893407:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800943f9f80 x1830964746830336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.893416:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f9f80 with x1830964746830336 ext(0->1048575) 00002000:00010000:1.0:1746144665.893421:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f9f80 00000100:00100000:2.0:1746144665.896100:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746830464:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15951us (17895us total) trans 0 rc 540672/540672 00000100:00100000:2.0:1746144665.896112:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4713 00002000:00100000:2.0:1746144665.896124:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1236992->2097151) req@ffff88009ee0b800 x1830964746830464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 504/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.896160:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee0b800 with x1830964746830464 ext(1236992->2097151) 00002000:00010000:2.0:1746144665.896166:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee0b800 00000100:00100000:0.0:1746144665.913664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.913708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.913759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.913807:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746830592 00000100:00100000:0.0:1746144665.913816:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746830592 00000100:00100000:0.0:1746144665.913874:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746830848 00000100:00100000:0.0:1746144665.913876:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746830848 00000100:00100000:0.0:1746144665.913897:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746830720 00000100:00100000:0.0:1746144665.913899:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746830720 00000100:00100000:0.0:1746144665.913915:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12206 00000100:00100000:0.0:1746144665.913924:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:29340:x1830964746830592:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144665.913935:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12207 00000100:00100000:3.0:1746144665.913945:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746830848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144665.913946:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.913954:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.913965:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01b420 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f798 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.913965:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f78a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.914001:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.914009:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144665.914011:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144665.914014:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.914037:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747554176:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144665.914037:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.914048:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 28 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144665.914056:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747554304:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.914115:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12208 00000100:00100000:1.0:1746144665.914123:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746830720:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144665.914125:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746144665.914131:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.914163:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4864400/0xa7c849b16e01b427 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f791 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144665.914191:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747554432:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144665.915841:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.915886:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.922735:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747554304:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144665.922773:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.922790:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4fc00, rc 0) 00000100:00100000:0.0:1746144665.922836:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:29340:x1830964746830592:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8912us (9184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.922845:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12206 00000100:00100000:1.0:1746144665.923211:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747554432:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144665.923237:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4864400/0xa7c849b16e01b427 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f791 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.923247:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4864400/0xa7c849b16e01b427 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f791 expref: 27 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144665.923267:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864400, rc 0) 00000100:00100000:1.0:1746144665.923305:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746830720:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9184us (9550us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144665.923312:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12208 00000100:00100000:3.0:1746144665.923410:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747554176:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144665.923436:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01b420 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f798 expref: 28 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.923445:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7f000/0xa7c849b16e01b420 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f798 expref: 28 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.923457:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f000, rc 0) 00000100:00100000:3.0:1746144665.923474:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746830848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9532us (9766us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144665.923480:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12207 00000100:00100000:0.0:1746144665.924722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.924789:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746830976 00000100:00100000:2.0:1746144665.924797:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746830976 00002000:00100000:2.0:1746144665.924851:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1748991) req@ffff8800a50e2a00 x1830964746830976/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 504/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.924881:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e2a00 with x1830964746830976 ext(1048576->1748991) 00010000:00010000:2.0:1746144665.924890:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 27 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144665.924903:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 27 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144665.924914:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a50e2a00 00000100:00100000:2.0:1746144665.924938:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 940 00000100:00100000:2.0:1746144665.924946:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746830976:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144665.928486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.928594:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746831360 00000100:00100000:3.0:1746144665.928603:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746831360 00000100:00100000:3.0:1746144665.928650:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12209 00000100:00100000:3.0:1746144665.928658:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29343:x1830964746831360:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144665.928679:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.928697:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7a6 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.928728:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.928736:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.928737:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144665.928740:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 27 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.928771:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.928784:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 13 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144665.928797:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747554560:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.928863:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.929037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.929269:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746831232 00000100:00100000:1.0:1746144665.929272:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746831232 00000100:00100000:1.0:1746144665.929301:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10184 00000100:00100000:1.0:1746144665.929306:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:29345:x1830964746831232:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144665.929319:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144665.929329:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f79f expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.929409:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.929422:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 311 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.929429:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 22 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.929434:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.929450:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 22 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.931596:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 22 pid: 14710 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144665.931613:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747554688:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144665.931703:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 311 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.931711:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 311 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144665.931719:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747554816:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.931737:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.933071:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747554560:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.933100:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 27 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.933117:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e800, rc 0) 00000100:00100000:3.0:1746144665.933168:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29343:x1830964746831360:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4510us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.933178:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12209 00000100:00100000:1.0:1746144665.933288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.933655:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746831488 00000100:00100000:0.0:1746144665.933662:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746831488 00002000:00100000:0.0:1746144665.933697:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2797568->3145727) req@ffff8800943fa300 x1830964746831488/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.933707:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fa300 with x1830964746831488 ext(2797568->3145727) 00010000:00010000:0.0:1746144665.933713:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 14 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.933724:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 14 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144665.933730:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943fa300 00000100:00100000:0.0:1746144665.933746:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 941 00000100:00100000:0.0:1746144665.933751:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746831488:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144665.936306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.936836:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747554688:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144665.936848:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747554816:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144665.936873:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144665.937604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.937667:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746831744 00000100:00100000:1.0:1746144665.937674:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746831744 00010000:00010000:1.0:1746144665.937707:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 312 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144665.937731:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746831616 00000100:00100000:1.0:1746144665.937734:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746831616 00010000:00010000:1.0:1746144665.937743:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 23 pid: 14710 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144665.937762:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6098 00000100:00100000:1.0:1746144665.937768:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+312:1960:x1830964746831744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.937782:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.937788:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 312 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144665.937798:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 312 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144665.937820:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b5600/0xa7c849b16e01b125 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5c3 expref: 312 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144665.937837:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.937842:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.937850:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.937855:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.937891:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:1960:x1830964746831744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 123us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.937898:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6098 00000100:00100000:1.0:1746144665.937947:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6099 00000100:00100000:1.0:1746144665.937952:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746831616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.937958:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.937963:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 23 pid: 14710 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144665.937970:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 23 pid: 14710 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144665.937981:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b179 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f5e6 expref: 23 pid: 14710 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144665.937999:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.938002:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.938009:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.938015:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.938032:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.938047:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746831616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 95us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.938053:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6099 00010000:00010000:1.0:1746144665.938071:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.938076:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.938096:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144665.938248:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 23 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.938265:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 22 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.938271:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.938273:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746144665.938276:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864e00, rc 0) 00000100:00100000:1.0:1746144665.938298:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:29345:x1830964746831232:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8991us (9261us total) trans 8589944083 rc 0/0 00000100:00100000:1.0:1746144665.938304:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10184 00000100:00100000:0.0:1746144665.941895:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746830976:12345-192.168.204.23@tcp:4:cat.0 Request processed in 16938us (17166us total) trans 21474840576 rc 0/0 00000100:00100000:0.0:1746144665.941908:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 940 00002000:00100000:0.0:1746144665.941920:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1748991) req@ffff8800a50e2a00 x1830964746830976/t21474840576(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 504/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.941930:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e2a00 with x1830964746830976 ext(1048576->1748991) 00010000:00010000:0.0:1746144665.941940:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.941953:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144665.941961:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a50e2a00 00000100:00100000:2.0:1746144665.945410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.945458:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746831872 00000100:00100000:3.0:1746144665.945468:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746831872 00000100:00100000:3.0:1746144665.945523:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12210 00000100:00100000:3.0:1746144665.945531:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+16:29345:x1830964746831872:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.945550:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.945569:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7ad expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.945601:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.945615:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.945621:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.945623:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.945626:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [81920->126975] (req 81920->126975) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.945658:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.945669:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 26 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144665.945681:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747554944:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.945763:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.945771:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 17 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144665.945780:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747555072:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.945798:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144665.945995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.946018:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746832000 00000100:00100000:3.0:1746144665.946022:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746832000 00010000:00010000:3.0:1746144665.946041:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144665.946059:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6100 00000100:00100000:3.0:1746144665.946065:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746832000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144665.946073:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144665.946093:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144665.946103:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144665.946122:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7ec00/0xa7c849b16e01b394 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f73d expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144665.946157:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.946159:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.946166:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.946173:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.946197:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144665.946206:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747555200:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144665.946237:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.946255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.946435:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746832256 00000100:00100000:1.0:1746144665.946440:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746832256 00000100:00100000:1.0:1746144665.946481:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10185 00000100:00100000:1.0:1746144665.946488:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+311:29347:x1830964746832256:12345-192.168.204.23@tcp:101:multiop.0 00000100:00100000:0.0:1746144665.946488:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746831488:12345-192.168.204.23@tcp:4:cat.0 Request processed in 12364us (12835us total) trans 17179873352 rc 0/0 00000100:00100000:0.0:1746144665.946499:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 941 00010000:00010000:1.0:1746144665.946501:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746144665.946508:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2797568->3145727) req@ffff8800943fa300 x1830964746831488/t17179873352(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746144665.946513:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7b4 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746144665.946517:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fa300 with x1830964746831488 ext(2797568->3145727) 00010000:00010000:0.0:1746144665.946524:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 18 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.946533:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 18 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144665.946540:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800943fa300 00010000:00010000:1.0:1746144665.946600:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946611:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946621:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946634:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946742:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946748:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946850:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946858:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946864:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144665.946873:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144665.946944:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946950:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946956:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946962:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.946965:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946971:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.946979:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144665.946982:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.946996:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947001:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947018:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947023:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947028:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947032:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144665.947035:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947039:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947045:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d900) 00010000:00010000:1.0:1746144665.947047:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144665.947049:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947053:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b45f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144665.947084:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 314 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.947098:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 313 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.947103:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144665.947105:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144665.947107:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4865c00, rc 0) 00000100:00100000:1.0:1746144665.947128:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:29347:x1830964746832256:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 642us (875us total) trans 8589944084 rc 0/0 00000100:00100000:1.0:1746144665.947151:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10185 00000100:00100000:3.0:1746144665.952287:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747554944:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.952300:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747555072:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.952333:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [81920->126975] (req 81920->126975) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.952351:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7ea00, rc 0) 00000100:00100000:3.0:1746144665.952410:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+17:29345:x1830964746831872:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6878us (7008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.952418:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12210 00000100:00100000:0.0:1746144665.952493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.952604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.952619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.952666:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746832384 00000100:00100000:0.0:1746144665.952672:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746832384 00010000:00010000:0.0:1746144665.952702:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 27 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144665.952722:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746832512 00000100:00100000:0.0:1746144665.952724:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746832512 00010000:00010000:0.0:1746144665.952736:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 17 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144665.952749:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746832640 00000100:00100000:0.0:1746144665.952751:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746832640 00010000:00010000:0.0:1746144665.952760:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 18 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144665.952771:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6101 00000100:00100000:0.0:1746144665.952777:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746832384:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.952790:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.952813:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 27 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.952824:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 27 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.952847:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f600/0xa7c849b16e01b412 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f783 expref: 27 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.952862:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.952882:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746832384:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 105us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.952888:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6101 00000100:00100000:0.0:1746144665.952899:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6102 00000100:00100000:0.0:1746144665.952904:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746832512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.952912:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.952919:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.952927:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.952939:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdad400/0xa7c849b16e01b40b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f77c expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.952947:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.952949:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.952956:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.952963:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.953004:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 17 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.953016:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747555328:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.953071:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.953088:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6103 00000100:00100000:0.0:1746144665.953094:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746832640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144665.953102:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144665.953113:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 17 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.953127:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 17 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.953156:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b39b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2797568->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f744 expref: 17 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144665.953165:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.953166:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144665.953170:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 25 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.953177:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 25 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144665.953194:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 25 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144665.953202:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747555456:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.953230:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144665.953311:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747555200:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144665.953322:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144665.953340:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746832000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7275us (7354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144665.953346:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6100 00000100:00100000:2.0:1746144665.957367:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747555328:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144665.957378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144665.957391:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.957444:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746832512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4538us (4838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.957455:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6102 00000100:00100000:1.0:1746144665.957539:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746833152 00000100:00100000:1.0:1746144665.957546:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746833152 00002000:00100000:1.0:1746144665.957591:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (81920->86015) req@ffff8800a50e1c00 x1830964746833152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.957599:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e1c00 with x1830964746833152 ext(81920->86015) 00002000:00010000:1.0:1746144665.957604:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a50e1c00 00000100:00100000:1.0:1746144665.957620:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4714 00000100:00100000:1.0:1746144665.957627:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746833152:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144665.957840:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+16:1963:x1830964746833152:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 213us (463us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144665.957845:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4714 00002000:00100000:1.0:1746144665.957850:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (81920->86015) req@ffff8800a50e1c00 x1830964746833152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144665.957855:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e1c00 with x1830964746833152 ext(81920->86015) 00002000:00010000:1.0:1746144665.957858:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a50e1c00 00000100:00100000:0.0:1746144665.960797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.960946:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747555456:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144665.960972:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144665.961023:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746832640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7928us (8401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.961032:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6103 00000100:00100000:2.0:1746144665.962241:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746832896 00000100:00100000:2.0:1746144665.962252:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746832896 00002000:00100000:2.0:1746144665.962310:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a50e3b80 x1830964746832896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.962319:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e3b80 with x1830964746832896 ext(1048576->2097151) 00002000:00010000:2.0:1746144665.962324:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a50e3b80 00000100:00100000:2.0:1746144665.962357:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4715 00000100:00100000:2.0:1746144665.962366:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746832896:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144665.964053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.965648:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746833408 00000100:00100000:3.0:1746144665.965660:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746833408 00002000:00100000:3.0:1746144665.965703:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (122880->126975) req@ffff8800a50e0e00 x1830964746833408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.965714:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e0e00 with x1830964746833408 ext(122880->126975) 00002000:00010000:3.0:1746144665.965719:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a50e0e00 00000100:00100000:3.0:1746144665.965741:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4716 00000100:00100000:3.0:1746144665.965748:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746833408:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144665.965892:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746833408:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 144us (1846us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144665.965898:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4716 00002000:00100000:3.0:1746144665.965904:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (122880->126975) req@ffff8800a50e0e00 x1830964746833408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.965911:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e0e00 with x1830964746833408 ext(122880->126975) 00002000:00010000:3.0:1746144665.965915:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a50e0e00 00000100:00100000:0.0:1746144665.966632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.966651:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746833664 00000100:00100000:0.0:1746144665.966655:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746833664 00002000:00100000:0.0:1746144665.966681:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012cfb8000 x1830964746833664/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144665.966689:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8000 with x1830964746833664 ext(2097152->3145727) 00002000:00010000:0.0:1746144665.966693:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfb8000 00000100:00100000:0.0:1746144665.966704:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4717 00000100:00100000:0.0:1746144665.966709:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746833664:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144665.979277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144665.979351:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746833792 00000100:00100000:3.0:1746144665.979361:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746833792 00000100:00100000:3.0:1746144665.979425:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12211 00000100:00100000:3.0:1746144665.979438:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29347:x1830964746833792:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144665.979459:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144665.979479:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7bb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.979509:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.979518:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.979525:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 29 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.979532:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.979534:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144665.979537:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 29 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.979569:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 29 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.979580:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 29 pid: 29370 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144665.979598:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747555584:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.979707:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.979715:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 28 pid: 8450 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144665.979723:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747555712:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.979747:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144665.979754:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 8 pid: 10724 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144665.979760:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747555840:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144665.979774:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.981450:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746833664:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14735us (14813us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.981461:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4717 00002000:00100000:2.0:1746144665.981471:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012cfb8000 x1830964746833664/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.981480:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8000 with x1830964746833664 ext(2097152->3145727) 00002000:00010000:2.0:1746144665.981484:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfb8000 00000100:00100000:1.0:1746144665.990174:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.990219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144665.990262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.990287:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834048 00000100:00100000:2.0:1746144665.990296:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834048 00010000:00010000:2.0:1746144665.990349:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 9 pid: 10724 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746144665.990361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.990374:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746833920 00000100:00100000:2.0:1746144665.990376:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746833920 00000100:00100000:1.0:1746144665.990379:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834304 00000100:00100000:1.0:1746144665.990381:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834304 00010000:00010000:2.0:1746144665.990388:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 31 pid: 29370 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746144665.990399:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834176 00000100:00100000:2.0:1746144665.990401:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834176 00000100:00100000:1.0:1746144665.990402:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12212 00010000:00010000:2.0:1746144665.990410:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 29 pid: 8450 timeout: 745 lvb_type: 1 00000100:00100000:1.0:1746144665.990410:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29343:x1830964746834304:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144665.990426:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144665.990435:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6104 00000100:00100000:2.0:1746144665.990440:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746834048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144665.990442:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7c2 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.990453:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144665.990462:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.990469:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144665.990470:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144665.990473:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 32 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.990474:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 9 pid: 10724 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144665.990484:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 9 pid: 10724 timeout: 745 lvb_type: 1 00010000:00010000:1.0:1746144665.990502:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.990506:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144665.990516:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144665.990526:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a2ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747555968:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144665.990544:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746834048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 105us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.990550:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6104 00000100:00100000:2.0:1746144665.990564:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6105 00000100:00100000:1.0:1746144665.990566:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.990569:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746833920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.990577:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144665.990583:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 32 pid: 29370 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144665.990590:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 32 pid: 29370 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144665.990598:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.990612:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746833920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.990617:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6105 00000100:00100000:2.0:1746144665.990660:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6106 00000100:00100000:2.0:1746144665.990667:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746834176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144665.990672:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144665.990678:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 29 pid: 8450 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144665.990686:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 29 pid: 8450 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144665.990697:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.990698:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144665.990710:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 31 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.990720:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 31 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144665.990744:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 31 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144665.990752:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747556096:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144665.990775:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144665.991363:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746832896:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 28997us (31414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144665.991371:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4715 00002000:00100000:2.0:1746144665.991378:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a50e3b80 x1830964746832896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/440 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.991386:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e3b80 with x1830964746832896 ext(1048576->2097151) 00002000:00010000:2.0:1746144665.991390:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a50e3b80 00010000:00010000:3.0:1746144665.991490:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930b4400/0xa7c849b16e01b0a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f576 expref: 31 pid: 29370 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144665.991514:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747555584:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.991523:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135782400/0xa7c849b16e01b0ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f592 expref: 27 pid: 8450 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144665.991536:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747555712:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.991543:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b05a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f530 expref: 8 pid: 10724 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144665.991548:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747555840:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144665.991569:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 30 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144665.991580:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a200, rc 0) 00000100:00100000:3.0:1746144665.991628:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29347:x1830964746833792:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 12191us (12363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144665.991636:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12211 00000100:00100000:1.0:1746144665.993394:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a2ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747555968:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144665.993423:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144665.993440:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864800, rc 0) 00000100:00100000:1.0:1746144665.993476:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29343:x1830964746834304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3067us (3113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144665.993484:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12212 00000100:00100000:2.0:1746144665.993767:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747556096:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144665.993790:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144665.993813:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746834176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3147us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144665.993824:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6106 00000100:00100000:0.0:1746144665.995463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144665.995505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144665.995577:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834432 00000100:00100000:2.0:1746144665.995585:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834432 00002000:00100000:2.0:1746144665.995633:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2326527) req@ffff88012cfb8380 x1830964746834432/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.995643:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8380 with x1830964746834432 ext(2097152->2326527) 00010000:00010000:2.0:1746144665.995652:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 26 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144665.995666:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 26 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144665.995673:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cfb8380 00000100:00100000:2.0:1746144665.995935:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834688 00000100:00100000:2.0:1746144665.995939:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834688 00000100:00100000:1.0:1746144665.995974:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 942 00000100:00100000:1.0:1746144665.995998:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746834432:12345-192.168.204.23@tcp:4:multiop.0 00002000:00100000:2.0:1746144665.996105:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1810432->1814527) req@ffff88012cfb8700 x1830964746834688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/0 e 0 to 0 dl 1746144676 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144665.996113:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8700 with x1830964746834688 ext(1810432->1814527) 00002000:00010000:2.0:1746144665.996117:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfb8700 00000100:00100000:3.0:1746144665.996182:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4718 00000100:00100000:3.0:1746144665.996200:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746834688:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144665.996372:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746834688:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 179us (864us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144665.996378:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4718 00002000:00100000:3.0:1746144665.996385:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1810432->1814527) req@ffff88012cfb8700 x1830964746834688/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:306/0 lens 488/4536 e 0 to 0 dl 1746144676 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144665.996394:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8700 with x1830964746834688 ext(1810432->1814527) 00002000:00010000:3.0:1746144665.996399:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfb8700 00000100:00100000:0.0:1746144666.000975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.001316:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834816 00000100:00100000:1.0:1746144666.001325:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834816 00000100:00100000:1.0:1746144666.001381:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12213 00000100:00100000:1.0:1746144666.001390:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+28:29340:x1830964746834816:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.001407:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.001425:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7c9 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.001459:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 28 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.001468:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144666.001469:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144666.001473:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.001503:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 28 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.001514:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 28 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.001525:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a2ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747556224:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144666.001606:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00000100:00080000:0.0:1746144666.001684:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144666.003480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.003572:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746834944 00000100:00100000:3.0:1746144666.003580:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746834944 00000100:00080000:0.0:1746144666.003604:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144666.003637:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12214 00000100:00100000:3.0:1746144666.003644:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29347:x1830964746834944:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.003657:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.003669:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7d0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.003695:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.003703:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.003710:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.003712:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.003715:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 27 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.003744:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 14 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.003754:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 14 pid: 29370 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.003763:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747556352:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.003830:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.003843:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.003851:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747556480:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.003869:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.004763:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a2ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747556224:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144666.004787:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 29 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.004799:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864000, rc 0) 00000100:00100000:1.0:1746144666.004835:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+29:29340:x1830964746834816:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3448us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.004841:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12213 00000100:00100000:0.0:1746144666.005312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.005878:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+29:1961:x1830964746834432:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 9894us (10419us total) trans 21474840577 rc 0/0 00000100:00100000:1.0:1746144666.005891:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 942 00002000:00100000:1.0:1746144666.005900:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2326527) req@ffff88012cfb8380 x1830964746834432/t21474840577(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:306/0 lens 488/448 e 0 to 0 dl 1746144676 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.005909:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8380 with x1830964746834432 ext(2097152->2326527) 00010000:00010000:1.0:1746144666.005917:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.005929:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746144666.005935:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cfb8380 00000100:00100000:1.0:1746144666.005950:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746835072 00000100:00100000:1.0:1746144666.005954:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746835072 00002000:00100000:1.0:1746144666.006001:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1810432->2097151) req@ffff88012cfb8e00 x1830964746835072/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.006008:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8e00 with x1830964746835072 ext(1810432->2097151) 00010000:00010000:1.0:1746144666.006012:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.006020:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746144666.006026:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cfb8e00 00000100:00100000:1.0:1746144666.006040:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 943 00000100:00100000:1.0:1746144666.006046:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746835072:12345-192.168.204.23@tcp:4:multiop.0 00000100:00080000:0.0:1746144666.006382:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144666.009333:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747556480:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.009333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.009344:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747556352:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.009374:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->1089535] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 27 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.009392:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c18000, rc 0) 00000100:00100000:3.0:1746144666.009438:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29347:x1830964746834944:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5795us (5966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.009445:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12214 00000100:00100000:1.0:1746144666.009629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.009675:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746835200 00000100:00100000:0.0:1746144666.009681:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746835200 00010000:00010000:0.0:1746144666.009730:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 15 pid: 29370 timeout: 745 lvb_type: 0 00000100:00080000:1.0:1746144666.009940:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144666.010175:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746835328 00000100:00100000:2.0:1746144666.010179:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746835328 00010000:00010000:2.0:1746144666.010208:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.010225:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6107 00000100:00100000:2.0:1746144666.010233:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746835200:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.010248:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.010268:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 15 pid: 29370 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.010279:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 15 pid: 29370 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.010300:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4272800/0xa7c849b16e01b30f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6f0 expref: 15 pid: 29370 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.010318:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.010351:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746835200:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 118us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.010357:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6107 00000100:00100000:2.0:1746144666.010368:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6108 00000100:00100000:2.0:1746144666.010374:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746835328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.010382:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.010388:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.010397:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.010407:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6400/0xa7c849b16e01b308 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f6e9 expref: 27 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.010420:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.010422:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.010429:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.010438:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.010467:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 26 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.010478:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747556608:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.011584:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.012183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.012225:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746835456 00000100:00100000:0.0:1746144666.012231:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746835456 00010000:00010000:0.0:1746144666.012259:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144666.012278:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6109 00000100:00100000:0.0:1746144666.012286:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746835456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.012297:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144666.012316:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.012325:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.012343:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e7e200/0xa7c849b16e01b3a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f74b expref: 29 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.012366:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.012368:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.012373:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.012380:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.012403:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 30 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.012412:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cfb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747556736:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144666.012457:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.015750:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746835072:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 9692us (10427us total) trans 21474840578 rc 0/0 00000100:00100000:2.0:1746144666.015763:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 943 00002000:00100000:2.0:1746144666.015775:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1810432->2097151) req@ffff88012cfb8e00 x1830964746835072/t21474840578(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.015785:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb8e00 with x1830964746835072 ext(1810432->2097151) 00010000:00010000:2.0:1746144666.015796:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 31 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.015810:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 31 pid: 8389 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.015823:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cfb8e00 00000100:00100000:0.0:1746144666.015968:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.016050:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746835712 00000100:00100000:3.0:1746144666.016059:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746835712 00002000:00100000:3.0:1746144666.016095:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1085440->1089535) req@ffff88012cfb9880 x1830964746835712/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.016104:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb9880 with x1830964746835712 ext(1085440->1089535) 00002000:00010000:3.0:1746144666.016108:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfb9880 00000100:00100000:3.0:1746144666.016161:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4719 00000100:00100000:3.0:1746144666.016169:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746835712:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144666.016322:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746835712:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 153us (354us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144666.016328:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4719 00002000:00100000:3.0:1746144666.016333:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1085440->1089535) req@ffff88012cfb9880 x1830964746835712/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.016340:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb9880 with x1830964746835712 ext(1085440->1089535) 00002000:00010000:3.0:1746144666.016343:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfb9880 00000100:00100000:1.0:1746144666.016731:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cfb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747556736:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144666.016751:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.016785:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746835456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4499us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.016794:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6109 00000100:00100000:2.0:1746144666.017839:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747556608:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.018094:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.018170:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746835328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7795us (8540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.018178:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6108 00000100:00100000:0.0:1746144666.020445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.020482:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.020526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.020554:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746835968 00000100:00100000:2.0:1746144666.020564:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746835968 00002000:00100000:2.0:1746144666.020624:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012cfb9c00 x1830964746835968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.020634:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb9c00 with x1830964746835968 ext(2097152->3145727) 00002000:00010000:2.0:1746144666.020639:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfb9c00 00000100:00100000:3.0:1746144666.020644:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746836224 00000100:00100000:3.0:1746144666.020649:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746836224 00000100:00100000:2.0:1746144666.020665:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746836480 00000100:00100000:2.0:1746144666.020667:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746836480 00000100:00100000:3.0:1746144666.020678:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4720 00002000:00100000:2.0:1746144666.020682:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012cfba300 x1830964746836480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746144666.020688:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746835968:12345-192.168.204.23@tcp:3:multiop.0 00002000:00100000:2.0:1746144666.020689:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfba300 with x1830964746836480 ext(3145728->4194303) 00002000:00010000:2.0:1746144666.020692:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfba300 00000100:00100000:2.0:1746144666.020712:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4721 00000100:00100000:2.0:1746144666.020719:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746836480:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144666.021049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.021076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.021694:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746836864 00000100:00100000:3.0:1746144666.021699:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746836864 00000100:00100000:3.0:1746144666.021745:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4140 00000100:00080000:1.0:1746144666.021749:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144666.021753:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+313:29347:x1830964746836864:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144666.021972:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+314:29347:x1830964746836864:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 219us (892us total) trans 8589944085 rc 0/0 00000100:00100000:3.0:1746144666.021979:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4140 00000100:00100000:2.0:1746144666.022243:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746836608 00000100:00100000:2.0:1746144666.022247:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746836608 00010000:00010000:2.0:1746144666.022271:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 33 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.022296:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6110 00000100:00100000:2.0:1746144666.022302:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746836608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.022312:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144666.022328:0:7309:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144664 -> 1746144666 00002000:00010000:2.0:1746144666.022331:0:7309:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144664 -> 1746144666 00010000:00010000:2.0:1746144666.022336:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 33 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.022346:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 33 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.022368:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7bb expref: 33 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.022391:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.022394:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.022401:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.022410:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.022442:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.022458:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747556864:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.022509:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1b40 going to sleep for 11 seconds 00002000:00100000:2.0:1746144666.023227:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012cfb9f80 x1830964746836224/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.023237:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb9f80 with x1830964746836224 ext(3145728->4194303) 00002000:00010000:2.0:1746144666.023241:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfb9f80 00000100:00100000:2.0:1746144666.023263:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4722 00000100:00100000:2.0:1746144666.023270:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746836224:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144666.029703:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746836480:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 8972us (9163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.029716:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4721 00002000:00100000:2.0:1746144666.029729:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012cfba300 x1830964746836480/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.029738:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfba300 with x1830964746836480 ext(3145728->4194303) 00002000:00010000:2.0:1746144666.029744:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfba300 00000100:00100000:0.0:1746144666.038682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.038804:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747556864:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.038842:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.038906:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746836608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 16602us (17855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.038917:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6110 00000100:00100000:3.0:1746144666.039068:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837120 00000100:00100000:3.0:1746144666.039076:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837120 00002000:00100000:3.0:1746144666.039120:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cfbaa00 x1830964746837120/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.039130:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbaa00 with x1830964746837120 ext(1048576->2097151) 00002000:00010000:3.0:1746144666.039153:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfbaa00 00000100:00100000:3.0:1746144666.039171:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4723 00000100:00100000:3.0:1746144666.039184:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746837120:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144666.043368:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746836224:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 20088us (22873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.043380:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4722 00002000:00100000:3.0:1746144666.043394:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012cfb9f80 x1830964746836224/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.043404:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb9f80 with x1830964746836224 ext(3145728->4194303) 00002000:00010000:3.0:1746144666.043410:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfb9f80 00000100:00100000:2.0:1746144666.044198:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746835968:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 23510us (23760us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.044210:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4720 00002000:00100000:2.0:1746144666.044216:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012cfb9c00 x1830964746835968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.044223:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfb9c00 with x1830964746835968 ext(2097152->3145727) 00002000:00010000:2.0:1746144666.044226:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfb9c00 00000100:00100000:3.0:1746144666.046120:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746837120:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 6926us (7439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.046157:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4723 00002000:00100000:3.0:1746144666.046170:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012cfbaa00 x1830964746837120/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.046179:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbaa00 with x1830964746837120 ext(1048576->2097151) 00002000:00010000:3.0:1746144666.046184:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfbaa00 00000100:00100000:0.0:1746144666.054907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.055097:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837248 00000100:00100000:3.0:1746144666.055108:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837248 00000100:00100000:3.0:1746144666.055208:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12215 00000100:00100000:3.0:1746144666.055217:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:29340:x1830964746837248:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.055238:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.055259:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7d7 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.055295:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 25 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.055303:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144666.055305:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144666.055309:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.055342:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 25 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.055354:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 25 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.055366:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747556992:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.055460:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56600 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.059422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.059463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.059501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.059519:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837504 00000100:00100000:3.0:1746144666.059528:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837504 00000100:00100000:1.0:1746144666.059528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.059572:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837376 00000100:00100000:3.0:1746144666.059573:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837376 00000100:00100000:3.0:1746144666.059583:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837632 00000100:00100000:3.0:1746144666.059585:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837632 00000100:00100000:3.0:1746144666.059597:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12216 00000100:00100000:3.0:1746144666.059603:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746837504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.059620:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144666.059633:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12217 00010000:00010000:3.0:1746144666.059638:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7e5 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.059642:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746837376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.059651:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.059660:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.059662:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.059662:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801294be000/0xa7c849b16e01b49e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7de expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.059672:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 32 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.059687:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 32 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.059697:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a200, rc 0) 00000100:00100000:0.0:1746144666.059704:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cfbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557120:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144666.059754:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746837504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 149us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.059760:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12216 00000100:00100000:0.0:1746144666.059774:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.059775:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12218 00000100:00100000:3.0:1746144666.059779:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746837632:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.059785:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.059792:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7ec expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.059801:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.059803:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.059807:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 32 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144666.059807:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837760 00000100:00100000:0.0:1746144666.059810:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837760 00010000:00010000:3.0:1746144666.059816:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 32 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.059828:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304b400, rc 0) 00002000:00100000:0.0:1746144666.059835:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1089535) req@ffff88009a2ebb80 x1830964746837760/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746144666.059842:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746837632:12345-192.168.204.23@tcp:101:cat.0 Request processed in 63us (341us total) trans 0 rc 0/0 00002000:00100000:0.0:1746144666.059844:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2ebb80 with x1830964746837760 ext(1048576->1089535) 00000100:00100000:3.0:1746144666.059847:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12218 00010000:00010000:0.0:1746144666.059851:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 28 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.059862:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 28 pid: 8389 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144666.059873:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a2ebb80 00000100:00100000:3.0:1746144666.059879:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:8389:1830964747556992:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.059884:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 944 00000100:00100000:0.0:1746144666.059889:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746837760:12345-192.168.204.23@tcp:4:multiop.0 00010000:00010000:3.0:1746144666.059898:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.059907:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c18600, rc 0) 00000100:00100000:3.0:1746144666.059920:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:16261e74-be72-4bb6-b857-d78345d984f7+15:29340:x1830964746837248:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4705us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.059926:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12215 00000100:00100000:0.0:1746144666.064560:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cfbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557120:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144666.064597:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801294be000/0xa7c849b16e01b49e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7de expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.064614:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801294be000/0xa7c849b16e01b49e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7de expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.064630:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801294be000, rc 0) 00000100:00100000:0.0:1746144666.064686:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746837376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5044us (5220us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144666.064695:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12217 00000100:00100000:2.0:1746144666.066284:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746837760:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 6386us (6746us total) trans 17179873353 rc 0/0 00000100:00100000:2.0:1746144666.066294:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 944 00002000:00100000:2.0:1746144666.066304:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1089535) req@ffff88009a2ebb80 x1830964746837760/t17179873353(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.066312:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2ebb80 with x1830964746837760 ext(1048576->1089535) 00010000:00010000:2.0:1746144666.066322:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 28 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.066335:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 28 pid: 8389 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.066341:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a2ebb80 00000100:00100000:0.0:1746144666.069739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.070649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.070844:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746838144 00000100:00100000:3.0:1746144666.070855:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746838144 00002000:00100000:3.0:1746144666.070904:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012cfbb480 x1830964746838144/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.070915:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbb480 with x1830964746838144 ext(4194304->4935679) 00002000:00010000:3.0:1746144666.070921:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfbb480 00000100:00100000:3.0:1746144666.070955:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4724 00000100:00100000:3.0:1746144666.070962:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746838144:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144666.071027:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746837888 00000100:00100000:2.0:1746144666.071032:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746837888 00010000:00010000:2.0:1746144666.071068:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.071095:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6111 00000100:00100000:2.0:1746144666.071102:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746837888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.071112:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.071128:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.071155:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.071176:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18000/0xa7c849b16e01b489 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1089535) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d0 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.071194:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.071196:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.071202:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.071210:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.071251:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 14 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.071261:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747557248:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.071330:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.076325:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747557248:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144666.076365:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.076419:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746837888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5316us (6689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.076432:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6111 00000100:00100000:0.0:1746144666.076610:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.077381:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746838400 00000100:00100000:2.0:1746144666.077389:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746838400 00002000:00100000:2.0:1746144666.077434:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012cfbb800 x1830964746838400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.077449:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbb800 with x1830964746838400 ext(1048576->2097151) 00002000:00010000:2.0:1746144666.077454:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfbb800 00000100:00100000:2.0:1746144666.077478:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4725 00000100:00100000:2.0:1746144666.077486:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746838400:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144666.078907:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746838144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7937us (8253us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144666.078917:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4724 00002000:00100000:3.0:1746144666.078926:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88012cfbb480 x1830964746838144/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.078934:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbb480 with x1830964746838144 ext(4194304->4935679) 00002000:00010000:3.0:1746144666.078939:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfbb480 00000100:00100000:0.0:1746144666.086501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.086564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.086745:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746838528 00000100:00100000:2.0:1746144666.086754:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746838528 00000100:00100000:3.0:1746144666.086770:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746838656 00000100:00100000:3.0:1746144666.086786:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746838656 00000100:00100000:2.0:1746144666.086818:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12219 00000100:00100000:2.0:1746144666.086827:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746838528:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.086849:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144666.086851:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12220 00000100:00100000:3.0:1746144666.086859:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746838656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.086869:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f22aa00/0xa7c849b16e01b4ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7f3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.086875:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.086892:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f7fa expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.086911:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.086913:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.086920:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.086932:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 30 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.086941:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a800, rc 0) 00000100:00100000:3.0:1746144666.087009:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746838656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 150us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.087015:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12220 00000100:00100000:2.0:1746144666.087681:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557376:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144666.087775:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.093535:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557376:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144666.093591:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f22aa00/0xa7c849b16e01b4ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7f3 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.093608:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f22aa00/0xa7c849b16e01b4ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7f3 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.093631:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f22aa00, rc 0) 00000100:00100000:2.0:1746144666.094658:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746838528:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7827us (8161us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144666.094672:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12219 00000100:00100000:2.0:1746144666.096027:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746838400:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 18536us (19412us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.096037:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4725 00002000:00100000:2.0:1746144666.096048:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012cfbb800 x1830964746838400/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.096057:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbb800 with x1830964746838400 ext(1048576->2097151) 00002000:00010000:2.0:1746144666.096062:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfbb800 00000100:00100000:0.0:1746144666.100123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.100349:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746838784 00000100:00100000:2.0:1746144666.100360:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746838784 00000100:00100000:2.0:1746144666.100434:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12221 00000100:00100000:2.0:1746144666.100445:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746838784:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.100466:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.100487:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b4ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f801 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.100545:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557504:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144666.100828:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.103379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.103505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.103731:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746838912 00000100:00100000:2.0:1746144666.103740:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746838912 00000100:00100000:2.0:1746144666.103787:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746839040 00000100:00100000:2.0:1746144666.103789:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746839040 00000100:00100000:2.0:1746144666.103806:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12222 00000100:00100000:2.0:1746144666.103812:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746838912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.103830:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.103847:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f808 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.103857:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557504:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144666.103868:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.103870:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.103878:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 16 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.103884:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b4ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f801 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.103891:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 16 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.103893:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f800/0xa7c849b16e01b4ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f801 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.103899:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7e000, rc 0) 00010000:00010000:0.0:1746144666.103908:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f800, rc 0) 00000100:00100000:3.0:1746144666.104196:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12223 00000100:00100000:3.0:1746144666.104205:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746839040:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.104214:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.104225:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f80f expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.104237:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.104239:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.104244:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 29 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.104254:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 29 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.104347:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304ae00, rc 0) 00000100:00100000:3.0:1746144666.104534:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746839040:12345-192.168.204.23@tcp:101:cat.0 Request processed in 330us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.104535:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746838912:12345-192.168.204.23@tcp:101:cat.0 Request processed in 721us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.104535:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746838784:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4090us (4421us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144666.104541:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12223 00000100:00100000:0.0:1746144666.104627:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12221 00000100:00100000:2.0:1746144666.104630:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12222 00000100:00100000:0.0:1746144666.116088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.116257:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.116351:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746839552 00000100:00100000:2.0:1746144666.116361:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746839552 00000100:00100000:3.0:1746144666.116413:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746839808 00000100:00100000:3.0:1746144666.116418:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746839808 00002000:00100000:2.0:1746144666.116424:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800943f8700 x1830964746839552/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.116434:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8700 with x1830964746839552 ext(3145728->4194303) 00002000:00100000:3.0:1746144666.116439:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800943f8000 x1830964746839808/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746144666.116439:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f8700 00002000:00100000:3.0:1746144666.116447:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8000 with x1830964746839808 ext(2097152->3145727) 00002000:00010000:3.0:1746144666.116451:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943f8000 00000100:00100000:3.0:1746144666.116485:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4726 00000100:00100000:0.0:1746144666.116493:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4727 00000100:00100000:3.0:1746144666.116494:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746839552:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144666.116502:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746839808:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.116639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.116656:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746839424 00000100:00100000:1.0:1746144666.116659:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746839424 00002000:00100000:1.0:1746144666.116676:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a2e8380 x1830964746839424/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.116683:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e8380 with x1830964746839424 ext(2097152->3145727) 00002000:00010000:1.0:1746144666.116685:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2e8380 00000100:00100000:1.0:1746144666.116702:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4728 00000100:00100000:1.0:1746144666.116707:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746839424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.116995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.117045:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746839936 00000100:00100000:3.0:1746144666.117049:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746839936 00002000:00100000:3.0:1746144666.117062:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009a2e8700 x1830964746839936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.117069:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e8700 with x1830964746839936 ext(3145728->4194303) 00002000:00010000:3.0:1746144666.117072:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e8700 00000100:00100000:3.0:1746144666.117088:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4729 00000100:00100000:3.0:1746144666.117093:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+30:1960:x1830964746839936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144666.128076:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+31:1960:x1830964746839808:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11563us (11929us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.128090:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4727 00002000:00100000:2.0:1746144666.128104:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800943f8000 x1830964746839808/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.128115:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8000 with x1830964746839808 ext(2097152->3145727) 00002000:00010000:2.0:1746144666.128121:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943f8000 00000100:00100000:2.0:1746144666.131427:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746839552:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14923us (15337us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.131439:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4726 00002000:00100000:2.0:1746144666.131451:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800943f8700 x1830964746839552/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.131460:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943f8700 with x1830964746839552 ext(3145728->4194303) 00002000:00010000:2.0:1746144666.131465:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943f8700 00000100:00100000:3.0:1746144666.134894:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746839936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17787us (17885us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.134906:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4729 00002000:00100000:3.0:1746144666.134918:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009a2e8700 x1830964746839936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.134926:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e8700 with x1830964746839936 ext(3145728->4194303) 00002000:00010000:3.0:1746144666.134931:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e8700 00000100:00100000:1.0:1746144666.136879:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746839424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20163us (20231us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144666.136889:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4728 00002000:00100000:1.0:1746144666.136898:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009a2e8380 x1830964746839424/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.136907:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e8380 with x1830964746839424 ext(2097152->3145727) 00002000:00010000:1.0:1746144666.136911:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2e8380 00000100:00100000:0.0:1746144666.147118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.147185:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746840320 00000100:00100000:1.0:1746144666.147196:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746840320 00002000:00100000:1.0:1746144666.147246:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880099b8ce00 x1830964746840320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.147256:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ce00 with x1830964746840320 ext(4194304->4935679) 00002000:00010000:1.0:1746144666.147262:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8ce00 00000100:00100000:1.0:1746144666.147483:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4730 00000100:00100000:1.0:1746144666.147491:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746840320:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144666.149177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.149303:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746840576 00000100:00100000:1.0:1746144666.149310:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746840576 00000100:00100000:1.0:1746144666.149870:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10186 00000100:00100000:1.0:1746144666.149879:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+314:29353:x1830964746840576:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144666.149902:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.149922:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b4cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f816 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.150055:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150069:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150081:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150095:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150101:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150108:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150402:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b4e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150411:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150418:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144666.150427:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144666.150514:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150521:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150527:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150533:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4865a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144666.150537:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150543:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150573:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144666.150576:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144666.150581:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150587:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865a00/0xa7c849b16e01b4d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150612:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150617:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150622:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150626:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144666.150628:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150633:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150640:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d000) 00010000:00010000:1.0:1746144666.150642:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144666.150644:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150648:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b4dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.150716:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865200/0xa7c849b16e01b4cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f816 expref: 317 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.150730:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f816 expref: 316 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.150736:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144666.150739:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144666.150741:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864c00, rc 0) 00000100:00100000:1.0:1746144666.151631:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+316:29353:x1830964746840576:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1750us (2457us total) trans 8589944086 rc 0/0 00000100:00100000:1.0:1746144666.151640:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10186 00000100:00100000:0.0:1746144666.154554:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746840320:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7047us (7432us total) trans 0 rc 741376/741376 00000100:00100000:0.0:1746144666.154571:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4730 00002000:00100000:0.0:1746144666.154588:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880099b8ce00 x1830964746840320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.154599:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099b8ce00 with x1830964746840320 ext(4194304->4935679) 00002000:00010000:0.0:1746144666.154606:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099b8ce00 00000100:00100000:0.0:1746144666.156703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.156981:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746840704 00000100:00100000:3.0:1746144666.156998:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746840704 00000100:00100000:2.0:1746144666.157728:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 644 00000100:00100000:2.0:1746144666.157751:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+316:1962:x1830964746840704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.157766:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.157793:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b4e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f816 expref: 316 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.157819:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.157823:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.158264:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:1962:x1830964746840704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 527us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.158271:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 644 00000100:00100000:0.0:1746144666.169704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.169899:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746840960 00000100:00100000:2.0:1746144666.169911:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746840960 00000100:00100000:2.0:1746144666.170051:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4141 00000100:00100000:2.0:1746144666.170064:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:29340:x1830964746840960:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144666.170371:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:29340:x1830964746840960:12345-192.168.204.23@tcp:35:cat.0 Request processed in 311us (681us total) trans 8589944087 rc 0/0 00000100:00100000:2.0:1746144666.170383:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4141 00000100:00080000:1.0:1746144666.170947:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144666.190553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.190725:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746841216 00000100:00100000:1.0:1746144666.190747:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746841216 00000100:00100000:1.0:1746144666.190814:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10187 00000100:00100000:1.0:1746144666.190822:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:29356:x1830964746841216:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144666.190849:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.190869:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865400/0xa7c849b16e01b4f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f81d expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.191024:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191038:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191048:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191062:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191069:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191074:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191222:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191230:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191235:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144666.191245:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144666.191332:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191338:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191343:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191348:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144666.191352:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191357:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191367:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144666.191371:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144666.191375:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191380:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864200/0xa7c849b16e01b4f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191409:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191413:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191417:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191421:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4864600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144666.191423:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191427:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191432:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d100) 00010000:00010000:1.0:1746144666.191434:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144666.191436:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191440:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864600/0xa7c849b16e01b500 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144666.191477:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865400/0xa7c849b16e01b4f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 26 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.191492:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 25 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.191498:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144666.191499:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144666.191502:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864c00, rc 0) 00000100:00100000:1.0:1746144666.191552:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:29356:x1830964746841216:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 730us (1009us total) trans 8589944088 rc 0/0 00000100:00100000:1.0:1746144666.191564:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10187 00000100:00100000:0.0:1746144666.198405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.198457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.198697:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746841600 00000100:00100000:1.0:1746144666.198707:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746841600 00000100:00100000:1.0:1746144666.198765:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12224 00000100:00100000:1.0:1746144666.198774:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29353:x1830964746841600:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144666.198796:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.198819:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f824 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.198853:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.198861:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144666.198862:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144666.198866:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [733184->1048575] (req 733184->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.198895:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 15 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.198909:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 15 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.198922:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a2e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557632:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144666.199021:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.199259:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746841472 00000100:00100000:3.0:1746144666.199264:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746841472 00000100:00100000:3.0:1746144666.199291:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4142 00000100:00100000:3.0:1746144666.199295:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:29356:x1830964746841472:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144666.199482:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:29356:x1830964746841472:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 185us (1087us total) trans 8589944089 rc 0/0 00000100:00100000:3.0:1746144666.199493:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4142 00000100:00100000:0.0:1746144666.201553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.201942:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746841728 00000100:00100000:3.0:1746144666.201949:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746841728 00000100:00100000:3.0:1746144666.202166:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10188 00000100:00100000:3.0:1746144666.202174:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29357:x1830964746841728:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144666.202196:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.202213:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a000/0xa7c849b16e01b51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f82b expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.202279:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202292:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202302:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202315:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202321:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202326:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202434:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202444:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 25 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.202451:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.202480:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 25 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.202491:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 25 pid: 14710 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.202503:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747557760:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.202572:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.204745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.204815:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746841856 00000100:00100000:2.0:1746144666.204823:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746841856 00002000:00100000:2.0:1746144666.204879:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (81920->126975) req@ffff88009f273b80 x1830964746841856/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.204889:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f273b80 with x1830964746841856 ext(81920->126975) 00010000:00010000:2.0:1746144666.204899:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 16 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.204913:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 16 pid: 8389 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.204919:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f273b80 00000100:00100000:2.0:1746144666.204947:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 945 00000100:00100000:2.0:1746144666.204956:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746841856:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144666.205596:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a2e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747557632:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144666.205734:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [733184->1048575] (req 733184->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.205751:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4865200, rc 0) 00000100:00100000:1.0:1746144666.205866:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:29353:x1830964746841600:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7092us (7407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.205874:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12224 00000100:00100000:2.0:1746144666.207247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.207272:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746841984 00000100:00100000:2.0:1746144666.207277:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746841984 00010000:00010000:2.0:1746144666.207312:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 26 pid: 14710 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.207340:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6112 00000100:00100000:2.0:1746144666.207347:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746841984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.207359:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.207364:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 26 pid: 14710 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.207374:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 26 pid: 14710 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.207393:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.207398:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.207407:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.207413:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.207427:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.207450:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746841984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 103us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.207456:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6112 00010000:00010000:3.0:1746144666.207608:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864e00/0xa7c849b16e01b43c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f79f expref: 25 pid: 14710 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.207637:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747557760:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.207656:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207664:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207668:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144666.207707:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:3.0:1746144666.207711:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144666.207727:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207741:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207750:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207756:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207762:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207767:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304ac00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.207770:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207777:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207786:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144666.207788:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.207791:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207796:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207804:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207809:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207813:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207818:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135782400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.207820:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207824:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207830:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeab00) 00010000:00010000:3.0:1746144666.207832:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.207834:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207838:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782400/0xa7c849b16e01b52a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.207873:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a000/0xa7c849b16e01b51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.207884:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 10 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.207889:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144666.207891:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144666.207893:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783c00, rc 0) 00000100:00100000:3.0:1746144666.207917:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29357:x1830964746841728:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5745us (6371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.207924:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10188 00000100:00100000:0.0:1746144666.208690:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746841856:12345-192.168.204.23@tcp:4:cat.0 Request processed in 3733us (3949us total) trans 17179873354 rc 0/0 00000100:00100000:0.0:1746144666.208699:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 945 00002000:00100000:0.0:1746144666.208709:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (81920->126975) req@ffff88009f273b80 x1830964746841856/t17179873354(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.208717:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f273b80 with x1830964746841856 ext(81920->126975) 00010000:00010000:0.0:1746144666.208724:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.208736:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144666.208741:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f273b80 00000100:00100000:0.0:1746144666.211951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.212000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.212027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.212047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.212061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.212074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.212100:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842112 00000100:00100000:0.0:1746144666.212108:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842112 00000100:00100000:0.0:1746144666.212174:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842240 00000100:00100000:0.0:1746144666.212177:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842240 00000100:00100000:0.0:1746144666.212191:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842368 00000100:00100000:0.0:1746144666.212193:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842368 00000100:00100000:0.0:1746144666.212202:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842496 00000100:00100000:0.0:1746144666.212204:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842496 00000100:00100000:0.0:1746144666.212212:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842624 00000100:00100000:0.0:1746144666.212214:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842624 00000100:00100000:0.0:1746144666.212224:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842752 00000100:00100000:0.0:1746144666.212225:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842752 00000100:00100000:0.0:1746144666.212240:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12225 00000100:00100000:0.0:1746144666.212247:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746842112:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144666.212266:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144666.212267:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12226 00000100:00100000:3.0:1746144666.212276:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746842240:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:1.0:1746144666.212277:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12227 00000100:00100000:1.0:1746144666.212285:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746842368:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144666.212286:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.212287:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090f56c00/0xa7c849b16e01b538 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f832 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.212291:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.212297:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f839 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.212298:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f840 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.212309:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.212309:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.212311:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.212311:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.212319:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 12 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.212319:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.212333:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 12 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.212333:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144666.212337:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747557888:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144666.212342:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7b8a00, rc 0) 00010000:00010000:1.0:1746144666.212342:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4864400, rc 0) 00000100:00100000:1.0:1746144666.212383:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746842368:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.212390:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12227 00000100:00100000:1.0:1746144666.212404:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12228 00000100:00100000:1.0:1746144666.212408:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746842496:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:2.0:1746144666.212418:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12229 00010000:00010000:1.0:1746144666.212419:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.212427:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f847 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.212437:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746842624:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144666.212437:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.212438:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.212443:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.212444:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.212453:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f84e expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.212453:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.212460:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4865a00, rc 0) 00010000:00010000:2.0:1746144666.212469:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.212470:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.212475:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.212489:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 10 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.212497:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800936d9e00, rc 0) 00000100:00100000:3.0:1746144666.212503:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746842240:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 229us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.212509:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12226 00000100:00100000:2.0:1746144666.212511:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746842624:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 87us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.212516:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12229 00000100:00100000:3.0:1746144666.212520:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12230 00000100:00100000:3.0:1746144666.212524:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746842752:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144666.212530:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.212537:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f855 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.212546:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.212547:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.212551:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.212564:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 11 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.212571:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304bc00, rc 0) 00000100:00100000:3.0:1746144666.212585:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746842752:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 61us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.212590:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12230 00000100:00100000:1.0:1746144666.213069:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746842496:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 658us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.213075:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12228 00000100:00100000:0.0:1746144666.213128:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.213150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.213381:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746842880 00000100:00100000:2.0:1746144666.213386:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746842880 00010000:00010000:2.0:1746144666.213408:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.214038:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6113 00000100:00100000:2.0:1746144666.214047:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746842880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.214059:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.214081:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.214093:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.214111:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.214113:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.214117:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.214130:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.214249:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.214259:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747558016:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.214345:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80a13c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144666.217064:0:30345:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88009f01ea00 x1830964747557888) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.217103:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7ea00/0xa7c849b16e01b44a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 81920->126975) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ad expref: 18 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.217124:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747557888:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144666.217179:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090f56c00/0xa7c849b16e01b538 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f832 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.217193:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090f56c00/0xa7c849b16e01b538 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f832 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.217205:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090f56c00, rc 0) 00000100:00100000:3.0:1746144666.217281:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747558016:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144666.217302:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.218066:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746842880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4018us (4911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.218066:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1960:x1830964746842112:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 5815us (6122us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144666.218076:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6113 00000100:00100000:2.0:1746144666.218076:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12225 00000100:00100000:0.0:1746144666.218094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.218119:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746843136 00000100:00100000:0.0:1746144666.218801:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746843136 00002000:00100000:0.0:1746144666.218847:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (733184->737279) req@ffff88009f01ca80 x1830964746843136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.218855:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01ca80 with x1830964746843136 ext(733184->737279) 00002000:00010000:0.0:1746144666.218861:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f01ca80 00000100:00100000:0.0:1746144666.219002:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4731 00000100:00100000:0.0:1746144666.219069:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746843136:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144666.219938:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746843136:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 872us (1841us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144666.219949:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4731 00002000:00100000:0.0:1746144666.219955:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (733184->737279) req@ffff88009f01ca80 x1830964746843136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.219962:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01ca80 with x1830964746843136 ext(733184->737279) 00002000:00010000:0.0:1746144666.219965:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f01ca80 00000100:00100000:0.0:1746144666.225492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.227222:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746843392 00000100:00100000:3.0:1746144666.227235:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746843392 00000100:00100000:3.0:1746144666.227313:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10189 00000100:00100000:3.0:1746144666.227324:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29357:x1830964746843392:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144666.227350:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.227373:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f85c expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.227491:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.227510:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.227536:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.227579:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.227592:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 11 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.227606:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747558144:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.227738:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.227966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.228351:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746843520 00000100:00100000:3.0:1746144666.228355:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746843520 00000100:00100000:3.0:1746144666.228392:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12231 00000100:00100000:3.0:1746144666.228399:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29353:x1830964746843520:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.228408:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.228421:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f863 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.228441:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 28 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.228449:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.228456:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.228463:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.228465:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.228468:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1310719] (req 1048576->1310719) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 33 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.228485:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.228493:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144666.228502:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747558272:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.228941:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 10 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.228950:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 10 pid: 8389 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144666.228959:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747558400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.228999:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 28 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.229008:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 28 pid: 22208 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.229021:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747558528:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.229038:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.231383:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747558272:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144666.231925:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747558144:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.231950:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144666.232006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.232072:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747558400:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.232080:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747558528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.232104:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->1310719] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 33 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.232121:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c18200, rc 0) 00000100:00100000:3.0:1746144666.232484:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29353:x1830964746843520:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4083us (4516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.232492:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12231 00000100:00100000:0.0:1746144666.232893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.232915:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746843648 00000100:00100000:2.0:1746144666.232922:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746843648 00010000:00010000:2.0:1746144666.232963:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 12 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.233002:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6114 00000100:00100000:2.0:1746144666.233010:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746843648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.233023:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.233028:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 12 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.233040:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 12 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.233060:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783c00/0xa7c849b16e01b531 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f82b expref: 12 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.233087:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.233093:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.233103:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.233110:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.233128:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.233164:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746843648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 156us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.233170:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6114 00010000:00010000:2.0:1746144666.233185:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.233191:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144666.233209:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144666.233353:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304ac00/0xa7c849b16e01b562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f85c expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.233365:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f85c expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.233371:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.233373:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144666.233375:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092459800, rc 0) 00000100:00100000:2.0:1746144666.233393:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29357:x1830964746843392:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 6073us (7916us total) trans 8589944090 rc 0/0 00000100:00100000:2.0:1746144666.233400:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10189 00000100:00100000:0.0:1746144666.233927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.233960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.234007:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746843776 00000100:00100000:0.0:1746144666.234011:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746843776 00010000:00010000:0.0:1746144666.234029:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 11 pid: 8389 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746144666.234045:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746843904 00000100:00100000:0.0:1746144666.234046:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746843904 00010000:00010000:0.0:1746144666.234055:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746144666.234066:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746844032 00000100:00100000:0.0:1746144666.234067:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746844032 00010000:00010000:0.0:1746144666.234076:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 29 pid: 22208 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144666.234100:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6115 00000100:00100000:0.0:1746144666.234107:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746843776:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.234116:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144666.234155:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 11 pid: 8389 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.234163:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 11 pid: 8389 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.234178:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7b8a00/0xa7c849b16e01b53f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f839 expref: 11 pid: 8389 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.234192:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144666.234211:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746843776:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 104us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.234217:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6115 00000100:00100000:0.0:1746144666.234227:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6116 00000100:00100000:0.0:1746144666.234232:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746843904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.234239:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144666.234246:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.234254:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.234265:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304a200/0xa7c849b16e01b497 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7e5 expref: 33 pid: 22208 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.234278:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144666.234291:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746843904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.234296:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6116 00000100:00100000:0.0:1746144666.234305:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6117 00000100:00100000:0.0:1746144666.234310:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746844032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.234316:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144666.234322:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 29 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.234331:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 29 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.234342:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b4fc00/0xa7c849b16e01b419 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f78a expref: 29 pid: 22208 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.234350:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.234352:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.234357:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 31 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.234365:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 31 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.234392:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 31 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.234404:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f169500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747558656:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144666.236760:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800998526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.236915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.237159:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746844288 00000100:00100000:3.0:1746144666.237167:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746844288 00000100:00100000:3.0:1746144666.237207:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10190 00000100:00100000:3.0:1746144666.237214:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+315:29360:x1830964746844288:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.237238:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.237256:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e01b57e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f86a expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.237369:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237383:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237393:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237406:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237412:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237416:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237522:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1400/0xa7c849b16e01b593 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237532:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1400/0xa7c849b16e01b593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237538:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1400/0xa7c849b16e01b593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144666.237547:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144666.237623:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237630:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237636:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237642:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2c1a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.237645:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237653:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237662:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144666.237665:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.237669:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237674:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1a00/0xa7c849b16e01b585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237688:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237693:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237698:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237701:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2c1200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.237703:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237706:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237711:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea200) 00010000:00010000:3.0:1746144666.237713:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.237715:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237720:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1200/0xa7c849b16e01b58c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.237754:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c0200/0xa7c849b16e01b57e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f86a expref: 318 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.237765:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1400/0xa7c849b16e01b593 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f86a expref: 317 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.237771:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144666.237773:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144666.237775:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2c1400, rc 0) 00000100:00100000:3.0:1746144666.237816:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29360:x1830964746844288:12345-192.168.204.23@tcp:101:cat.0 Request processed in 602us (905us total) trans 8589944091 rc 0/0 00000100:00100000:3.0:1746144666.237823:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10190 00000100:00100000:0.0:1746144666.239855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.240889:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746844544 00000100:00100000:2.0:1746144666.240899:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746844544 00000100:00100000:2.0:1746144666.240972:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10191 00000100:00100000:2.0:1746144666.240992:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29357:x1830964746844544:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144666.241016:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.241019:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144666.241046:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01b569 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f85c expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.241076:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.241080:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144666.241092:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045400/0xa7c849b16e01b5a1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f871 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.241198:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241211:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241219:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241230:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241235:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241241:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241246:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5045600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144666.241250:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241260:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241267:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.241269:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144666.241272:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241276:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b5a8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144666.241299:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045400/0xa7c849b16e01b5a1 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f871 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.241306:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045400/0xa7c849b16e01b5a1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f871 expref: 11 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.241313:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5045400, rc 0) 00000100:00100000:2.0:1746144666.241360:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29357:x1830964746844544:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 380us (1513us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144666.241367:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10191 00000100:00100000:0.0:1746144666.242498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.243045:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f169500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747558656:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144666.243064:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.243096:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746844032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 8785us (9135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.243100:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746844800 00000100:00100000:1.0:1746144666.243103:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6117 00000100:00100000:2.0:1746144666.243105:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746844800 00000100:00100000:2.0:1746144666.243229:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4143 00000100:00100000:2.0:1746144666.243239:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29360:x1830964746844800:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144666.243459:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:29360:x1830964746844800:12345-192.168.204.23@tcp:35:cat.0 Request processed in 223us (966us total) trans 8589944092 rc 0/0 00000100:00100000:2.0:1746144666.243466:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4143 00000100:00100000:1.0:1746144666.255487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.255516:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746844928 00000100:00100000:1.0:1746144666.255525:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746844928 00000100:00100000:1.0:1746144666.255576:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 645 00000100:00100000:1.0:1746144666.255584:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:1960:x1830964746844928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.255600:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.255631:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2c1400/0xa7c849b16e01b593 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f86a expref: 318 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.255650:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144666.255655:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.256072:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:1960:x1830964746844928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 486us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.256079:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 645 00000100:00100000:1.0:1746144666.256161:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.256227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.256262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.257595:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746845184 00000100:00100000:3.0:1746144666.257604:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746845184 00000100:00100000:3.0:1746144666.257641:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4144 00000100:00100000:3.0:1746144666.257648:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29357:x1830964746845184:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:3.0:1746144666.257860:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29357:x1830964746845184:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 211us (1697us total) trans 8589944093 rc 0/0 00000100:00100000:3.0:1746144666.257866:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4144 00000100:00100000:3.0:1746144666.260499:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746845440 00000100:00100000:3.0:1746144666.260510:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746845440 00002000:00100000:3.0:1746144666.260556:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1306624->1310719) req@ffff88009a2e9c00 x1830964746845440/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.260565:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9c00 with x1830964746845440 ext(1306624->1310719) 00002000:00010000:3.0:1746144666.260570:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9c00 00000100:00100000:3.0:1746144666.260587:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746845696 00000100:00100000:3.0:1746144666.260589:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746845696 00002000:00100000:3.0:1746144666.260599:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->733183) req@ffff88009a2eaa00 x1830964746845696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.260605:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2eaa00 with x1830964746845696 ext(0->733183) 00002000:00010000:3.0:1746144666.260607:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2eaa00 00000100:00100000:3.0:1746144666.260617:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4732 00000100:00100000:3.0:1746144666.260623:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746845440:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144666.260773:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1962:x1830964746845440:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 151us (4545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144666.260779:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4732 00002000:00100000:3.0:1746144666.260784:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1306624->1310719) req@ffff88009a2e9c00 x1830964746845440/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.260789:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2e9c00 with x1830964746845440 ext(1306624->1310719) 00002000:00010000:3.0:1746144666.260791:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a2e9c00 00000100:00100000:3.0:1746144666.260803:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4733 00000100:00100000:3.0:1746144666.260807:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746845696:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.287945:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.288375:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746845696:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27564us (32110us total) trans 0 rc 733184/733184 00000100:00100000:1.0:1746144666.288386:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4733 00002000:00100000:1.0:1746144666.288402:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (0->733183) req@ffff88009a2eaa00 x1830964746845696/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.288412:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a2eaa00 with x1830964746845696 ext(0->733183) 00002000:00010000:1.0:1746144666.288418:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a2eaa00 00000100:00100000:3.0:1746144666.288826:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746845952 00000100:00100000:3.0:1746144666.288835:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746845952 00000100:00100000:3.0:1746144666.288870:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4145 00000100:00100000:3.0:1746144666.288877:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+317:29353:x1830964746845952:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144666.290700:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:29353:x1830964746845952:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1816us (2759us total) trans 8589944094 rc 0/0 00000100:00100000:3.0:1746144666.290710:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4145 00000100:00100000:1.0:1746144666.322589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.322623:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746846336 00000100:00100000:1.0:1746144666.322630:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746846336 00002000:00100000:1.0:1746144666.322668:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1310720->2097151) req@ffff88009f168000 x1830964746846336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.322677:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168000 with x1830964746846336 ext(1310720->2097151) 00002000:00010000:1.0:1746144666.322682:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168000 00000100:00100000:1.0:1746144666.322700:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4734 00000100:00100000:1.0:1746144666.322706:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746846336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.323737:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.323751:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746846464 00000100:00100000:1.0:1746144666.323754:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746846464 00002000:00100000:1.0:1746144666.323770:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f169c00 x1830964746846464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.323778:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169c00 with x1830964746846464 ext(1048576->2097151) 00002000:00010000:1.0:1746144666.323781:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f169c00 00000100:00100000:3.0:1746144666.325551:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4735 00000100:00100000:3.0:1746144666.325570:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746846464:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.326335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.327796:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746846720 00000100:00100000:0.0:1746144666.327807:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746846720 00002000:00100000:0.0:1746144666.327849:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f169880 x1830964746846720/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.327859:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169880 with x1830964746846720 ext(1048576->2097151) 00002000:00010000:0.0:1746144666.327865:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f169880 00000100:00100000:0.0:1746144666.327882:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4736 00000100:00100000:0.0:1746144666.327888:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746846720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144666.330854:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746846336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8138us (8264us total) trans 0 rc 786432/786432 00000100:00100000:0.0:1746144666.330867:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4734 00002000:00100000:0.0:1746144666.330880:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1310720->2097151) req@ffff88009f168000 x1830964746846336/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 786432/786432 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.330889:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f168000 with x1830964746846336 ext(1310720->2097151) 00002000:00010000:0.0:1746144666.330895:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f168000 00000100:00100000:1.0:1746144666.349163:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746846464:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23594us (25424us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144666.349173:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4735 00002000:00100000:1.0:1746144666.349183:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009f169c00 x1830964746846464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.349192:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169c00 with x1830964746846464 ext(1048576->2097151) 00002000:00010000:1.0:1746144666.349197:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f169c00 00000100:00100000:3.0:1746144666.363333:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746846720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 35413us (36973us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.363343:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4736 00002000:00100000:3.0:1746144666.363353:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009f169880 x1830964746846720/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.363361:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f169880 with x1830964746846720 ext(1048576->2097151) 00002000:00010000:3.0:1746144666.363366:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f169880 00000001:00080000:3.0:1746144666.380407:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840576 is committed 00000001:00080000:3.0:1746144666.380424:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840562 is committed 00000001:00080000:3.0:1746144666.380457:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840503 is committed 00000001:00080000:3.0:1746144666.380466:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840577 is committed 00000001:00080000:3.0:1746144666.380484:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840564 is committed 00000001:00080000:3.0:1746144666.380509:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840578 is committed 00000001:00080000:3.0:1746144666.380523:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840570 is committed 00000001:00080000:3.0:1746144666.380548:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840519 is committed 00000001:00080000:3.0:1746144666.380551:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840520 is committed 00000100:00100000:0.0:1746144666.417630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.418938:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746846976 00000100:00100000:3.0:1746144666.418947:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746846976 00000100:00100000:3.0:1746144666.419029:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10192 00000100:00100000:3.0:1746144666.419036:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:29366:x1830964746846976:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.419055:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.419074:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047000/0xa7c849b16e01b5af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f878 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.419204:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419217:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419226:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419235:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419240:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419245:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419320:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419327:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419332:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144666.419340:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144666.419401:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419406:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419412:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419420:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b047200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.419423:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419428:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419437:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144666.419439:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.419443:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419447:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047200/0xa7c849b16e01b5b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419468:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419473:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419477:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419481:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b047400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.419483:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419487:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419493:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea400) 00010000:00010000:3.0:1746144666.419495:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.419497:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419501:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047400/0xa7c849b16e01b5bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.419538:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047000/0xa7c849b16e01b5af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 28 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.419547:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 27 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.419553:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144666.419554:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144666.419556:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b047c00, rc 0) 00000100:00100000:3.0:1746144666.419608:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+27:29366:x1830964746846976:12345-192.168.204.23@tcp:101:cat.0 Request processed in 572us (1985us total) trans 8589944095 rc 0/0 00000100:00100000:3.0:1746144666.419615:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10192 00000100:00100000:0.0:1746144666.429391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.429437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.429480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.429514:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847104 00000100:00100000:0.0:1746144666.429523:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847104 00000100:00100000:0.0:1746144666.429568:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847232 00000100:00100000:0.0:1746144666.429570:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847232 00000100:00100000:0.0:1746144666.429583:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847360 00000100:00100000:0.0:1746144666.429584:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847360 00000100:00100000:0.0:1746144666.429598:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12232 00000100:00100000:0.0:1746144666.429606:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746847104:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.429628:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.429647:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e3ea600/0xa7c849b16e01b5d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f87f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.429681:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12233 00000100:00100000:1.0:1746144666.429698:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746847232:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144666.429704:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747558784:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.429717:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.429734:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4da000/0xa7c849b16e01b5d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f886 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144666.429905:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12234 00000100:00100000:3.0:1746144666.429914:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+19:29356:x1830964746847360:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.429921:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.429929:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f88d expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.429948:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 28 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.429956:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 6 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.429968:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.429974:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.429975:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.429988:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.430009:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 20 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.430021:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 20 pid: 7257 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144666.430029:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747558912:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144666.430196:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747559040:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144666.430946:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.431043:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746144666.434817:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 6 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.434838:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 6 pid: 7257 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746144666.434853:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747559168:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.435343:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 28 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.435353:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 28 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.435361:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747559296:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.435640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.435700:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847488 00000100:00100000:3.0:1746144666.435708:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847488 00002000:00010000:1.0:1746144666.435969:0:8453:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144666 -> 1746144667 00002000:00010000:1.0:1746144666.435973:0:8453:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144666 -> 1746144667 00002000:00010000:1.0:1746144666.435974:0:8453:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144666 -> 1746144667 00000100:00100000:1.0:1746144666.436007:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747558784:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.436043:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e3ea600/0xa7c849b16e01b5d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f87f expref: 21 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.436054:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3ea600/0xa7c849b16e01b5d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f87f expref: 21 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.436079:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3ea600, rc 0) 00000100:00100000:1.0:1746144666.436112:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746847104:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6506us (6732us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144666.436120:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12232 00000100:00100000:2.0:1746144666.436421:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.436434:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747558912:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.436796:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 19 pid: 7257 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144666.436821:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6118 00000100:00100000:3.0:1746144666.436830:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1961:x1830964746847488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.436842:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.436855:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 19 pid: 7257 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.436866:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 19 pid: 7257 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.436882:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e000/0xa7c849b16e01b4c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f808 expref: 19 pid: 7257 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.437101:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.439204:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746847488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2363us (3553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.439217:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6118 00000100:00100000:0.0:1746144666.441561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.441745:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747559168:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144666.441757:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747559296:192.168.204.23@tcp:104: 00002000:00010000:1.0:1746144666.441829:0:10724:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144666 -> 1746144667 00002000:00010000:1.0:1746144666.441834:0:10724:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144666 -> 1746144667 00002000:00010000:1.0:1746144666.441836:0:10724:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144666 -> 1746144667 00000100:00100000:1.0:1746144666.441856:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747559040:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.441882:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4da000/0xa7c849b16e01b5d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f886 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.441896:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4da000/0xa7c849b16e01b5d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f886 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.441907:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4da000, rc 0) 00000100:00100000:1.0:1746144666.441954:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746847232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 12263us (12516us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144666.441962:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12233 00010000:00010000:2.0:1746144666.444856:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2924544->3145727] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.444879:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b046400, rc 0) 00000100:00100000:2.0:1746144666.444950:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+17:29356:x1830964746847360:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 15035us (15466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.444959:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12234 00000100:00100000:3.0:1746144666.445532:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847616 00000100:00100000:3.0:1746144666.445542:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847616 00010000:00010000:3.0:1746144666.445572:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 7 pid: 7257 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746144666.446019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.446049:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847744 00000100:00100000:3.0:1746144666.446052:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847744 00000100:00100000:0.0:1746144666.446060:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6119 00010000:00010000:3.0:1746144666.446066:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144666.446068:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746847616:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.446081:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144666.446083:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6120 00000100:00100000:3.0:1746144666.446088:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746847744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.446095:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.446104:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.446104:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 7 pid: 7257 timeout: 745 lvb_type: 1 00010000:00010000:0.0:1746144666.446114:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 7 pid: 7257 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.446128:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.446163:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936d9e00/0xa7c849b16e01b554 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f84e expref: 7 pid: 7257 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.446169:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7e800/0xa7c849b16e01b42e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7a6 expref: 29 pid: 8389 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.446177:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.446179:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.446185:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.446193:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.446201:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144666.446221:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144666.446239:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746847744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 149us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.446245:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6120 00000100:00100000:0.0:1746144666.446883:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747559424:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144666.446960:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.451505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.451693:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747559424:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144666.451720:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.451779:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746847616:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5711us (10227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.451788:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6119 00000100:00100000:2.0:1746144666.452060:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746847872 00000100:00100000:2.0:1746144666.452068:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746847872 00000100:00100000:2.0:1746144666.452228:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12235 00000100:00100000:2.0:1746144666.452238:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+17:29366:x1830964746847872:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.452256:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.452274:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f894 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.452302:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.452309:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144666.452311:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144666.452315:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 18 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.452342:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.452353:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 27 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.452365:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747559552:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144666.452432:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.454217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.455413:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848128 00000100:00100000:3.0:1746144666.455423:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848128 00002000:00100000:3.0:1746144666.455467:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2924544->2928639) req@ffff88009b813800 x1830964746848128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.455476:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b813800 with x1830964746848128 ext(2924544->2928639) 00002000:00010000:3.0:1746144666.455481:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b813800 00000100:00100000:2.0:1746144666.455490:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747559552:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.455505:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4737 00000100:00100000:3.0:1746144666.455512:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746848128:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:2.0:1746144666.455531:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 19 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.455551:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044400, rc 0) 00000100:00100000:2.0:1746144666.455594:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+19:29366:x1830964746847872:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3359us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.455600:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12235 00000100:00100000:3.0:1746144666.455663:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746848128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 150us (1454us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144666.455669:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4737 00002000:00100000:3.0:1746144666.455674:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2924544->2928639) req@ffff88009b813800 x1830964746848128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.455681:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b813800 with x1830964746848128 ext(2924544->2928639) 00002000:00010000:3.0:1746144666.455684:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b813800 00000100:00100000:0.0:1746144666.457518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.457593:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848256 00000100:00100000:1.0:1746144666.457600:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848256 00002000:00100000:1.0:1746144666.457682:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (733184->1048575) req@ffff88009b810a80 x1830964746848256/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.457699:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b810a80 with x1830964746848256 ext(733184->1048575) 00010000:00010000:1.0:1746144666.457796:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 28 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.457818:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 28 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746144666.457825:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b810a80 00000100:00100000:1.0:1746144666.462624:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 946 00000100:00100000:1.0:1746144666.462645:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746848256:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144666.463087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.463415:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848384 00000100:00100000:0.0:1746144666.463423:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848384 00000100:00100000:0.0:1746144666.463459:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12236 00000100:00100000:0.0:1746144666.463464:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:29356:x1830964746848384:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144666.463475:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.463492:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f89b expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.463517:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.463530:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 6 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.463536:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.463542:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.463543:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.463546:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2899967] (req 2097152->2899967) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.463573:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.463582:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746144666.463592:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747559680:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144666.463662:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 6 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.463669:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 6 pid: 8389 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746144666.463676:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747559808:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144666.463699:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 15 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.463706:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 15 pid: 29370 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144666.463713:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747559936:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.463725:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.470376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.470408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.471531:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746848256:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8887us (14017us total) trans 17179873355 rc 0/0 00000100:00100000:0.0:1746144666.471541:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 946 00002000:00100000:0.0:1746144666.471550:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (733184->1048575) req@ffff88009b810a80 x1830964746848256/t17179873355(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.471559:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b810a80 with x1830964746848256 ext(733184->1048575) 00010000:00010000:0.0:1746144666.471568:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 30 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.471579:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 30 pid: 8450 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144666.471585:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b810a80 00000100:00100000:0.0:1746144666.471640:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b812a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747559680:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.471650:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b811880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747559808:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.471659:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747559936:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144666.471688:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->2899967] (req 2097152->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.471701:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3eaa00, rc 0) 00000100:00100000:0.0:1746144666.471717:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+9:29356:x1830964746848384:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8253us (8632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.471722:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12236 00000100:00100000:3.0:1746144666.472832:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848512 00000100:00100000:3.0:1746144666.472843:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848512 00010000:00010000:3.0:1746144666.472884:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144666.472917:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848640 00000100:00100000:3.0:1746144666.472920:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848640 00010000:00010000:3.0:1746144666.472931:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 7 pid: 8389 timeout: 745 lvb_type: 1 00000100:00100000:3.0:1746144666.472946:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6121 00000100:00100000:3.0:1746144666.472953:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746848512:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.472968:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.473001:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.473012:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.473033:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01b4c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f80f expref: 9 pid: 22208 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.473049:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.473102:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:1962:x1830964746848512:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 149us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.473107:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6121 00000100:00100000:3.0:1746144666.473123:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6122 00000100:00100000:3.0:1746144666.473127:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746848640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.473150:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.473156:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 7 pid: 8389 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.473164:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 7 pid: 8389 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.473174:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304bc00/0xa7c849b16e01b55b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f855 expref: 7 pid: 8389 timeout: 745 lvb_type: 1 00010000:00010000:3.0:1746144666.473183:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.473197:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746848640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 69us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.473202:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6122 00000100:00100000:2.0:1746144666.473562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.473830:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848768 00000100:00100000:1.0:1746144666.473834:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848768 00010000:00010000:1.0:1746144666.473852:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 16 pid: 29370 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.474421:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6123 00000100:00100000:1.0:1746144666.474426:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746848768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.474435:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.474447:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 16 pid: 29370 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.474455:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 16 pid: 29370 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.474466:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864800/0xa7c849b16e01b47b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c2 expref: 16 pid: 29370 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.474478:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.474480:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.474487:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 7 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.474495:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 7 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.474523:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 7 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.474534:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747560064:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144666.474598:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.475219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.475658:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746848896 00000100:00100000:3.0:1746144666.475663:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746848896 00010000:00010000:3.0:1746144666.475682:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 30 pid: 8450 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.475708:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6124 00000100:00100000:3.0:1746144666.475713:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746848896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.475723:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.475739:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 30 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.475753:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 30 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.475766:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865200/0xa7c849b16e01b515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 733184->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f824 expref: 30 pid: 8450 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.475775:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.475777:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.475780:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.475787:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.475804:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144666.475811:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747560192:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144666.475867:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.477781:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747560064:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144666.477800:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.478195:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1963:x1830964746848768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3766us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.478205:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6123 00000100:00100000:3.0:1746144666.482099:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747560192:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144666.482123:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.482374:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746848896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6658us (7154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.482384:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6124 00000100:00100000:0.0:1746144666.486015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.486099:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746849152 00000100:00100000:2.0:1746144666.486109:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746849152 00002000:00100000:2.0:1746144666.486192:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008b9a0a80 x1830964746849152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.486202:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0a80 with x1830964746849152 ext(0->1048575) 00002000:00010000:2.0:1746144666.486207:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0a80 00000100:00100000:2.0:1746144666.486240:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4738 00000100:00100000:2.0:1746144666.486249:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746849152:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144666.491040:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.491092:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746849408 00000100:00100000:3.0:1746144666.491104:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746849408 00002000:00100000:3.0:1746144666.491181:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2895872->2899967) req@ffff88008b9a2300 x1830964746849408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.491191:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a2300 with x1830964746849408 ext(2895872->2899967) 00002000:00010000:3.0:1746144666.491196:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a2300 00000100:00100000:3.0:1746144666.491216:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4739 00000100:00100000:3.0:1746144666.491223:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746849408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144666.492132:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:1960:x1830964746849408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 905us (1098us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144666.492166:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4739 00002000:00100000:3.0:1746144666.492173:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2895872->2899967) req@ffff88008b9a2300 x1830964746849408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.492185:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a2300 with x1830964746849408 ext(2895872->2899967) 00002000:00010000:3.0:1746144666.492188:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a2300 00000100:00100000:2.0:1746144666.497195:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746849152:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10934us (11177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.497209:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4738 00002000:00100000:2.0:1746144666.497221:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88008b9a0a80 x1830964746849152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.497231:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0a80 with x1830964746849152 ext(0->1048575) 00002000:00010000:2.0:1746144666.497237:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0a80 00000100:00100000:0.0:1746144666.501017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.501112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.501585:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746849664 00000100:00100000:0.0:1746144666.501594:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746849664 00000100:00100000:0.0:1746144666.501643:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10193 00000100:00100000:0.0:1746144666.501651:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+318:29370:x1830964746849664:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.501676:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.501696:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb600/0xa7c849b16e01b5f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8a2 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.501807:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501820:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501829:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501844:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501848:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501853:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144666.501949:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746849920 00000100:00100000:3.0:1746144666.501953:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746849920 00010000:00010000:0.0:1746144666.501958:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501967:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144666.501973:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144666.501991:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4146 00000004:00200000:0.0:1746144666.501991:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000100:00100000:3.0:1746144666.501996:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+27:29356:x1830964746849920:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144666.502175:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:29356:x1830964746849920:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 177us (1166us total) trans 8589944096 rc 0/0 00000100:00100000:3.0:1746144666.502182:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4146 00010000:00010000:1.0:1746144666.503487:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503497:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503503:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503508:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bb800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144666.503512:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503522:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503534:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144666.503537:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144666.503541:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503545:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb800/0xa7c849b16e01b5fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503568:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503574:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503579:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503583:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bb000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144666.503585:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503591:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503597:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8c00) 00010000:00010000:1.0:1746144666.503598:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144666.503600:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503605:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.503644:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bb600/0xa7c849b16e01b5f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 321 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.503655:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 320 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.503661:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144666.503663:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144666.503665:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bae00, rc 0) 00000100:00100000:1.0:1746144666.503707:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:29370:x1830964746849664:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2056us (2594us total) trans 8589944097 rc 0/0 00000100:00100000:1.0:1746144666.503713:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10193 00000100:00100000:0.0:1746144666.507279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.508395:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746850176 00000100:00100000:3.0:1746144666.508406:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746850176 00000100:00100000:3.0:1746144666.508458:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4147 00000100:00100000:3.0:1746144666.508466:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+320:29370:x1830964746850176:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144666.508553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.508691:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:29370:x1830964746850176:12345-192.168.204.23@tcp:35:cat.0 Request processed in 225us (1424us total) trans 8589944098 rc 0/0 00000100:00100000:3.0:1746144666.508698:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4147 00000100:00100000:0.0:1746144666.508841:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746850304 00000100:00100000:0.0:1746144666.508845:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746850304 00000100:00100000:0.0:1746144666.508868:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12237 00000100:00100000:0.0:1746144666.508872:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:29366:x1830964746850304:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.508881:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.508899:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8a9 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.508924:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 14 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.508936:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144666.508938:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144666.508941:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.508966:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 14 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.508984:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 14 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144666.508995:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b810380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747560320:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.509055:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.513220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.513243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.513276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.513301:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746850432 00000100:00100000:0.0:1746144666.513309:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746850432 00000100:00100000:0.0:1746144666.513345:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746850688 00000100:00100000:0.0:1746144666.513347:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746850688 00000100:00100000:0.0:1746144666.513375:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746850560 00000100:00100000:0.0:1746144666.513377:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746850560 00000100:00100000:0.0:1746144666.513393:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12238 00000100:00100000:0.0:1746144666.513400:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746850432:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.513420:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.513439:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8b0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.513463:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.513465:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.513474:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.513490:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.513501:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ba200, rc 0) 00000100:00100000:1.0:1746144666.513566:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12239 00000100:00100000:1.0:1746144666.513575:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1960:x1830964746850688:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.513584:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.513595:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4dac00/0xa7c849b16e01b626 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8be expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144666.513619:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12240 00000100:00100000:3.0:1746144666.513627:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746850560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.513634:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144666.513634:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f169500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:3010:1830964747560448:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144666.513641:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b047800/0xa7c849b16e01b62d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8b7 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144666.513666:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747560576:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144666.514029:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b810380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747560320:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.514057:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.514066:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bb000, rc 0) 00000100:00100000:3.0:1746144666.514341:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f39d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.514343:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746850432:12345-192.168.204.23@tcp:101:cat.0 Request processed in 943us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.514349:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12238 00000100:00100000:3.0:1746144666.514351:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.514430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.514552:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+9:29366:x1830964746850304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5678us (5999us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.514558:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12237 00000100:00100000:2.0:1746144666.514579:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746850816 00000100:00100000:2.0:1746144666.514582:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746850816 00002000:00100000:2.0:1746144666.514619:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1310719) req@ffff88009ee08000 x1830964746850816/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.514628:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08000 with x1830964746850816 ext(1048576->1310719) 00010000:00010000:2.0:1746144666.514634:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.514645:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.514651:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee08000 00000100:00100000:2.0:1746144666.514677:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 947 00000100:00100000:2.0:1746144666.514684:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746850816:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144666.524868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.525121:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746851072 00000100:00100000:1.0:1746144666.525131:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746851072 00002000:00010000:2.0:1746144666.525191:0:3010:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144666 -> 1746144667 00002000:00010000:2.0:1746144666.525196:0:3010:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144666 -> 1746144667 00002000:00010000:2.0:1746144666.525198:0:3010:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144666 -> 1746144667 00000100:00100000:1.0:1746144666.525199:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10194 00000100:00100000:2.0:1746144666.525220:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f169500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:3010:1830964747560448:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144666.525252:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4dac00/0xa7c849b16e01b626 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8be expref: 18 pid: 3010 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.525264:0:3010:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4dac00/0xa7c849b16e01b626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8be expref: 18 pid: 3010 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.525278:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4dac00, rc 0) 00000100:00100000:2.0:1746144666.525318:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746850688:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11745us (12073us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144666.525325:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12239 00000100:00100000:1.0:1746144666.525469:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:29373:x1830964746851072:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144666.525489:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.525507:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4daa00/0xa7c849b16e01b634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8c5 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.525599:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.525613:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 27 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.525620:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 322 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.525626:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144666.525656:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 322 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.525667:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 322 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.525678:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f169500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747560704:192.168.204.23@tcp:104: 00002000:00010000:3.0:1746144666.525714:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144666 -> 1746144667 00002000:00010000:3.0:1746144666.525717:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144666 -> 1746144667 00002000:00010000:3.0:1746144666.525719:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144666 -> 1746144667 00000100:00100000:3.0:1746144666.525732:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747560576:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.525733:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 27 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.525740:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 27 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.525747:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747560832:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.525750:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b047800/0xa7c849b16e01b62d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b7 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.525759:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b047800/0xa7c849b16e01b62d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b7 expref: 31 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144666.525762:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746144666.525774:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b047800, rc 0) 00000100:00100000:3.0:1746144666.525799:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746850560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 12174us (12523us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144666.525804:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12240 00000100:00100000:3.0:1746144666.531455:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746850816:12345-192.168.204.23@tcp:4:cat.0 Request processed in 16757us (17010us total) trans 21474840579 rc 0/0 00000100:00100000:3.0:1746144666.531469:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 947 00002000:00100000:3.0:1746144666.531485:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1310719) req@ffff88009ee08000 x1830964746850816/t21474840579(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.531495:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee08000 with x1830964746850816 ext(1048576->1310719) 00010000:00010000:3.0:1746144666.531505:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.531520:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:3.0:1746144666.531527:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee08000 00000100:00100000:1.0:1746144666.532856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.532885:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f169500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747560704:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144666.532896:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747560832:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.532918:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144666.532919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.532991:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746851200 00000100:00100000:3.0:1746144666.533003:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746851200 00010000:00010000:3.0:1746144666.533033:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 323 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.533056:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6125 00000100:00100000:3.0:1746144666.533063:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+323:1963:x1830964746851200:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.533077:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.533083:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 323 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.533097:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 323 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.533118:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5bae00/0xa7c849b16e01b60a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a2 expref: 323 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.533156:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144666.533162:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.533169:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.533175:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.533212:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:1963:x1830964746851200:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 149us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.533218:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6125 00000100:00100000:3.0:1746144666.533235:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746851328 00000100:00100000:3.0:1746144666.533238:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746851328 00010000:00010000:3.0:1746144666.533248:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 28 pid: 20319 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.533266:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6126 00000100:00100000:3.0:1746144666.533271:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746851328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144666.533279:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144666.533282:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 28 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.533295:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 28 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.533305:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b047c00/0xa7c849b16e01b5c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f878 expref: 28 pid: 20319 timeout: 745 lvb_type: 0 00010000:00010000:3.0:1746144666.533312:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144666.533315:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.533322:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.533328:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.533341:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.533352:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746851328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 81us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.533357:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6126 00010000:00010000:2.0:1746144666.533460:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.533466:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144666.533487:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144666.533634:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4daa00/0xa7c849b16e01b634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 323 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.533650:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 322 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.533661:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.533663:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144666.533665:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4da600, rc 0) 00000100:00100000:2.0:1746144666.533687:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:29373:x1830964746851072:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8222us (8832us total) trans 8589944099 rc 0/0 00000100:00100000:2.0:1746144666.533693:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10194 00000100:00100000:0.0:1746144666.537630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.538694:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.538891:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746851712 00000100:00100000:1.0:1746144666.538901:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746851712 00010000:00010000:1.0:1746144666.538946:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.538988:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6127 00000100:00100000:1.0:1746144666.538996:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746851712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.539011:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.539035:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.539047:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.539071:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c18200/0xa7c849b16e01b570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f863 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.539091:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.539093:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.539100:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.539109:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.539166:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.539180:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747560960:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144666.539263:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.539611:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746851584 00000100:00100000:3.0:1746144666.539616:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746851584 00002000:00100000:3.0:1746144666.539647:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f398700 x1830964746851584/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.539655:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398700 with x1830964746851584 ext(0->1048575) 00002000:00010000:3.0:1746144666.539660:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f398700 00000100:00100000:3.0:1746144666.539673:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4740 00000100:00100000:3.0:1746144666.539678:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746851584:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144666.549955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.550661:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747560960:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144666.550684:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.550732:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1960:x1830964746851712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 11736us (12039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.550743:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6127 00000100:00100000:2.0:1746144666.550847:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746851968 00000100:00100000:2.0:1746144666.550855:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746851968 00002000:00100000:2.0:1746144666.550908:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f398e00 x1830964746851968/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.550917:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398e00 with x1830964746851968 ext(1048576->2097151) 00002000:00010000:2.0:1746144666.551086:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f398e00 00000100:00100000:2.0:1746144666.551109:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4741 00000100:00100000:2.0:1746144666.551119:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746851968:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144666.551546:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746851584:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11866us (13926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.551552:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4740 00002000:00100000:3.0:1746144666.551558:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f398700 x1830964746851584/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.551564:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398700 with x1830964746851584 ext(0->1048575) 00002000:00010000:3.0:1746144666.551567:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f398700 00000100:00100000:0.0:1746144666.561909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.562311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.562354:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746852096 00000100:00100000:0.0:1746144666.562363:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746852096 00000100:00100000:0.0:1746144666.562402:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746852224 00000100:00100000:0.0:1746144666.562405:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746852224 00000100:00100000:0.0:1746144666.562429:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12241 00000100:00100000:0.0:1746144666.562437:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29370:x1830964746852096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.562457:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.562476:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8cc expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562506:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.562508:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.562515:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 17 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562530:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 17 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562541:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bbe00, rc 0) 00000100:00100000:0.0:1746144666.562585:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29370:x1830964746852096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 150us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.562592:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12241 00000100:00100000:0.0:1746144666.562607:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12242 00000100:00100000:0.0:1746144666.562612:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29373:x1830964746852224:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144666.562619:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.562628:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8d3 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562642:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562651:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.562656:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.562658:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.562661:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [909312->962559] (req 909312->962559) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 31 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562689:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.562702:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 745 lvb_type: 1 00000100:00100000:0.0:1746144666.562714:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561088:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144666.562773:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.562782:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:0.0:1746144666.562790:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561216:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.562810:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.562909:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746851968:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11791us (12963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.562918:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4741 00002000:00100000:2.0:1746144666.562928:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f398e00 x1830964746851968/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.562937:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f398e00 with x1830964746851968 ext(1048576->2097151) 00002000:00010000:2.0:1746144666.562942:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f398e00 00000100:00100000:0.0:1746144666.565516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.565575:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746852352 00000100:00100000:1.0:1746144666.565583:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746852352 00010000:00010000:1.0:1746144666.565625:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 18 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.565651:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6128 00000100:00100000:1.0:1746144666.565658:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746852352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.565671:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.565695:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 18 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.565704:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 18 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.565728:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.565776:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746852352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.565786:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6128 00000100:00100000:2.0:1746144666.565963:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561088:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.565988:0:3010:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044400/0xa7c849b16e01b5e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f894 expref: 17 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.566004:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561216:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.566033:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [909312->962559] (req 909312->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 31 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.566043:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5ba800, rc 0) 00000100:00100000:2.0:1746144666.566067:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29373:x1830964746852224:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3455us (3756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.566074:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12242 00000100:00100000:0.0:1746144666.568064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.568340:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746852480 00000100:00100000:2.0:1746144666.568346:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746852480 00010000:00010000:2.0:1746144666.568389:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 745 lvb_type: 1 00000100:00100000:2.0:1746144666.568417:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6129 00000100:00100000:2.0:1746144666.568424:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746852480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.568436:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.568456:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144666.568466:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144666.568487:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba200/0xa7c849b16e01b61f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8b0 expref: 31 pid: 8451 timeout: 745 lvb_type: 1 00010000:00010000:2.0:1746144666.568506:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.568508:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.568515:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.568523:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.568552:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.568563:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747561344:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.568641:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.569281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.569454:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746852736 00000100:00100000:2.0:1746144666.569457:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746852736 00002000:00100000:2.0:1746144666.569491:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ac000 x1830964746852736/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.569500:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac000 with x1830964746852736 ext(1048576->2097151) 00002000:00010000:2.0:1746144666.569504:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ac000 00000100:00100000:2.0:1746144666.569527:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4742 00000100:00100000:2.0:1746144666.569535:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746852736:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144666.571270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.571297:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746852992 00000100:00100000:2.0:1746144666.571302:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746852992 00002000:00100000:2.0:1746144666.571338:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (909312->913407) req@ffff88012b1cea00 x1830964746852992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.571347:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cea00 with x1830964746852992 ext(909312->913407) 00002000:00010000:2.0:1746144666.571352:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1cea00 00000100:00100000:2.0:1746144666.571368:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4743 00000100:00100000:2.0:1746144666.571377:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746852992:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144666.571486:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746852992:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 112us (222us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144666.571493:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4743 00002000:00100000:2.0:1746144666.571498:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (909312->913407) req@ffff88012b1cea00 x1830964746852992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.571505:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cea00 with x1830964746852992 ext(909312->913407) 00002000:00010000:2.0:1746144666.571508:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1cea00 00000100:00100000:3.0:1746144666.571607:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747561344:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144666.571631:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.571665:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746852480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3243us (3608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.571673:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6129 00000100:00100000:0.0:1746144666.577295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.577330:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746853248 00000100:00100000:0.0:1746144666.577339:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746853248 00002000:00100000:0.0:1746144666.577380:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (958464->962559) req@ffff880136958a80 x1830964746853248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.577396:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958a80 with x1830964746853248 ext(958464->962559) 00002000:00010000:0.0:1746144666.577401:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136958a80 00000100:00100000:0.0:1746144666.577432:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4744 00000100:00100000:0.0:1746144666.577439:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746853248:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144666.577601:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746853248:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 161us (314us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144666.577607:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4744 00002000:00100000:0.0:1746144666.577613:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e8:0x0] (958464->962559) req@ffff880136958a80 x1830964746853248/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.577619:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958a80 with x1830964746853248 ext(958464->962559) 00002000:00010000:0.0:1746144666.577622:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136958a80 00000100:00100000:2.0:1746144666.577638:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746852736:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 8095us (8348us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.577649:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4742 00002000:00100000:2.0:1746144666.577661:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920ac000 x1830964746852736/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.577669:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac000 with x1830964746852736 ext(1048576->2097151) 00002000:00010000:2.0:1746144666.577674:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ac000 00000100:00100000:0.0:1746144666.585526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.585573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.585636:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746853376 00000100:00100000:1.0:1746144666.585647:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746853376 00000100:00100000:1.0:1746144666.585845:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746853504 00000100:00100000:1.0:1746144666.585849:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746853504 00000100:00100000:2.0:1746144666.585863:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12243 00000100:00100000:2.0:1746144666.585890:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746853376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.585906:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.585922:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044800/0xa7c849b16e01b657 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8da expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.585966:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561472:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144666.585992:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12244 00000100:00100000:1.0:1746144666.586001:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746853504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.586015:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.586029:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7aca00/0xa7c849b16e01b65e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8e1 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.586068:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747561600:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144666.588116:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.588285:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.589613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.589631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.589711:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746853760 00000100:00100000:3.0:1746144666.589722:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746853760 00000100:00100000:0.0:1746144666.589736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.589759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.589787:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746854016 00000100:00100000:1.0:1746144666.589791:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746854016 00002000:00100000:1.0:1746144666.589822:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3366912->4194303) req@ffff88013695b480 x1830964746854016/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746144666.589850:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747561600:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144666.589877:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d7aca00/0xa7c849b16e01b65e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e1 expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.589889:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7aca00/0xa7c849b16e01b65e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e1 expref: 18 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.589906:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7aca00, rc 0) 00000100:00100000:0.0:1746144666.589939:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746853504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3939us (4364us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144666.589945:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12244 00002000:00100000:3.0:1746144666.590118:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3366911) req@ffff880136959f80 x1830964746853760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 504/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.590124:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959f80 with x1830964746853760 ext(2097152->3366911) 00002000:00010000:3.0:1746144666.590129:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136959f80 00000100:00100000:3.0:1746144666.590182:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746854272 00000100:00100000:2.0:1746144666.590185:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561472:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144666.590186:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746854272 00002000:00100000:3.0:1746144666.590201:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2899968->3948543) req@ffff88013695b800 x1830964746854272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.590207:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b800 with x1830964746854272 ext(2899968->3948543) 00010000:00010000:2.0:1746144666.590209:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044800/0xa7c849b16e01b657 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8da expref: 31 pid: 3010 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746144666.590210:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695b800 00010000:00010000:2.0:1746144666.590218:0:3010:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044800/0xa7c849b16e01b657 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8da expref: 31 pid: 3010 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144666.590227:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746854528 00000100:00100000:3.0:1746144666.590229:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746854528 00010000:00010000:2.0:1746144666.590232:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044800, rc 0) 00002000:00100000:3.0:1746144666.590238:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3948544->4194303) req@ffff880136958380 x1830964746854528/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.590243:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958380 with x1830964746854528 ext(3948544->4194303) 00002000:00010000:3.0:1746144666.590245:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136958380 00000100:00100000:2.0:1746144666.590251:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4745 00000100:00100000:2.0:1746144666.590260:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746853760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144666.590268:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4746 00000100:00100000:3.0:1746144666.590274:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746854272:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:1.0:1746144666.590279:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b480 with x1830964746854016 ext(3366912->4194303) 00002000:00010000:1.0:1746144666.590282:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013695b480 00000100:00100000:1.0:1746144666.590295:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4747 00000100:00100000:1.0:1746144666.590300:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746854528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.590325:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4748 00000100:00100000:1.0:1746144666.590329:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746854016:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144666.590882:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746853376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5007us (5364us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144666.590887:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12243 00000100:00100000:0.0:1746144666.594534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.594583:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746854656 00000100:00100000:2.0:1746144666.594590:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746854656 00000100:00100000:2.0:1746144666.594637:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12245 00000100:00100000:2.0:1746144666.594646:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:29370:x1830964746854656:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.594660:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.594675:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8e8 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.594701:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.594710:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144666.594711:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144666.594714:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 31 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.594737:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.594748:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 20 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.594758:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561728:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144666.594808:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.604559:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746854528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14245us (14784us total) trans 0 rc 245760/245760 00000100:00100000:1.0:1746144666.604577:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4747 00002000:00100000:1.0:1746144666.604592:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3948544->4194303) req@ffff880136958380 x1830964746854528/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 245760/245760 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.604602:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958380 with x1830964746854528 ext(3948544->4194303) 00002000:00010000:1.0:1746144666.604607:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136958380 00000100:00100000:3.0:1746144666.605122:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747561728:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.606035:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 31 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.606055:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5044600, rc 0) 00000100:00100000:3.0:1746144666.606111:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29370:x1830964746854656:12345-192.168.204.23@tcp:101:cat.0 Request processed in 11466us (11584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.606120:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12245 00000100:00100000:0.0:1746144666.609373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.609450:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746854784 00000100:00100000:1.0:1746144666.609460:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746854784 00002000:00100000:1.0:1746144666.609506:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2924544->3145727) req@ffff880136958000 x1830964746854784/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.609516:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958000 with x1830964746854784 ext(2924544->3145727) 00010000:00010000:1.0:1746144666.609525:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 21 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.609541:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 21 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:1.0:1746144666.609547:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136958000 00000100:00100000:1.0:1746144666.609582:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 948 00000100:00100000:1.0:1746144666.609589:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746854784:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144666.613704:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746854272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23415us (23952us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.613717:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4746 00002000:00100000:3.0:1746144666.613731:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2899968->3948543) req@ffff88013695b800 x1830964746854272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.613741:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b800 with x1830964746854272 ext(2899968->3948543) 00002000:00010000:3.0:1746144666.613748:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013695b800 00000100:00100000:1.0:1746144666.618204:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746854016:12345-192.168.204.23@tcp:3:cat.0 Request processed in 27861us (28558us total) trans 0 rc 827392/827392 00000100:00100000:0.0:1746144666.618204:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746854784:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8605us (8832us total) trans 17179873356 rc 0/0 00000100:00100000:0.0:1746144666.618216:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 948 00000100:00100000:1.0:1746144666.618224:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4748 00002000:00100000:0.0:1746144666.618227:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2924544->3145727) req@ffff880136958000 x1830964746854784/t17179873356(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.618230:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3366912->4194303) req@ffff88013695b480 x1830964746854016/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.618237:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136958000 with x1830964746854784 ext(2924544->3145727) 00002000:00100000:1.0:1746144666.618243:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695b480 with x1830964746854016 ext(3366912->4194303) 00010000:00010000:0.0:1746144666.618247:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 22 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.618249:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 22 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.618262:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 22 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.618264:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 22 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:0.0:1746144666.618269:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136958000 00002000:00010000:1.0:1746144666.618270:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013695b480 00000100:00100000:2.0:1746144666.621745:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746853760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 31475us (32125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.621757:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4745 00002000:00100000:2.0:1746144666.621769:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3366911) req@ffff880136959f80 x1830964746853760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 504/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.621779:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959f80 with x1830964746853760 ext(2097152->3366911) 00010000:00010000:2.0:1746144666.621789:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 19 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.621804:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 19 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.621816:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136959f80 00000100:00100000:1.0:1746144666.633896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.633929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.633992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.634019:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746855296 00000100:00100000:1.0:1746144666.634029:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746855296 00010000:00010000:1.0:1746144666.634067:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 19 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.634094:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6130 00000100:00100000:1.0:1746144666.634102:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746855296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.634117:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.634157:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 19 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.634169:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 19 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.634192:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b046400/0xa7c849b16e01b5e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2924544->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f88d expref: 19 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.634220:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.634222:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144666.634231:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.635954:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746855040 00000100:00100000:2.0:1746144666.635963:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746855040 00000100:00100000:3.0:1746144666.635966:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746855168 00000100:00100000:3.0:1746144666.635971:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746855168 00000100:00100000:3.0:1746144666.636018:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12246 00000100:00100000:2.0:1746144666.636018:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10195 00000100:00100000:3.0:1746144666.636025:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:16261e74-be72-4bb6-b857-d78345d984f7+19:29366:x1830964746855168:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144666.636025:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+27:29376:x1830964746855040:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144666.636035:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.636042:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.636042:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.636054:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8f6 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.636055:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01b673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8ef expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.636072:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.636074:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.636078:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 20 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.636088:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 20 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.636089:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.636096:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130ff4800, rc 0) 00000100:00100000:1.0:1746144666.636103:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747561856:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144666.636158:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:16261e74-be72-4bb6-b857-d78345d984f7+20:29366:x1830964746855168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 134us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.636164:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12246 00000100:00100000:1.0:1746144666.636177:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b560c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144666.636186:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636197:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636206:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636218:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636223:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636228:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636340:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b688 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636349:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b688 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636355:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b688 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144666.636363:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144666.636448:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636456:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636461:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636467:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5044200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144666.636471:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636476:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636485:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144666.636488:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144666.636491:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636496:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044200/0xa7c849b16e01b67a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636522:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636527:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636534:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636537:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5044c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144666.636539:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636542:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636546:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f3c3400) 00010000:00010000:2.0:1746144666.636548:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144666.636549:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636553:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044c00/0xa7c849b16e01b681 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144666.636587:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5044800/0xa7c849b16e01b673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8ef expref: 30 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.636595:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b688 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8ef expref: 29 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.636600:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144666.636602:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144666.636604:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5045600, rc 0) 00000100:00100000:2.0:1746144666.636625:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+29:29376:x1830964746855040:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 601us (2740us total) trans 8589944100 rc 0/0 00000100:00100000:2.0:1746144666.636631:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10195 00000100:00100000:1.0:1746144666.640210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.640302:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746855424 00000100:00100000:0.0:1746144666.640311:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746855424 00000100:00100000:0.0:1746144666.640373:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 646 00000100:00100000:0.0:1746144666.640381:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746855424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.640396:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144666.640729:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5045600/0xa7c849b16e01b688 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8ef expref: 29 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.640755:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144666.640759:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144666.640798:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746855424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 418us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.640804:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 646 00000100:00100000:0.0:1746144666.642794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.642880:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746855680 00000100:00100000:2.0:1746144666.642887:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746855680 00002000:00100000:2.0:1746144666.642944:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b5f6680 x1830964746855680/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.642954:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6680 with x1830964746855680 ext(3145728->4194303) 00002000:00010000:2.0:1746144666.642960:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6680 00000100:00100000:2.0:1746144666.643739:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4749 00000100:00100000:2.0:1746144666.643750:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746855680:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144666.648746:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747561856:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144666.648775:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.648829:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746855296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 14726us (14836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.648840:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6130 00000100:00100000:0.0:1746144666.654335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.654425:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746855936 00000100:00100000:1.0:1746144666.654438:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746855936 00002000:00100000:1.0:1746144666.654488:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b5f5180 x1830964746855936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.654498:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5180 with x1830964746855936 ext(2097152->3145727) 00002000:00010000:1.0:1746144666.654504:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f5180 00000100:00100000:1.0:1746144666.654545:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4750 00000100:00100000:1.0:1746144666.654552:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746855936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144666.660096:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746855680:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16334us (17294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.660111:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4749 00002000:00100000:3.0:1746144666.660126:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b5f6680 x1830964746855680/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.660149:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f6680 with x1830964746855680 ext(3145728->4194303) 00002000:00010000:3.0:1746144666.660156:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f6680 00000100:00100000:1.0:1746144666.670990:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746855936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16417us (16642us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144666.671003:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4750 00002000:00100000:1.0:1746144666.671016:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012b5f5180 x1830964746855936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.671309:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f5180 with x1830964746855936 ext(2097152->3145727) 00002000:00010000:1.0:1746144666.671315:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b5f5180 00000100:00100000:0.0:1746144666.673049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.673175:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856064 00000100:00100000:1.0:1746144666.673185:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856064 00000100:00100000:1.0:1746144666.673230:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12247 00000100:00100000:1.0:1746144666.673237:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746856064:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.673253:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.673273:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f33f600/0xa7c849b16e01b696 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f8fd expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.673320:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747561984:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144666.673583:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.674530:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747561984:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.674558:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f33f600/0xa7c849b16e01b696 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8fd expref: 20 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.674571:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f33f600/0xa7c849b16e01b696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8fd expref: 20 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.674600:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f33f600, rc 0) 00000100:00100000:1.0:1746144666.674634:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746856064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1396us (1591us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144666.674641:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12247 00000100:00100000:0.0:1746144666.675462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.675521:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856192 00000100:00100000:1.0:1746144666.675526:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856192 00000100:00100000:1.0:1746144666.675720:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12248 00000100:00100000:1.0:1746144666.675727:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29370:x1830964746856192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.675740:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.675753:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f904 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.675776:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.675783:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144666.675785:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144666.675788:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.675812:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 8 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.675823:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 8 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.675838:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747562112:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144666.676369:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.684673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.684720:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747562112:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144666.684757:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 18 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.684776:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f33e200, rc 0) 00000100:00100000:2.0:1746144666.684835:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856448 00000100:00100000:2.0:1746144666.684844:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856448 00000100:00100000:0.0:1746144666.684845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00100000:2.0:1746144666.684907:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2899967) req@ffff880092935c00 x1830964746856448/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.684921:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935c00 with x1830964746856448 ext(2097152->2899967) 00010000:00010000:2.0:1746144666.684927:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 9 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.684942:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 9 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.684949:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092935c00 00000100:00100000:2.0:1746144666.684982:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856576 00000100:00100000:2.0:1746144666.684985:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856576 00000100:00100000:3.0:1746144666.685000:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 949 00000100:00100000:1.0:1746144666.685000:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29370:x1830964746856192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9272us (9538us total) trans 0 rc 0/0 00002000:00100000:2.0:1746144666.685001:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880092935f80 x1830964746856576/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.685007:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935f80 with x1830964746856576 ext(4194304->4935679) 00000100:00100000:1.0:1746144666.685008:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12248 00000100:00100000:3.0:1746144666.685011:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746856448:12345-192.168.204.23@tcp:4:cat.0 00002000:00010000:2.0:1746144666.685011:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935f80 00000100:00100000:2.0:1746144666.685026:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4751 00000100:00100000:2.0:1746144666.685031:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746856576:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144666.692942:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746856576:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7897us (8084us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144666.692956:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4751 00002000:00100000:2.0:1746144666.692969:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880092935f80 x1830964746856576/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.692987:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935f80 with x1830964746856576 ext(4194304->4935679) 00002000:00010000:2.0:1746144666.692993:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935f80 00000100:00100000:0.0:1746144666.696397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.696629:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856704 00000100:00100000:1.0:1746144666.696639:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856704 00000100:00100000:1.0:1746144666.696697:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12249 00000100:00100000:1.0:1746144666.696704:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746856704:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.696723:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.696742:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f33f000/0xa7c849b16e01b6a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f90b expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.696795:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747562240:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144666.696869:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.696924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.696951:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856832 00000100:00100000:3.0:1746144666.696956:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856832 00000100:00100000:3.0:1746144666.696989:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12250 00000100:00100000:3.0:1746144666.696995:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746856832:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.697002:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.697012:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb2d600/0xa7c849b16e01b6ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f912 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144666.697037:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747562368:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144666.697059:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.698825:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747562240:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.698855:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f33f000/0xa7c849b16e01b6a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f90b expref: 20 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.698871:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f33f000/0xa7c849b16e01b6a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f90b expref: 20 pid: 4760 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144666.698932:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747562368:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144666.698948:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb2d600/0xa7c849b16e01b6ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f912 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.698956:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb2d600/0xa7c849b16e01b6ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f912 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144666.698969:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb2d600, rc 0) 00000100:00100000:2.0:1746144666.699023:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746856832:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2027us (2097us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144666.699030:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12250 00010000:00010000:1.0:1746144666.699201:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f33f000, rc 0) 00000100:00100000:1.0:1746144666.699220:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746856704:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2517us (2833us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144666.699226:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12249 00000100:00100000:2.0:1746144666.699583:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:1963:x1830964746856448:12345-192.168.204.23@tcp:4:cat.0 Request processed in 14573us (14918us total) trans 21474840580 rc 0/0 00000100:00100000:2.0:1746144666.699590:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 949 00002000:00100000:2.0:1746144666.699599:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->2899967) req@ffff880092935c00 x1830964746856448/t21474840580(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.699608:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935c00 with x1830964746856448 ext(2097152->2899967) 00010000:00010000:2.0:1746144666.699616:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 11 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.699629:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 11 pid: 30345 timeout: 745 lvb_type: 0 00002000:00010000:2.0:1746144666.699635:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092935c00 00000100:00100000:0.0:1746144666.707951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.708017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.708076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.708089:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746857088 00000100:00100000:2.0:1746144666.708099:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746857088 00000100:00100000:0.0:1746144666.708114:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746857216 00000100:00100000:0.0:1746144666.708118:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746857216 00010000:00010000:0.0:1746144666.708173:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 12 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.708630:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746856960 00000100:00100000:2.0:1746144666.708634:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746856960 00000100:00100000:1.0:1746144666.708637:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12251 00000100:00100000:1.0:1746144666.708647:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+12:1962:x1830964746857088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144666.708668:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144666.708688:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f33fc00/0xa7c849b16e01b6b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f920 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.708690:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12252 00000100:00100000:2.0:1746144666.708697:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746856960:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.708704:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.708713:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c901e00/0xa7c849b16e01b6b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f919 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.708742:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747562496:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144666.708742:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747562624:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144666.708809:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6131 00000100:00100000:0.0:1746144666.708818:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746857216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144666.708827:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144666.708960:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 13 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.708979:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 13 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:0.0:1746144666.708998:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.709000:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.709007:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.709014:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.709148:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.709225:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00010000:00010000:0.0:1746144666.713309:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 17 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.713358:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747562752:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144666.713515:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.716640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.716727:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746857344 00000100:00100000:3.0:1746144666.716740:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746857344 00000100:00100000:3.0:1746144666.716817:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12253 00000100:00100000:3.0:1746144666.716828:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29378:x1830964746857344:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.716853:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.716875:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f927 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.716912:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.716921:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.716928:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.716930:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.716934:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1990656->2043903] (req 1990656->2043903) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 19 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.716983:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.716998:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 19 pid: 3010 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.717011:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747562880:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.717168:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.717177:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 13 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.717184:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563008:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.717218:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.718494:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092935880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747562752:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.718512:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.718527:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747562496:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144666.718555:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746857216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9737us (10478us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144666.718560:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c901e00/0xa7c849b16e01b6b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f919 expref: 20 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144666.718564:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6131 00010000:00010000:3.0:1746144666.718571:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c901e00/0xa7c849b16e01b6b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f919 expref: 20 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.718588:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c901e00, rc 0) 00000100:00100000:3.0:1746144666.718608:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746856960:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9912us (10592us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144666.718613:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12252 00010000:00010000:1.0:1746144666.718696:0:4760:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff8800a4dd7800 x1830964747562624) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 12 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:1.0:1746144666.718720:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3eaa00/0xa7c849b16e01b5ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2899967) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f89b expref: 12 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:1.0:1746144666.718910:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747562624:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144666.718933:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f33fc00/0xa7c849b16e01b6b2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f920 expref: 11 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.718943:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f33fc00/0xa7c849b16e01b6b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f920 expref: 11 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144666.718950:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f33fc00, rc 0) 00000100:00100000:1.0:1746144666.718989:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746857088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 10344us (11052us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144666.718996:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12251 00000100:00100000:3.0:1746144666.721825:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747562880:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.721825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.721839:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563008:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.721865:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1990656->2043903] (req 1990656->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 19 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.721875:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746857472 00010000:00010000:3.0:1746144666.721879:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd200, rc 0) 00000100:00100000:2.0:1746144666.721882:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746857472 00010000:00010000:2.0:1746144666.721921:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 10 pid: 30345 timeout: 745 lvb_type: 0 00000100:00100000:3.0:1746144666.721926:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29378:x1830964746857344:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5101us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.721932:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12253 00000100:00100000:2.0:1746144666.721944:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6132 00000100:00100000:2.0:1746144666.721951:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746857472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.721964:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.721994:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 10 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.722003:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 10 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.722025:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb000/0xa7c849b16e01b618 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8a9 expref: 10 pid: 30345 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.722038:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.722056:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+9:1962:x1830964746857472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.722061:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6132 00010000:00010000:0.0:1746144666.723368:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144666.728044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.728088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.728115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.728147:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746857856 00000100:00100000:3.0:1746144666.728158:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746857856 00000100:00100000:0.0:1746144666.728169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.728201:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746858112 00000100:00100000:0.0:1746144666.728204:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746858112 00002000:00100000:3.0:1746144666.728207:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880092936300 x1830964746857856/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.728217:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936300 with x1830964746857856 ext(2097152->3145727) 00002000:00100000:0.0:1746144666.728218:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092936680 x1830964746858112/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:3.0:1746144666.728223:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092936300 00002000:00100000:0.0:1746144666.728225:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936680 with x1830964746858112 ext(3145728->4194303) 00002000:00010000:0.0:1746144666.728227:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092936680 00000100:00100000:2.0:1746144666.728298:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746857600 00000100:00100000:2.0:1746144666.728302:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746857600 00010000:00010000:2.0:1746144666.728337:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 21 pid: 3010 timeout: 745 lvb_type: 0 00000100:00100000:2.0:1746144666.728367:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6133 00000100:00100000:2.0:1746144666.728374:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746857600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.728392:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.728413:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 21 pid: 3010 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.728424:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 21 pid: 3010 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.728444:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bbe00/0xa7c849b16e01b649 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8cc expref: 21 pid: 3010 timeout: 745 lvb_type: 0 00010000:00010000:2.0:1746144666.728459:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.728461:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.728468:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.728475:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.728506:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.728518:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747563136:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.728597:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8600 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.729374:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746858368 00000100:00100000:1.0:1746144666.729379:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746858368 00000100:00100000:3.0:1746144666.729394:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4752 00000100:00100000:3.0:1746144666.729401:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746858112:12345-192.168.204.23@tcp:3:multiop.0 00002000:00100000:1.0:1746144666.729405:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092935880 x1830964746858368/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.729412:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935880 with x1830964746858368 ext(3145728->4194303) 00002000:00010000:1.0:1746144666.729415:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935880 00000100:00100000:1.0:1746144666.729428:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4753 00000100:00100000:1.0:1746144666.729432:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746857856:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144666.730695:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4754 00000100:00100000:0.0:1746144666.730707:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746858368:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144666.731007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.731031:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746858624 00000100:00100000:3.0:1746144666.731035:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746858624 00000100:00100000:3.0:1746144666.731060:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4148 00000100:00100000:3.0:1746144666.731064:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:29366:x1830964746858624:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144666.731237:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+29:29366:x1830964746858624:12345-192.168.204.23@tcp:35:cat.0 Request processed in 170us (230us total) trans 8589944101 rc 0/0 00000100:00100000:3.0:1746144666.731242:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4148 00000100:00100000:0.0:1746144666.744450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.744515:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746858880 00000100:00100000:1.0:1746144666.744526:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746858880 00002000:00100000:1.0:1746144666.744573:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1990656->1994751) req@ffff8800a51ece00 x1830964746858880/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.744584:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ece00 with x1830964746858880 ext(1990656->1994751) 00002000:00010000:1.0:1746144666.744590:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ece00 00000100:00100000:2.0:1746144666.744609:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747563136:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144666.744629:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4755 00010000:00010000:2.0:1746144666.744634:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.744636:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746858880:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144666.744676:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746857600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 16302us (16644us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.744686:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6133 00000100:00100000:1.0:1746144666.745211:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746858880:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 574us (771us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144666.745218:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4755 00002000:00100000:1.0:1746144666.745224:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1990656->1994751) req@ffff8800a51ece00 x1830964746858880/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.745231:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ece00 with x1830964746858880 ext(1990656->1994751) 00002000:00010000:1.0:1746144666.745235:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ece00 00000100:00100000:3.0:1746144666.747741:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746858112:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 18329us (19613us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144666.747752:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4752 00002000:00100000:3.0:1746144666.747763:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880092936680 x1830964746858112/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.747773:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936680 with x1830964746858112 ext(3145728->4194303) 00002000:00010000:3.0:1746144666.747779:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092936680 00000100:00100000:1.0:1746144666.750939:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746857856:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 21495us (22839us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144666.750951:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4753 00002000:00100000:1.0:1746144666.750961:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880092936300 x1830964746857856/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.750981:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936300 with x1830964746857856 ext(2097152->3145727) 00002000:00010000:1.0:1746144666.750986:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092936300 00000100:00100000:2.0:1746144666.755665:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746858368:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 24950us (27483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144666.755678:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4754 00002000:00100000:2.0:1746144666.755690:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880092935880 x1830964746858368/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.755700:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092935880 with x1830964746858368 ext(3145728->4194303) 00002000:00010000:2.0:1746144666.755705:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092935880 00000100:00100000:0.0:1746144666.757191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.757255:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746859136 00000100:00100000:2.0:1746144666.757264:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746859136 00002000:00100000:2.0:1746144666.757318:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (2039808->2043903) req@ffff880093e30e00 x1830964746859136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.757326:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30e00 with x1830964746859136 ext(2039808->2043903) 00002000:00010000:2.0:1746144666.757330:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e30e00 00000100:00100000:2.0:1746144666.757390:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4756 00000100:00100000:2.0:1746144666.757400:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746859136:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144666.758304:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746859136:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 903us (1114us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144666.758311:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4756 00002000:00100000:2.0:1746144666.758317:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (2039808->2043903) req@ffff880093e30e00 x1830964746859136/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.758325:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e30e00 with x1830964746859136 ext(2039808->2043903) 00002000:00010000:2.0:1746144666.758328:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e30e00 00000100:00100000:0.0:1746144666.763326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.763491:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746859392 00000100:00100000:2.0:1746144666.763501:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746859392 00002000:00100000:2.0:1746144666.763558:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093e33100 x1830964746859392/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.763569:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33100 with x1830964746859392 ext(4194304->4935679) 00002000:00010000:2.0:1746144666.763575:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e33100 00000100:00100000:2.0:1746144666.763641:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4757 00000100:00100000:2.0:1746144666.763649:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746859392:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144666.776917:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746859392:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13258us (13593us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144666.776929:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4757 00002000:00100000:2.0:1746144666.776942:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093e33100 x1830964746859392/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.776949:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33100 with x1830964746859392 ext(4194304->4935679) 00002000:00010000:2.0:1746144666.776955:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e33100 00000100:00100000:0.0:1746144666.802363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.804689:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746859520 00000100:00100000:3.0:1746144666.804702:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746859520 00000100:00100000:3.0:1746144666.804768:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12254 00000100:00100000:3.0:1746144666.804777:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+9:29376:x1830964746859520:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.804798:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.804817:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f92e expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.804848:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.804856:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144666.804858:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144666.804861:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1515520->2097151] (req 1515520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 10 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.804902:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 17 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.804914:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 17 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144666.804925:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563264:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.805025:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.807310:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563264:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.807342:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1515520->2097151] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 10 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.807359:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0a4400, rc 0) 00000100:00100000:3.0:1746144666.807400:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+10:29376:x1830964746859520:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2624us (5048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.807409:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12254 00000100:00100000:2.0:1746144666.808847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.809368:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746859648 00000100:00100000:3.0:1746144666.809377:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746859648 00002000:00100000:3.0:1746144666.809422:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1990656->2043903) req@ffff88012b1cc700 x1830964746859648/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.809432:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cc700 with x1830964746859648 ext(1990656->2043903) 00010000:00010000:3.0:1746144666.809441:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 18 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144666.809459:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 18 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746144666.809465:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1cc700 00000100:00100000:3.0:1746144666.810049:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 950 00000100:00100000:3.0:1746144666.810057:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746859648:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144666.812603:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746859648:12345-192.168.204.23@tcp:4:cat.0 Request processed in 2537us (3752us total) trans 21474840581 rc 0/0 00000100:00100000:3.0:1746144666.812614:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 950 00002000:00100000:3.0:1746144666.812624:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1990656->2043903) req@ffff88012b1cc700 x1830964746859648/t21474840581(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.812634:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cc700 with x1830964746859648 ext(1990656->2043903) 00010000:00010000:3.0:1746144666.812644:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144666.812659:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746144666.812665:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1cc700 00000100:00100000:0.0:1746144666.814424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.814498:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746859776 00000100:00100000:2.0:1746144666.814508:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746859776 00010000:00010000:2.0:1746144666.814562:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144666.814598:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6134 00000100:00100000:2.0:1746144666.814607:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746859776:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.814622:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.814642:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.814654:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.814680:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01b6c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2043903) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f927 expref: 20 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.814711:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.814713:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.814721:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.814729:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.814763:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.814774:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747563392:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.814861:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.817211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.817453:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746860032 00000100:00100000:3.0:1746144666.817461:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746860032 00002000:00100000:3.0:1746144666.817502:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1515520->1519615) req@ffff880093e33480 x1830964746860032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.817511:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33480 with x1830964746860032 ext(1515520->1519615) 00002000:00010000:3.0:1746144666.817517:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e33480 00000100:00100000:3.0:1746144666.817536:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4758 00000100:00100000:3.0:1746144666.817543:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746860032:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144666.817722:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746860032:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 178us (518us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144666.817729:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4758 00002000:00100000:3.0:1746144666.817734:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1515520->1519615) req@ffff880093e33480 x1830964746860032/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144666.817740:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e33480 with x1830964746860032 ext(1515520->1519615) 00002000:00010000:3.0:1746144666.817743:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e33480 00000100:00100000:2.0:1746144666.817946:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747563392:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.817983:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.818302:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746859776:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3695us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.818310:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6134 00000100:00100000:0.0:1746144666.825558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.825656:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746860160 00000100:00100000:3.0:1746144666.825667:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746860160 00000100:00100000:3.0:1746144666.826077:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12255 00000100:00100000:3.0:1746144666.826086:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+10:29376:x1830964746860160:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.826105:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.826125:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f935 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.826192:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.826201:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 5 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.826208:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 18 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.826215:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.826217:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.826220:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1376255] (req 1048576->1376255) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.826251:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 18 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.826261:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 18 pid: 22208 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144666.826273:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563520:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.828129:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 5 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.828163:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 5 pid: 29370 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144666.828174:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563648:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.829646:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.829659:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144666.829675:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563776:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.829698:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144666.833609:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563520:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.833624:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563648:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.833632:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747563776:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.833664:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->1376255] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 11 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.833683:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5a00, rc 0) 00000100:00100000:3.0:1746144666.833740:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+11:29376:x1830964746860160:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7654us (8193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.833748:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12255 00000100:00100000:0.0:1746144666.837948:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.838013:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.838016:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746860288 00000100:00100000:2.0:1746144666.838026:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746860288 00000100:00100000:0.0:1746144666.838044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.838070:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746860544 00000100:00100000:0.0:1746144666.838074:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746860544 00010000:00010000:2.0:1746144666.838082:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 19 pid: 22208 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746144666.838090:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144666.838109:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746860416 00000100:00100000:2.0:1746144666.838111:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746860416 00000100:00100000:0.0:1746144666.838119:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6135 00010000:00010000:2.0:1746144666.838120:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 6 pid: 29370 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746144666.838127:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1962:x1830964746860288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144666.838153:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6136 00010000:00010000:0.0:1746144666.838156:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144666.838159:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746860544:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.838166:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.838178:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746144666.838179:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 19 pid: 22208 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144666.838189:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746144666.838196:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 19 pid: 22208 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144666.838293:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864000/0xa7c849b16e01b482 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7c9 expref: 11 pid: 29370 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.838312:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.838339:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6137 00000100:00100000:3.0:1746144666.838347:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746860416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144666.838350:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746860544:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 192us (336us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144666.838355:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144666.838356:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6136 00010000:00010000:3.0:1746144666.838365:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 6 pid: 29370 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746144666.838373:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 6 pid: 29370 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746144666.838384:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4864400/0xa7c849b16e01b546 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f840 expref: 6 pid: 29370 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746144666.838407:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144666.838430:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1962:x1830964746860416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 84us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.838436:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6137 00010000:00010000:0.0:1746144666.838920:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304b400/0xa7c849b16e01b4a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7ec expref: 19 pid: 22208 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746144666.839088:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.839090:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.839097:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.839105:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.839154:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 9 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.839166:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747563904:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144666.839215:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800998526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.844814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.844821:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747563904:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.844842:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.844889:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1962:x1830964746860288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6763us (6953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.844900:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6135 00000100:00100000:1.0:1746144666.845013:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746860800 00000100:00100000:1.0:1746144666.845022:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746860800 00002000:00100000:1.0:1746144666.845065:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1372160->1376255) req@ffff88009f437b80 x1830964746860800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.845076:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437b80 with x1830964746860800 ext(1372160->1376255) 00002000:00010000:1.0:1746144666.845081:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437b80 00000100:00100000:1.0:1746144666.845098:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4759 00000100:00100000:1.0:1746144666.845105:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746860800:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144666.845306:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+10:1960:x1830964746860800:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 201us (501us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144666.845313:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4759 00002000:00100000:1.0:1746144666.845318:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1372160->1376255) req@ffff88009f437b80 x1830964746860800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.845325:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f437b80 with x1830964746860800 ext(1372160->1376255) 00002000:00010000:1.0:1746144666.845327:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f437b80 00000100:00100000:0.0:1746144666.849891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.850083:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861056 00000100:00100000:3.0:1746144666.850094:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861056 00000100:00100000:3.0:1746144666.850164:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4149 00000100:00100000:3.0:1746144666.850173:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+29:29376:x1830964746861056:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144666.850414:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+30:29376:x1830964746861056:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 241us (532us total) trans 8589944102 rc 0/0 00000100:00100000:3.0:1746144666.850420:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4149 00000100:00100000:0.0:1746144666.949803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.950176:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861184 00000100:00100000:3.0:1746144666.950186:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861184 00000100:00100000:3.0:1746144666.950246:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12256 00000100:00100000:3.0:1746144666.950253:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29384:x1830964746861184:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144666.950274:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.950295:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f93c expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.950329:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 32 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.950338:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 18 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.950348:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.950350:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144666.950353:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3620864->4034559] (req 3620864->4034559) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 32 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.950385:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 18 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.950397:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144666.950409:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747564032:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144666.950502:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 32 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.950510:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 32 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144666.950517:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747564160:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.950535:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.958807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.959033:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861568 00000100:00100000:3.0:1746144666.959043:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861568 00000100:00100000:3.0:1746144666.959093:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10196 00000100:00100000:3.0:1746144666.959102:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+30:29387:x1830964746861568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144666.959130:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144666.959171:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5000/0xa7c849b16e01b6dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f943 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.959287:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959300:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959312:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959323:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959328:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959332:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959426:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b6f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959433:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959438:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144666.959445:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144666.959521:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959527:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959533:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959538:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4272800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.959541:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959546:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959556:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144666.959559:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.959562:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959566:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4272800/0xa7c849b16e01b6e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959579:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959584:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959588:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959591:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4273400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144666.959593:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959596:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959604:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea200) 00010000:00010000:3.0:1746144666.959606:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144666.959608:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959612:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b6ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144666.959642:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0a5000/0xa7c849b16e01b6dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f943 expref: 33 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.959650:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f943 expref: 32 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144666.959655:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144666.959662:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144666.959664:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273a00, rc 0) 00000100:00100000:3.0:1746144666.959711:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:29387:x1830964746861568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 610us (917us total) trans 8589944103 rc 0/0 00000100:00100000:3.0:1746144666.959718:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10196 00000100:00100000:3.0:1746144666.959762:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747564032:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144666.959813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.959837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.959862:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747564160:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144666.959878:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861312 00010000:00010000:3.0:1746144666.959884:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3620864->4034559] (req 3620864->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 32 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144666.959884:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861312 00010000:00010000:3.0:1746144666.959901:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5200, rc 0) 00010000:00010000:1.0:1746144666.959903:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144666.959926:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861696 00000100:00100000:1.0:1746144666.959929:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861696 00010000:00010000:1.0:1746144666.959940:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144666.959952:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6138 00000100:00100000:1.0:1746144666.959958:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746861312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.959978:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.959995:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144666.960004:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144666.960021:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5044600/0xa7c849b16e01b665 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8e8 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144666.960038:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.960939:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6139 00000100:00100000:2.0:1746144666.960976:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746861696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.960987:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144666.960989:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29384:x1830964746861184:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10734us (11195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144666.960995:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12256 00010000:00010000:2.0:1746144666.961002:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.961012:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.961027:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130ff4800/0xa7c849b16e01b66c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8f6 expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.961042:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.961044:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.961053:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 31 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.961061:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 31 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.961094:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 31 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.961110:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747564288:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144666.961490:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746861312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1530us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.961502:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6138 00000100:00100000:2.0:1746144666.962110:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.963883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.964028:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861824 00000100:00100000:1.0:1746144666.964037:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861824 00000100:00100000:1.0:1746144666.964093:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 647 00000100:00100000:1.0:1746144666.964100:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746861824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144666.964112:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144666.964157:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b6f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f943 expref: 32 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144666.964181:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144666.964186:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144666.964220:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+31:1962:x1830964746861824:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.964226:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 647 00000100:00100000:3.0:1746144666.965525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.966058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144666.966116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144666.966891:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746861952 00000100:00100000:1.0:1746144666.966898:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746861952 00000100:00100000:2.0:1746144666.966994:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746862080 00000100:00100000:0.0:1746144666.966995:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746862208 00000100:00100000:2.0:1746144666.966998:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746862080 00000100:00100000:0.0:1746144666.966998:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746862208 00000100:00100000:2.0:1746144666.967040:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12257 00000100:00100000:0.0:1746144666.967045:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12258 00000100:00100000:2.0:1746144666.967047:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746861952:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144666.967050:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:1962:x1830964746862208:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144666.967066:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.967066:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144666.967082:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eae5600/0xa7c849b16e01b6ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f94a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.967082:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f958 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.967102:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.967104:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144666.967111:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.967125:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144666.967146:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747564416:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144666.967146:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb6400, rc 0) 00000100:00100000:0.0:1746144666.967184:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746862208:12345-192.168.204.23@tcp:101:cat.0 Request processed in 133us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144666.967189:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12258 00000100:00100000:0.0:1746144666.967204:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12259 00000100:00100000:0.0:1746144666.967209:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746862080:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.967215:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.967221:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bb6600/0xa7c849b16e01b70d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f951 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144666.967244:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747564544:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144666.967811:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.967851:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144666.968029:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747564288:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.968047:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.968314:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746861696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7367us (8475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144666.968317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.968322:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6139 00000100:00100000:2.0:1746144666.968350:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746862464 00000100:00100000:2.0:1746144666.968353:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746862464 00002000:00100000:2.0:1746144666.968472:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3620864->3624959) req@ffff8800a4dd7800 x1830964746862464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.968481:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7800 with x1830964746862464 ext(3620864->3624959) 00002000:00010000:2.0:1746144666.968486:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd7800 00000100:00100000:2.0:1746144666.968500:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4760 00000100:00100000:2.0:1746144666.968508:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746862464:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144666.968660:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1961:x1830964746862464:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 154us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144666.968666:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4760 00002000:00100000:2.0:1746144666.968671:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3620864->3624959) req@ffff8800a4dd7800 x1830964746862464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144666.968677:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7800 with x1830964746862464 ext(3620864->3624959) 00002000:00010000:2.0:1746144666.968680:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd7800 00000100:00100000:3.0:1746144666.972087:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747564416:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144666.972150:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eae5600/0xa7c849b16e01b6ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f94a expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.972165:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eae5600/0xa7c849b16e01b6ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f94a expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144666.972179:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eae5600, rc 0) 00000100:00100000:0.0:1746144666.972181:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f436d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747564544:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144666.972201:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bb6600/0xa7c849b16e01b70d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f951 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.972210:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bb6600/0xa7c849b16e01b70d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f951 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144666.972221:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb6600, rc 0) 00000100:00100000:3.0:1746144666.972228:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746861952:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5180us (6705us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144666.972236:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12257 00000100:00100000:0.0:1746144666.972240:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746862080:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5030us (6181us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144666.972246:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12259 00000100:00100000:2.0:1746144666.976436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.976583:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746862720 00000100:00100000:0.0:1746144666.976593:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746862720 00000100:00100000:0.0:1746144666.976693:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12260 00000100:00100000:0.0:1746144666.976702:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+18:29387:x1830964746862720:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144666.976721:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.976739:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f95f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.976772:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.976780:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144666.976781:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144666.976784:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.976815:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 30 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.976828:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 30 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746144666.976839:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747564672:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.977452:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144666.977595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.977654:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746862848 00000100:00100000:0.0:1746144666.977659:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746862848 00002000:00100000:0.0:1746144666.977687:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4030464->4034559) req@ffff8800a4dd7100 x1830964746862848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.977696:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7100 with x1830964746862848 ext(4030464->4034559) 00002000:00010000:0.0:1746144666.977701:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd7100 00000100:00100000:0.0:1746144666.977726:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4761 00000100:00100000:0.0:1746144666.977732:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746862848:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144666.977892:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1960:x1830964746862848:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 159us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144666.977899:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4761 00002000:00100000:0.0:1746144666.977905:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (4030464->4034559) req@ffff8800a4dd7100 x1830964746862848/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/4536 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144666.977912:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd7100 with x1830964746862848 ext(4030464->4034559) 00002000:00010000:0.0:1746144666.977915:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4dd7100 00000100:00100000:0.0:1746144666.980813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.981533:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747564672:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144666.981567:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.981587:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3b1600, rc 0) 00000100:00100000:1.0:1746144666.981735:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746862976 00000100:00100000:1.0:1746144666.981743:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746862976 00002000:00100000:1.0:1746144666.981783:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (909312->962559) req@ffff88009f436d80 x1830964746862976/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.981797:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f436d80 with x1830964746862976 ext(909312->962559) 00010000:00010000:1.0:1746144666.981804:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 31 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144666.981815:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 31 pid: 3010 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144666.981822:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f436d80 00000100:00100000:2.0:1746144666.981938:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+19:29387:x1830964746862720:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5236us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.981947:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12260 00000100:00100000:1.0:1746144666.982038:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 951 00000100:00100000:1.0:1746144666.982046:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746862976:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144666.985670:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1962:x1830964746862976:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 3611us (4852us total) trans 17179873357 rc 0/0 00000100:00100000:1.0:1746144666.985682:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 951 00002000:00100000:1.0:1746144666.985693:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (909312->962559) req@ffff88009f436d80 x1830964746862976/t17179873357(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:307/0 lens 488/448 e 0 to 0 dl 1746144677 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.985701:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f436d80 with x1830964746862976 ext(909312->962559) 00010000:00010000:1.0:1746144666.985710:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144666.985725:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144666.985731:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f436d80 00000100:00100000:0.0:1746144666.988599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.990045:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746863104 00000100:00100000:2.0:1746144666.990057:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746863104 00010000:00010000:2.0:1746144666.990105:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144666.990154:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6140 00000100:00100000:2.0:1746144666.990164:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746863104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144666.990178:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144666.990204:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.990217:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.990240:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5ba800/0xa7c849b16e01b650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 909312->962559) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8d3 expref: 33 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144666.990259:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.990262:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144666.990269:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.990277:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144666.990312:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144666.990325:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747564800:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144666.990414:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.990490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.990513:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746863232 00000100:00100000:0.0:1746144666.990517:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746863232 00000100:00100000:0.0:1746144666.990543:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10197 00000100:00100000:0.0:1746144666.990549:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29389:x1830964746863232:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144666.990569:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144666.990584:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0800/0xa7c849b16e01b71b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f966 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.990641:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990652:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990662:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990673:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990678:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990683:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990798:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990808:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 321 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.990815:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144666.990840:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 321 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144666.990852:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 321 pid: 20319 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746144666.990861:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747564928:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144666.991842:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144666.994323:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747564928:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144666.994348:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144666.994796:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747564800:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144666.994823:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144666.995335:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746863104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5171us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144666.995347:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6140 00000100:00100000:0.0:1746144666.997178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.997214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144666.997243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144666.997404:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746863488 00000100:00100000:2.0:1746144666.997413:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746863488 00000100:00100000:2.0:1746144666.997462:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4150 00000100:00100000:2.0:1746144666.997469:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:23544:x1830964746863488:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746144666.997676:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746863744 00000100:00100000:1.0:1746144666.997681:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746863744 00002000:00100000:1.0:1746144666.997710:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f01d500 x1830964746863744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.997720:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01d500 with x1830964746863744 ext(0->1048575) 00002000:00010000:1.0:1746144666.997725:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f01d500 00000100:00100000:1.0:1746144666.997736:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864000 00000100:00100000:1.0:1746144666.997737:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864000 00002000:00100000:1.0:1746144666.997747:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1515519) req@ffff88009f01dc00 x1830964746864000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/0 e 0 to 0 dl 1746144677 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144666.997753:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01dc00 with x1830964746864000 ext(1048576->1515519) 00002000:00010000:1.0:1746144666.997756:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01dc00 00000100:00100000:1.0:1746144666.997766:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4762 00000100:00100000:1.0:1746144666.997771:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746863744:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144666.997885:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4763 00000100:00100000:3.0:1746144666.997893:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746864000:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.000822:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+323:23544:x1830964746863488:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 3341us (3641us total) trans 8589944104 rc 0/0 00000100:00100000:2.0:1746144667.000835:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4150 00000100:00100000:0.0:1746144667.003774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.003809:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864256 00000100:00100000:0.0:1746144667.003819:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864256 00002000:00100000:0.0:1746144667.003862:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1376256->2097151) req@ffff88009f01f800 x1830964746864256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.003871:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01f800 with x1830964746864256 ext(1376256->2097151) 00002000:00010000:0.0:1746144667.003877:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01f800 00000100:00100000:0.0:1746144667.003895:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4764 00000100:00100000:0.0:1746144667.003906:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746864256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.011485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.011575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.011611:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864384 00000100:00100000:3.0:1746144667.011620:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864384 00000100:00100000:3.0:1746144667.011677:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864640 00000100:00100000:3.0:1746144667.011680:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864640 00000100:00100000:3.0:1746144667.011699:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12261 00000100:00100000:3.0:1746144667.011708:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746864384:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.011731:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.011751:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f96d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.011778:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.011780:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.011789:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 33 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.011806:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 33 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.011817:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273a00, rc 0) 00000100:00100000:3.0:1746144667.011860:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746864384:12345-192.168.204.23@tcp:101:cat.0 Request processed in 154us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.011867:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12261 00000100:00100000:3.0:1746144667.011882:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12262 00000100:00100000:3.0:1746144667.011887:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746864640:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144667.012246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.012670:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864512 00000100:00100000:2.0:1746144667.012679:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864512 00000100:00100000:2.0:1746144667.012727:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12263 00000100:00100000:0.0:1746144667.012734:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746863744:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14961us (15517us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.012735:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746864512:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144667.012743:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4762 00010000:00010000:2.0:1746144667.012751:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746144667.012753:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009f01d500 x1830964746863744/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.012761:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01d500 with x1830964746863744 ext(0->1048575) 00010000:00010000:2.0:1746144667.012765:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e01b73e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f974 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144667.012767:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f01d500 00000100:00100000:2.0:1746144667.012811:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747565056:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.012870:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144667.012880:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8600 going to sleep for 11 seconds 00010000:00010000:3.0:1746144667.012881:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b745 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f97b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.012917:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099b8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747565184:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.012951:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.015655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.016684:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864768 00000100:00100000:3.0:1746144667.016693:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864768 00010000:00010000:3.0:1746144667.016725:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 323 pid: 20319 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.016753:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6141 00000100:00100000:3.0:1746144667.016759:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+323:1960:x1830964746864768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.016770:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144667.016774:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 323 pid: 20319 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.016784:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 323 pid: 20319 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.016800:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4da600/0xa7c849b16e01b63b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f8c5 expref: 323 pid: 20319 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.017079:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144667.017084:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144667.017093:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144667.017099:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144667.017122:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144667.017169:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:1960:x1830964746864768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 408us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.017178:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6141 00010000:00010000:1.0:1746144667.017239:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017246:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144667.017279:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:1.0:1746144667.017283:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144667.017293:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017301:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017308:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017316:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017321:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017325:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3b1c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144667.017328:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017332:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017339:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144667.017341:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144667.017344:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017347:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1c00/0xa7c849b16e01b722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017370:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017374:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017378:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017381:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3b0c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144667.017383:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017389:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017395:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8900) 00010000:00010000:1.0:1746144667.017396:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144667.017398:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017402:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0c00/0xa7c849b16e01b729 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.017428:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b0800/0xa7c849b16e01b71b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.017437:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 12 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.017442:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.017443:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144667.017445:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3b1000, rc 0) 00000100:00100000:1.0:1746144667.017467:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29389:x1830964746863232:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 26919us (26978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.017472:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10197 00000100:00100000:3.0:1746144667.020376:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746864000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22475us (23123us total) trans 0 rc 466944/466944 00000100:00100000:3.0:1746144667.020387:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4763 00002000:00100000:3.0:1746144667.020397:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1515519) req@ffff88009f01dc00 x1830964746864000/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:307/0 lens 488/440 e 0 to 0 dl 1746144677 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.020406:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01dc00 with x1830964746864000 ext(1048576->1515519) 00002000:00010000:3.0:1746144667.020411:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01dc00 00000100:00100000:1.0:1746144667.024344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.025555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.026248:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+11:1962:x1830964746864256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22338us (22479us total) trans 0 rc 720896/720896 00000100:00100000:0.0:1746144667.026258:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4764 00002000:00100000:0.0:1746144667.026272:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1376256->2097151) req@ffff88009f01f800 x1830964746864256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.026280:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f01f800 with x1830964746864256 ext(1376256->2097151) 00002000:00010000:0.0:1746144667.026285:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f01f800 00000100:00100000:3.0:1746144667.026312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.026325:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746865024 00000100:00100000:2.0:1746144667.026336:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746865024 00000100:00100000:2.0:1746144667.026374:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746865280 00000100:00100000:2.0:1746144667.026376:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746865280 00000100:00100000:0.0:1746144667.026386:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12264 00000100:00100000:0.0:1746144667.026394:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746865024:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:2.0:1746144667.026404:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12265 00010000:00010000:0.0:1746144667.026405:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144667.026418:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746865280:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144667.026419:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b74c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f989 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.026426:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.026434:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b753 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f997 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.026459:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747565440:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144667.026460:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f01f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:3010:1830964747565312:192.168.204.23@tcp:106: 00000100:00080000:2.0:1746144667.026496:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746144667.026499:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144667.026505:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.026505:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.027058:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746864896 00000100:00100000:3.0:1746144667.027062:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746864896 00000100:00100000:3.0:1746144667.027091:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12266 00000100:00100000:3.0:1746144667.027096:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746864896:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144667.027103:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.027110:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f982 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.027122:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.027124:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.027131:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.027162:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.027170:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bb7800, rc 0) 00000100:00100000:3.0:1746144667.027190:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099b8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746864896:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 94us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.027195:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12266 00000100:00100000:3.0:1746144667.027218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.027272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.027284:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746865152 00000100:00100000:3.0:1746144667.027286:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746865152 00000100:00100000:3.0:1746144667.027297:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746865408 00000100:00100000:3.0:1746144667.027299:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746865408 00000100:00100000:3.0:1746144667.027308:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12267 00000100:00100000:3.0:1746144667.027312:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746865152:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144667.027318:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.027325:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5400/0xa7c849b16e01b761 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f990 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.027344:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747565568:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.027352:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12268 00000100:00100000:1.0:1746144667.027359:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746865408:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144667.027366:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.027373:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f99e expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.027375:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e840 going to sleep for 11 seconds 00010000:00010000:1.0:1746144667.027383:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.027385:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.027389:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 10 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.027399:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 10 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.027406:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ef8a00, rc 0) 00000100:00100000:1.0:1746144667.027422:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746865408:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.027427:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12268 00002000:00010000:3.0:1746144667.027452:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144666 -> 1746144667 00002000:00010000:3.0:1746144667.027455:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144664 -> 1746144667 00002000:00010000:3.0:1746144667.027457:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime: 1746144666 -> 1746144667 00000100:00100000:3.0:1746144667.027469:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099b8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747565184:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.027486:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b745 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f97b expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.027494:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273400/0xa7c849b16e01b745 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f97b expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.027509:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273400, rc 0) 00000100:00100000:3.0:1746144667.027522:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746864640:12345-192.168.204.23@tcp:101:cat.0 Request processed in 15635us (15954us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.027527:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12262 00000100:00100000:3.0:1746144667.027571:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747565056:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.027585:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e01b73e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f974 expref: 19 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.027593:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eae4c00/0xa7c849b16e01b73e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f974 expref: 19 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.027600:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eae4c00, rc 0) 00000100:00100000:3.0:1746144667.028481:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746864512:12345-192.168.204.23@tcp:101:cat.0 Request processed in 15744us (16231us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.028486:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12263 00000100:00100000:3.0:1746144667.029731:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747565568:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.029751:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5400/0xa7c849b16e01b761 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f990 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.029763:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5400/0xa7c849b16e01b761 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f990 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.029772:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0f5400, rc 0) 00000100:00100000:3.0:1746144667.029796:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746865152:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 2483us (2577us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.029803:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12267 00000100:00100000:3.0:1746144667.029838:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747565440:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.029859:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b753 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f997 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.029867:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b753 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f997 expref: 8 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.029874:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6a00, rc 0) 00000100:00100000:3.0:1746144667.029889:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746865280:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3479us (4336us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.029894:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12265 00000100:00100000:2.0:1746144667.029938:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f01f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:3010:1830964747565312:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144667.029958:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b74c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f989 expref: 7 pid: 3010 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.029978:0:3010:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b74c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f989 expref: 7 pid: 3010 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.029990:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3b0a00, rc 0) 00000100:00100000:2.0:1746144667.030006:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746865024:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 3614us (5670us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144667.030012:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12264 00000100:00100000:0.0:1746144667.043911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.044031:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746865536 00000100:00100000:2.0:1746144667.044042:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746865536 00000100:00100000:2.0:1746144667.044120:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12269 00000100:00100000:2.0:1746144667.044128:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:16261e74-be72-4bb6-b857-d78345d984f7+19:29387:x1830964746865536:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.044192:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.044208:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9a5 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.044238:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 32 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.044246:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.044247:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.044250:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 20 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.044276:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 32 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.044287:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 32 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.044297:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747565696:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.044388:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.047263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.047341:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746865792 00000100:00100000:1.0:1746144667.047348:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746865792 00000100:00080000:2.0:1746144667.047406:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144667.047467:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10198 00000100:00100000:1.0:1746144667.047474:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29389:x1830964746865792:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144667.047490:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.047504:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8200/0xa7c849b16e01b776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9ac expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.047579:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.047590:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.047652:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.047677:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.047686:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 13 pid: 14710 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144667.047700:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747565824:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144667.048308:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.048410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.048438:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866048 00000100:00100000:0.0:1746144667.048447:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866048 00000100:00100000:3.0:1746144667.048475:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747565696:192.168.204.23@tcp:104: 00002000:00100000:0.0:1746144667.048490:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b1cd880 x1830964746866048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.048501:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cd880 with x1830964746866048 ext(0->1048575) 00010000:00010000:3.0:1746144667.048504:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 20 pid: 3010 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144667.048507:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1cd880 00010000:00010000:3.0:1746144667.048516:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7a00, rc 0) 00000100:00100000:0.0:1746144667.048535:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4765 00000100:00100000:0.0:1746144667.048542:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746866048:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.048653:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f01f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:16261e74-be72-4bb6-b857-d78345d984f7+20:29387:x1830964746865536:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4526us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.048660:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12269 00000100:00100000:0.0:1746144667.052681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.053744:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866176 00000100:00100000:3.0:1746144667.053752:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866176 00002000:00100000:3.0:1746144667.053788:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3620864->4034559) req@ffff88013695a680 x1830964746866176/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.053803:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a680 with x1830964746866176 ext(3620864->4034559) 00010000:00010000:3.0:1746144667.053811:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.053822:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746144667.053829:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013695a680 00000100:00100000:3.0:1746144667.053846:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 952 00000100:00100000:3.0:1746144667.053852:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746866176:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144667.054296:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747565824:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144667.054315:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144667.055218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.055286:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866304 00000100:00100000:3.0:1746144667.055291:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866304 00010000:00010000:3.0:1746144667.055313:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.055331:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6142 00000100:00100000:3.0:1746144667.055335:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746866304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.055345:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144667.055349:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.055358:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.055374:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3b1000/0xa7c849b16e01b730 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f966 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.055403:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144667.055411:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144667.055418:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144667.055424:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144667.055554:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144667.055569:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.055577:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144667.055591:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000100:00100000:3.0:1746144667.055593:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746866304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 256us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.055599:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6142 00010000:00010000:1.0:1746144667.055703:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef8200/0xa7c849b16e01b776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ac expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.055730:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ac expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.055736:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.055739:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746144667.055741:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ef9600, rc 0) 00000100:00100000:1.0:1746144667.055764:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29389:x1830964746865792:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 8291us (8508us total) trans 8589944105 rc 0/0 00000100:00100000:1.0:1746144667.055769:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10198 00000100:00100000:2.0:1746144667.063283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.063840:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746866048:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15297us (15429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.063849:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4765 00002000:00100000:1.0:1746144667.063859:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012b1cd880 x1830964746866048/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.063867:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1cd880 with x1830964746866048 ext(0->1048575) 00002000:00010000:1.0:1746144667.063872:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1cd880 00000100:00100000:1.0:1746144667.064759:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866560 00000100:00100000:1.0:1746144667.064766:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866560 00000100:00100000:1.0:1746144667.064797:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10199 00000100:00100000:1.0:1746144667.064803:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29389:x1830964746866560:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:1.0:1746144667.064820:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.064823:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144667.064843:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ef9600/0xa7c849b16e01b77d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ac expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.064859:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.064862:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144667.064871:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38600/0xa7c849b16e01b78b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9b3 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.064941:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.064951:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.064960:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144667.064978:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144667.066252:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38600/0xa7c849b16e01b78b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.066264:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 14 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.066271:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.066273:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144667.066274:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ea38800, rc 0) 00000100:00100000:1.0:1746144667.066318:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29389:x1830964746866560:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 1514us (3042us total) trans 8589944106 rc 0/0 00000100:00100000:1.0:1746144667.066324:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10199 00000100:00100000:3.0:1746144667.068908:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746866176:12345-192.168.204.23@tcp:4:cat.0 Request processed in 15051us (16228us total) trans 17179873358 rc 0/0 00000100:00100000:3.0:1746144667.068917:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 952 00002000:00100000:3.0:1746144667.068927:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3620864->4034559) req@ffff88013695a680 x1830964746866176/t17179873358(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.068935:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a680 with x1830964746866176 ext(3620864->4034559) 00010000:00010000:3.0:1746144667.068942:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.068955:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746144667.068961:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013695a680 00000100:00100000:0.0:1746144667.069400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.069651:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867456 00000100:00100000:3.0:1746144667.069657:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867456 00000100:00100000:3.0:1746144667.069693:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12270 00000100:00100000:3.0:1746144667.069699:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29392:x1830964746867456:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.069711:0:3010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.069724:0:3010:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9ba expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.069745:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 10 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.069751:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.069752:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.069755:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.069784:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 10 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.069793:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 10 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.069803:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:3010:1830964747565952:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.069863:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.070160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.070185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.070206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.070217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.070239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.070260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.070301:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866688 00000100:00100000:2.0:1746144667.070305:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866688 00000100:00100000:2.0:1746144667.070330:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866944 00000100:00100000:2.0:1746144667.070331:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866944 00000100:00100000:2.0:1746144667.070341:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867200 00000100:00100000:2.0:1746144667.070342:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867200 00000100:00100000:2.0:1746144667.070349:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746866816 00000100:00100000:2.0:1746144667.070350:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746866816 00000100:00100000:2.0:1746144667.070358:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867072 00000100:00100000:2.0:1746144667.070359:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867072 00000100:00100000:2.0:1746144667.070366:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867328 00000100:00100000:2.0:1746144667.070368:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867328 00000100:00100000:2.0:1746144667.070378:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12271 00000100:00100000:2.0:1746144667.070382:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746866688:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144667.070405:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.070405:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12272 00000100:00100000:1.0:1746144667.070413:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746866944:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144667.070417:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070424:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070431:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 34 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070436:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.070437:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.070439:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070454:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 34 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070461:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 34 pid: 8450 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.070469:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747566080:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.070509:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070517:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 9 pid: 10724 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.070524:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747566208:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144667.070524:0:8453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070541:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.070541:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 10 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.070546:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.070548:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.070548:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144667.070550:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.070555:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747566336:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.070564:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.070578:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12273 00000100:00100000:2.0:1746144667.070584:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746867200:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144667.070597:0:22208:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070605:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.070608:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070613:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144667.070615:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070635:0:22208:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070644:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.070659:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12274 00000100:00100000:2.0:1746144667.070663:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746866816:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144667.070674:0:8388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070680:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.070683:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070688:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144667.070690:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070700:0:8388:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070707:0:8388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.070718:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12275 00000100:00100000:2.0:1746144667.070722:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746867072:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144667.070732:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070741:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070747:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070753:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 34 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070758:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.070759:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.070761:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070770:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 34 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070776:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 34 pid: 8389 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.070783:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747566720:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.070801:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070813:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.070819:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747566848:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.070832:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 19 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070838:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 19 pid: 8389 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.070845:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747566976:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.070854:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.070864:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12276 00000100:00100000:2.0:1746144667.070869:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746867328:12345-192.168.204.23@tcp:1:mirror_io.0 00010000:00010000:2.0:1746144667.070880:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070889:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070896:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070902:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070908:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.070909:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.070911:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.070922:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070928:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 10 pid: 8451 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.070935:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747567104:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.070952:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.070959:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 8 pid: 4760 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.070978:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747567232:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.070996:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.071003:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.071015:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747567360:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.071025:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8600 going to sleep for 11 seconds 00010000:00010000:1.0:1746144667.071297:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 10 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.071305:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 10 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144667.071313:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747567488:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144667.071348:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.072209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.072914:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867584 00000100:00100000:3.0:1746144667.072921:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867584 00010000:00010000:3.0:1746144667.072947:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.072987:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6143 00000100:00100000:3.0:1746144667.072992:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1962:x1830964746867584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.073002:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144667.073002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144667.073019:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.073029:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.073030:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:3010:1830964747565952:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.073049:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0f5200/0xa7c849b16e01b6d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3620864->4034559) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f93c expref: 35 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.073053:0:3010:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.073063:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.073064:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.073064:0:3010:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5113200, rc 0) 00010000:00010000:3.0:1746144667.073070:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.073078:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.073090:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29392:x1830964746867456:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3390us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.073096:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12270 00010000:00010000:3.0:1746144667.073730:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 19 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.073750:0:15951:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.073764:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747567616:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144667.073872:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.073903:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867712 00000100:00100000:3.0:1746144667.075944:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867712 00002000:00100000:3.0:1746144667.076013:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1515520->2097151) req@ffff880093760700 x1830964746867712/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.076029:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760700 with x1830964746867712 ext(1515520->2097151) 00010000:00010000:3.0:1746144667.076037:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 11 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.076048:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 11 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746144667.076055:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093760700 00000100:00100000:3.0:1746144667.076106:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 953 00000100:00100000:3.0:1746144667.076112:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746867712:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144667.078947:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747566080:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.078957:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747566208:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.086194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.086222:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867840 00000100:00100000:2.0:1746144667.086231:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867840 00010000:00010000:2.0:1746144667.086283:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 10 pid: 10724 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144667.086492:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747566336:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.086525:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.086595:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6144 00000100:00100000:2.0:1746144667.086605:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746867840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.086621:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.086644:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 10 pid: 10724 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144667.086660:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 10 pid: 10724 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144667.086901:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bb7800/0xa7c849b16e01b75a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f982 expref: 10 pid: 10724 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144667.086929:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.086981:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746867840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 378us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.086989:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6144 00000100:00100000:0.0:1746144667.087271:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747566720:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.087280:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747566848:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.087458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.087522:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746867968 00000100:00100000:0.0:1746144667.087525:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746867968 00010000:00010000:0.0:1746144667.087543:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746144667.087572:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6145 00000100:00100000:0.0:1746144667.087578:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746867968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.087587:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144667.087600:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746144667.087608:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746144667.087620:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4865a00/0xa7c849b16e01b54d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f847 expref: 9 pid: 29370 timeout: 746 lvb_type: 1 00010000:00010000:0.0:1746144667.087634:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.087704:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747566976:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144667.087745:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.088380:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747567104:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.088409:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747567232:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.088428:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092935500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747567360:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.088449:0:30345:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144667.088467:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746867968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 887us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.088472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.088473:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6145 00000100:00100000:2.0:1746144667.088543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.088561:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868224 00000100:00100000:2.0:1746144667.088564:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868224 00000100:00100000:3.0:1746144667.088573:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868608 00000100:00100000:3.0:1746144667.088580:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868608 00010000:00010000:2.0:1746144667.088581:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 13 pid: 8451 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.088599:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6146 00000100:00100000:2.0:1746144667.088606:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1963:x1830964746868224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.088610:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 20 pid: 8389 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.088614:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.088630:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 13 pid: 8451 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144667.088639:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 13 pid: 8451 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144667.088642:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6147 00000100:00100000:3.0:1746144667.088649:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746868608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.088654:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094bb6400/0xa7c849b16e01b706 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f958 expref: 13 pid: 8451 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746144667.088663:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.088664:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144667.088682:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 20 pid: 8389 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.088693:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 20 pid: 8389 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.088697:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:1963:x1830964746868224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.088704:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6146 00010000:00010000:3.0:1746144667.088712:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c18600/0xa7c849b16e01b490 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7d7 expref: 20 pid: 8389 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.088732:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144667.088735:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.088744:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868096 00000100:00100000:2.0:1746144667.088746:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868096 00010000:00010000:2.0:1746144667.088759:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 20 pid: 8451 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.088773:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6148 00000100:00100000:3.0:1746144667.088775:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746868608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 126us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.088778:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746868096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144667.088782:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6147 00010000:00010000:2.0:1746144667.088785:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.088794:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.088808:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144667.088882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.088897:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868480 00000100:00100000:1.0:1746144667.088900:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868480 00010000:00010000:1.0:1746144667.088915:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 35 pid: 8450 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746144667.088927:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6149 00000100:00100000:1.0:1746144667.088932:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746868480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.088939:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.088949:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 35 pid: 8450 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.088961:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 35 pid: 8450 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.088985:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4273a00/0xa7c849b16e01b737 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f96d expref: 35 pid: 8450 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.088998:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.088999:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.089004:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.089010:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.089025:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.089040:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746868480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.089045:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6149 00000100:00100000:1.0:1746144667.089070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.089078:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868352 00000100:00100000:1.0:1746144667.089080:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868352 00010000:00010000:1.0:1746144667.089090:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 9 pid: 4760 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746144667.089102:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6150 00000100:00100000:1.0:1746144667.089106:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746868352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.089116:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.089127:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 9 pid: 4760 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746144667.089167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.089211:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868736 00000100:00100000:3.0:1746144667.089215:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868736 00010000:00010000:3.0:1746144667.089226:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 34 pid: 8389 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144667.089237:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6151 00000100:00100000:3.0:1746144667.089241:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746868736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.089248:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144667.089254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144667.089256:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 34 pid: 8389 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746144667.089270:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746869248 00000100:00100000:0.0:1746144667.089273:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746869248 00000100:00100000:0.0:1746144667.089295:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10200 00010000:00010000:1.0:1746144667.089297:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 9 pid: 4760 timeout: 746 lvb_type: 1 00000100:00100000:0.0:1746144667.089300:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+31:29394:x1830964746869248:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144667.089309:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b768 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f99e expref: 9 pid: 4760 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.089319:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144667.089320:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.089334:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e01b7d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9c1 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.089337:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746868352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 230us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.089342:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6150 00000100:00100000:1.0:1746144667.089369:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747567488:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144667.089381:0:8453:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.089421:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747567616:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144667.089431:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144667.089436:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144667.089444:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1962:x1830964746867584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 16452us (17237us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144667.089447:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144667.089449:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6143 00010000:00010000:0.0:1746144667.089456:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.089468:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.089473:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.089479:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144667.089495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.089510:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.089518:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868992 00000100:00100000:1.0:1746144667.089521:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868992 00010000:00010000:1.0:1746144667.089531:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144667.089543:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6152 00000100:00100000:1.0:1746144667.089547:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1963:x1830964746868992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.089553:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.089560:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.089588:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 33 pid: 8389 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746144667.089599:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304a800/0xa7c849b16e01b4b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7fa expref: 33 pid: 8389 timeout: 746 lvb_type: 1 00010000:00010000:3.0:1746144667.089606:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.089607:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.089609:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089615:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089628:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144667.089645:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746868736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 403us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.089649:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6151 00010000:00010000:3.0:1746144667.089667:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089673:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089689:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089697:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089703:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089709:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3b0000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144667.089712:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089719:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089728:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089732:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0000/0xa7c849b16e01b7c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.089767:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746867072:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 19044us (19526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.089774:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12275 00010000:00010000:3.0:1746144667.089792:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089799:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089811:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089818:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089823:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089828:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097af6a00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144667.089830:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089835:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089842:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.089848:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af6a00/0xa7c849b16e01b7a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.089870:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746866688:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 19488us (19711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.089875:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12271 00010000:00010000:1.0:1746144667.089917:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.089928:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f33e200/0xa7c849b16e01b69d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f904 expref: 19 pid: 4760 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.089937:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.089939:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.089941:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.089947:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.089960:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.089984:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1963:x1830964746868992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 436us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.089990:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6152 00000100:00100000:1.0:1746144667.090008:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746868864 00000100:00100000:1.0:1746144667.090011:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746868864 00002000:00100000:1.0:1746144667.090031:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1376255) req@ffff88012e12fb80 x1830964746868864/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.090038:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12fb80 with x1830964746868864 ext(1048576->1376255) 00010000:00010000:1.0:1746144667.090043:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 12 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.090050:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 12 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.090056:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e12fb80 00000100:00100000:1.0:1746144667.090073:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 954 00000100:00100000:1.0:1746144667.090078:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+12:1961:x1830964746868864:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:2.0:1746144667.090109:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1600/0xa7c849b16e01b714 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f95f expref: 19 pid: 8451 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.090150:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.090169:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746868096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1391us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.090175:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6148 00000100:00100000:2.0:1746144667.090269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144667.090511:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.090524:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.090530:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.090558:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 13 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.090568:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 13 pid: 14710 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746144667.090580:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747567744:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.090623:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144667.090639:0:30345:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090647:0:30345:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090660:0:30345:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090666:0:30345:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090671:0:30345:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090675:0:30345:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009984c000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144667.090678:0:30345:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090688:0:30345:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090698:0:30345:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.090703:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b7ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.090742:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746867328:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 19872us (20480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.090748:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12276 00000100:00100000:1.0:1746144667.091146:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746869504 00000100:00100000:1.0:1746144667.091151:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746869504 00002000:00100000:1.0:1746144667.091168:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092936a00 x1830964746869504/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.091175:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936a00 with x1830964746869504 ext(2097152->3145727) 00010000:00010000:1.0:1746144667.091179:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.091187:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.091192:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092936a00 00000100:00100000:1.0:1746144667.091203:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 955 00000100:00100000:1.0:1746144667.091207:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746869504:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.097786:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746867712:12345-192.168.204.23@tcp:4:cat.0 Request processed in 21665us (24775us total) trans 21474840582 rc 0/0 00000100:00100000:1.0:1746144667.097797:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 953 00002000:00100000:1.0:1746144667.097808:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1515520->2097151) req@ffff880093760700 x1830964746867712/t21474840582(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.097816:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760700 with x1830964746867712 ext(1515520->2097151) 00010000:00010000:1.0:1746144667.097824:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.097835:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.097841:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093760700 00000100:00100000:3.0:1746144667.098320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.098431:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747567744:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144667.098450:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144667.098886:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746869632 00000100:00100000:2.0:1746144667.098892:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746869632 00010000:00010000:2.0:1746144667.098917:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.098950:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6153 00000100:00100000:2.0:1746144667.098958:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1963:x1830964746869632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.098979:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.098984:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.098992:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.099009:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ea38800/0xa7c849b16e01b792 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9b3 expref: 14 pid: 14710 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.099020:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144667.099024:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144667.099032:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144667.099038:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144667.099054:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.099075:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1963:x1830964746869632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 119us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.099080:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6153 00010000:00010000:0.0:1746144667.100374:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100382:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144667.100397:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:0.0:1746144667.100463:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100469:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100475:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100480:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e8600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144667.100483:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100489:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100499:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144667.100501:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746144667.100504:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.100508:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8600/0xa7c849b16e01b7e6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101799:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101806:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101811:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101815:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e8400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144667.101817:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101823:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101831:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144667.101833:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144667.101836:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101840:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8400/0xa7c849b16e01b7d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101849:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101854:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101859:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101862:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7e8a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144667.101864:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101869:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101874:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8700) 00010000:00010000:0.0:1746144667.101876:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144667.101878:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101882:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e8a00/0xa7c849b16e01b7df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144667.101919:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e01b7d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c1 expref: 33 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.101926:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7e9800/0xa7c849b16e01b7d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c1 expref: 33 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.101932:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7e9800, rc 0) 00000100:00100000:0.0:1746144667.101956:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:29394:x1830964746869248:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 12655us (12702us total) trans 8589944107 rc 301/301 00000100:00100000:0.0:1746144667.101963:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10200 00000100:00100000:1.0:1746144667.101996:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746868864:12345-192.168.204.23@tcp:4:cat.0 Request processed in 11531us (12114us total) trans 21474840583 rc 0/0 00000100:00100000:1.0:1746144667.102006:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 954 00002000:00100000:1.0:1746144667.102014:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->1376255) req@ffff88012e12fb80 x1830964746868864/t21474840583(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.102023:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12fb80 with x1830964746868864 ext(1048576->1376255) 00010000:00010000:1.0:1746144667.102030:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.102040:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.102047:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e12fb80 00000100:00100000:1.0:1746144667.102409:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746869504:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11201us (12139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.102416:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 955 00002000:00100000:1.0:1746144667.102421:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880092936a00 x1830964746869504/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.102428:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092936a00 with x1830964746869504 ext(2097152->3145727) 00010000:00010000:1.0:1746144667.102433:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.102441:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.102446:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092936a00 00000100:00100000:0.0:1746144667.102485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.103168:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746869760 00000100:00100000:3.0:1746144667.103176:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746869760 00010000:00010000:3.0:1746144667.103199:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.103232:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6154 00000100:00100000:3.0:1746144667.103239:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746869760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.103250:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144667.103267:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.103276:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.103292:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0a4400/0xa7c849b16e01b6c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f92e expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.103303:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.103305:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.103311:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 17 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.103317:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 17 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.103350:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 17 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.103359:0:7309:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 17 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.103368:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747567872:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144667.103438:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.107743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.107782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.107926:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746869888 00000100:00100000:0.0:1746144667.107937:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746869888 00010000:00010000:0.0:1746144667.107983:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:0.0:1746144667.108030:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6155 00000100:00100000:0.0:1746144667.108039:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746869888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.108055:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144667.108078:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746144667.108091:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746144667.108115:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0f5a00/0xa7c849b16e01b6ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f935 expref: 14 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746144667.108160:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.108162:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.108167:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.108176:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.108199:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144667.108251:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746869888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 211us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.108257:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6155 00000100:00100000:3.0:1746144667.108415:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746870016 00000100:00100000:3.0:1746144667.108423:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746870016 00000100:00100000:3.0:1746144667.108455:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12277 00000100:00100000:3.0:1746144667.108462:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+13:29394:x1830964746870016:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.108476:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.108491:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9c8 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.108513:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.108516:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.108522:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.108525:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1527808->1576959] (req 1527808->1576959) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 14 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.108537:0:30345:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.108551:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1527808->1576959] (req 1527808->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 14 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.108559:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ef8a00, rc 0) 00000100:00100000:3.0:1746144667.108592:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:29394:x1830964746870016:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 131us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.108597:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12277 00010000:00010000:1.0:1746144667.108707:0:8453:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108716:0:8453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108738:0:8453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108744:0:8453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108755:0:8453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108761:0:8453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ea38e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144667.108764:0:8453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108771:0:8453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108781:0:8453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.108786:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ea38e00/0xa7c849b16e01b7ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.108843:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746866944:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 38431us (38656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.108850:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12272 00000100:00100000:0.0:1746144667.109348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.109564:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7309:1830964747567872:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144667.109576:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144667.109598:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:1961:x1830964746869760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6360us (7114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.109606:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6154 00000100:00100000:1.0:1746144667.110060:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746870272 00000100:00100000:1.0:1746144667.110066:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746870272 00002000:00100000:1.0:1746144667.110097:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008c7d0700 x1830964746870272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.110106:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0700 with x1830964746870272 ext(1048576->2097151) 00010000:00010000:1.0:1746144667.110113:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.110123:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.110129:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c7d0700 00000100:00100000:1.0:1746144667.110164:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 956 00000100:00100000:1.0:1746144667.110169:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746870272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.110435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.110549:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746870400 00000100:00100000:3.0:1746144667.110553:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746870400 00000100:00100000:3.0:1746144667.110574:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12278 00000100:00100000:3.0:1746144667.110578:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:29387:x1830964746870400:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.110587:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.110598:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9cf expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144667.110614:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d9b, atime: 0x68140d9b, ctime: 0x68140d9b, blocks: 0x1029 00010000:00010000:3.0:1746144667.110627:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.110628:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.110634:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 14 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.110649:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 14 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.110656:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f381400, rc 0) 00000100:00100000:3.0:1746144667.110679:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:29387:x1830964746870400:12345-192.168.204.23@tcp:101:cat.0 Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.110683:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12278 00000100:00100000:0.0:1746144667.116898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.116955:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746870528 00000100:00100000:3.0:1746144667.116973:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746870528 00010000:00010000:3.0:1746144667.117015:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.117179:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6156 00000100:00100000:3.0:1746144667.117188:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746870528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.117202:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144667.117228:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.117239:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.117264:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b76f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9a5 expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.117292:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.117296:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.117301:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.117310:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.118435:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144667.118491:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746870528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1301us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.118499:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6156 00010000:00010000:2.0:1746144667.118641:0:22208:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118651:0:22208:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118677:0:22208:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118683:0:22208:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118696:0:22208:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118702:0:22208:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3b0800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144667.118705:0:22208:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118712:0:22208:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118723:0:22208:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.118729:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0800/0xa7c849b16e01b7b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.118778:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746867200:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 48195us (48570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.118786:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12273 00000100:00100000:0.0:1746144667.119517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.119590:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746870784 00000100:00100000:2.0:1746144667.119597:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746870784 00002000:00100000:2.0:1746144667.119643:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb45c00 x1830964746870784/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.119653:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb45c00 with x1830964746870784 ext(2097152->3145727) 00002000:00010000:2.0:1746144667.119658:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb45c00 00000100:00100000:2.0:1746144667.120206:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4766 00000100:00100000:2.0:1746144667.120215:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746870784:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144667.121129:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746870272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10955us (11777us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.121155:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 956 00002000:00100000:1.0:1746144667.121161:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008c7d0700 x1830964746870272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.121169:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c7d0700 with x1830964746870272 ext(1048576->2097151) 00010000:00010000:1.0:1746144667.121177:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.121191:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 18 pid: 3010 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.121197:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c7d0700 00000100:00100000:0.0:1746144667.129726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.130272:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746870912 00000100:00100000:2.0:1746144667.130281:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746870912 00000100:00100000:3.0:1746144667.130716:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746870784:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10501us (11198us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.130726:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4766 00002000:00100000:3.0:1746144667.130737:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb45c00 x1830964746870784/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.130746:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb45c00 with x1830964746870784 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.130751:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb45c00 00000100:00100000:2.0:1746144667.131012:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12279 00000100:00100000:2.0:1746144667.131022:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:29392:x1830964746870912:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.131035:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.131052:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9d6 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144667.131071:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d9b, atime: 0x68140d9b, ctime: 0x68140d9b, blocks: 0x821 00010000:00010000:2.0:1746144667.131087:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.131089:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.131095:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.131107:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.131115:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f3600, rc 0) 00000100:00100000:2.0:1746144667.131168:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29392:x1830964746870912:12345-192.168.204.23@tcp:101:cat.0 Request processed in 148us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.131174:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12279 00000100:00100000:0.0:1746144667.131636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.132105:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746871040 00000100:00100000:2.0:1746144667.132110:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746871040 00010000:00010000:2.0:1746144667.132151:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.132187:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6157 00000100:00100000:2.0:1746144667.132195:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746871040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.132204:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.132217:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.132226:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.132239:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5113200/0xa7c849b16e01b7a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9ba expref: 19 pid: 3010 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.132266:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.132268:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.132271:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132277:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132298:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.132328:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746871040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 134us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.132334:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6157 00010000:00010000:2.0:1746144667.132378:0:8388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132414:0:8388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132431:0:8388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132438:0:8388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132444:0:8388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132450:0:8388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3b1e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144667.132453:0:8388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132460:0:8388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132469:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.132470:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.132474:0:8388:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132480:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.132506:0:8388:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 13 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.132517:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747568000:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144667.132652:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4ef8540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.139176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.139369:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746871168 00000100:00100000:3.0:1746144667.139377:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746871168 00000100:00100000:3.0:1746144667.139425:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12280 00000100:00100000:3.0:1746144667.139433:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+17:29387:x1830964746871168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.139771:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.139788:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9dd expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144667.139809:0:8453:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4934944, mtime: 0x68140d9b, atime: 0x68140d9b, ctime: 0x68140d9b, blocks: 0x15f1 00010000:00010000:3.0:1746144667.139827:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.139828:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.139835:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.139847:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 18 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.139855:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f380600, rc 0) 00000100:00100000:3.0:1746144667.139893:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:29387:x1830964746871168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 461us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.139898:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12280 00000100:00100000:0.0:1746144667.139979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.140552:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746871424 00000100:00100000:3.0:1746144667.140556:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746871424 00002000:00100000:3.0:1746144667.140579:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb45f80 x1830964746871424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.140588:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb45f80 with x1830964746871424 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.140591:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb45f80 00000100:00100000:1.0:1746144667.140808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.140904:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747568000:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.140930:0:8388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.140937:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3b1e00/0xa7c849b16e01b7bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.141635:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746871680 00000100:00100000:3.0:1746144667.141639:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746871680 00002000:00100000:3.0:1746144667.141660:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1527808->1531903) req@ffff88012e12d880 x1830964746871680/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.141667:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12d880 with x1830964746871680 ext(1527808->1531903) 00002000:00010000:3.0:1746144667.141671:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12d880 00000100:00100000:3.0:1746144667.141685:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4767 00000100:00100000:2.0:1746144667.141685:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746866816:12345-192.168.204.23@tcp:1:mirror_io.0 Request processed in 70734us (71180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.141690:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746871424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.141693:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12274 00000100:00100000:2.0:1746144667.141720:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4768 00000100:00100000:2.0:1746144667.141727:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746871680:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144667.141815:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746871680:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 90us (1008us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144667.141820:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4768 00002000:00100000:2.0:1746144667.141824:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1527808->1531903) req@ffff88012e12d880 x1830964746871680/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.141829:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12d880 with x1830964746871680 ext(1527808->1531903) 00002000:00010000:2.0:1746144667.141832:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e12d880 00000100:00100000:1.0:1746144667.143426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.143552:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746871936 00000100:00100000:2.0:1746144667.143557:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746871936 00000100:00100000:2.0:1746144667.143603:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10201 00000100:00100000:2.0:1746144667.143608:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29389:x1830964746871936:12345-192.168.204.23@tcp:36:mirror_io.0 00010000:00010000:2.0:1746144667.143643:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.143668:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782000/0xa7c849b16e01b07d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f54c expref: 13 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.143683:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144667.143687:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.143730:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29389:x1830964746871936:12345-192.168.204.23@tcp:36:mirror_io.0 Request processed in 121us (312us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746144667.143736:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10201 00000100:00100000:0.0:1746144667.149587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.149628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.149654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.149682:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.149800:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746872320 00000100:00100000:2.0:1746144667.149812:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746872320 00000100:00100000:3.0:1746144667.149818:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746872448 00000100:00100000:3.0:1746144667.149821:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746872448 00000100:00100000:2.0:1746144667.149829:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746872960 00000100:00100000:2.0:1746144667.149831:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746872960 00002000:00100000:3.0:1746144667.149860:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee6d80 x1830964746872448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.149868:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6d80 with x1830964746872448 ext(3145728->4194303) 00000100:00100000:2.0:1746144667.149870:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4151 00002000:00010000:3.0:1746144667.149872:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee6d80 00000100:00100000:3.0:1746144667.149882:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746872704 00000100:00100000:2.0:1746144667.149883:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29389:x1830964746872960:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:3.0:1746144667.149884:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746872704 00002000:00100000:3.0:1746144667.149895:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee5f80 x1830964746872704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.149900:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5f80 with x1830964746872704 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.149903:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5f80 00000100:00100000:3.0:1746144667.149913:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4769 00000100:00100000:3.0:1746144667.149917:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746872448:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144667.150293:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29389:x1830964746872960:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 416us (609us total) trans 8589944108 rc 0/0 00000100:00100000:2.0:1746144667.150299:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4151 00000100:00100000:2.0:1746144667.150319:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4770 00000100:00100000:2.0:1746144667.150324:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746872704:12345-192.168.204.23@tcp:3:multiop.0 00002000:00100000:0.0:1746144667.153561:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1572864->1576959) req@ffff88009fb46680 x1830964746872320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.153583:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46680 with x1830964746872320 ext(1572864->1576959) 00002000:00010000:0.0:1746144667.153588:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb46680 00000100:00100000:0.0:1746144667.153617:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4771 00000100:00100000:0.0:1746144667.153624:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746872320:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144667.153717:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746871424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12025us (13737us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144667.153717:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746872320:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 95us (4144us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144667.153723:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4771 00002000:00100000:0.0:1746144667.153728:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1572864->1576959) req@ffff88009fb46680 x1830964746872320/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.153735:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46680 with x1830964746872320 ext(1572864->1576959) 00002000:00010000:0.0:1746144667.153738:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb46680 00000100:00100000:3.0:1746144667.154036:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4767 00002000:00100000:3.0:1746144667.154043:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb45f80 x1830964746871424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.154051:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb45f80 with x1830964746871424 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.154055:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb45f80 00000100:00100000:1.0:1746144667.155453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.155538:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746873216 00000100:00100000:3.0:1746144667.155545:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746873216 00000100:00100000:3.0:1746144667.155590:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4152 00000100:00100000:3.0:1746144667.155596:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29389:x1830964746873216:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:3.0:1746144667.155763:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29389:x1830964746873216:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 165us (313us total) trans 8589944109 rc 0/0 00000100:00100000:3.0:1746144667.155768:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4152 00000100:00100000:0.0:1746144667.162665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.162761:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746873472 00000100:00100000:2.0:1746144667.162771:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746873472 00000100:00100000:2.0:1746144667.162827:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4153 00000100:00100000:2.0:1746144667.162834:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+32:29394:x1830964746873472:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144667.163044:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:29394:x1830964746873472:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 209us (388us total) trans 8589944110 rc 0/0 00000100:00100000:2.0:1746144667.163050:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4153 00000100:00100000:3.0:1746144667.163466:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746872448:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 13544us (13834us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.163477:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4769 00002000:00100000:3.0:1746144667.163488:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee6d80 x1830964746872448/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.163498:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6d80 with x1830964746872448 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.163504:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee6d80 00000100:00100000:0.0:1746144667.164336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.164641:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746873600 00000100:00100000:2.0:1746144667.164650:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746873600 00000100:00100000:2.0:1746144667.164700:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12281 00000100:00100000:2.0:1746144667.164708:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29392:x1830964746873600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.164720:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.164737:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9e4 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144667.164758:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d9a, atime: 0x68140d98, ctime: 0x68140d9a, blocks: 0x821 00010000:00010000:2.0:1746144667.164774:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.164775:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.164782:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 33 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.164793:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 33 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.164802:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f2c00, rc 0) 00000100:00100000:2.0:1746144667.164850:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:29392:x1830964746873600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 143us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.164855:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12281 00000100:00100000:3.0:1746144667.165405:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746872704:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 15079us (15749us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.165414:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4770 00002000:00100000:3.0:1746144667.165422:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee5f80 x1830964746872704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.165430:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5f80 with x1830964746872704 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.165434:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee5f80 00000100:00100000:2.0:1746144667.170768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.170979:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746873728 00000100:00100000:0.0:1746144667.170992:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746873728 00000100:00100000:2.0:1746144667.171024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.171042:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746873984 00000100:00100000:0.0:1746144667.171045:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746873984 00000100:00100000:2.0:1746144667.171061:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12282 00000100:00100000:0.0:1746144667.171074:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12283 00000100:00100000:0.0:1746144667.171081:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746873984:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144667.171082:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+18:1963:x1830964746873728:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.171099:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.171100:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.171118:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9eb expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.171118:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9f2 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144667.171159:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d9b, atime: 0x68140d9b, ctime: 0x68140d9b, blocks: 0x809 00010000:00010000:0.0:1746144667.171165:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.171167:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.171178:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.171180:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.171187:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 19 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.171201:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 19 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.171211:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f3a00, rc 0) 00000100:00100000:2.0:1746144667.171261:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746873728:12345-192.168.204.23@tcp:101:cat.0 Request processed in 192us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.171268:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12282 00000100:00100000:1.0:1746144667.171298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144667.171332:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 15 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.171350:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 15 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.171360:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092458a00, rc 0) 00000100:00100000:0.0:1746144667.171439:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746873984:12345-192.168.204.23@tcp:101:cat.0 Request processed in 358us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.171446:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12283 00000100:00100000:0.0:1746144667.171458:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746874112 00000100:00100000:0.0:1746144667.171461:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746874112 00000100:00100000:0.0:1746144667.171477:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12284 00000100:00100000:0.0:1746144667.171481:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746874112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.171488:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.171497:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152f9f9 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.171508:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.171510:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.171515:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 20 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.171524:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 20 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.171531:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092458c00, rc 0) 00000100:00100000:0.0:1746144667.171547:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746874112:12345-192.168.204.23@tcp:101:cat.0 Request processed in 65us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.171552:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12284 00000100:00100000:2.0:1746144667.171813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.171876:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746874240 00000100:00100000:3.0:1746144667.171882:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746874240 00002000:00100000:3.0:1746144667.171909:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092934700 x1830964746874240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.171917:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934700 with x1830964746874240 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.171921:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092934700 00000100:00100000:3.0:1746144667.171944:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4772 00000100:00100000:3.0:1746144667.171950:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746874240:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.178521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.178644:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746874496 00000100:00100000:2.0:1746144667.178655:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746874496 00002000:00100000:2.0:1746144667.178720:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093ee5180 x1830964746874496/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.178730:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5180 with x1830964746874496 ext(4194304->4935679) 00002000:00010000:2.0:1746144667.178738:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee5180 00000100:00100000:2.0:1746144667.178777:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4773 00000100:00100000:2.0:1746144667.178786:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746874496:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.184517:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1961:x1830964746874240:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12554us (12691us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.184530:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4772 00002000:00100000:3.0:1746144667.184544:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff880092934700 x1830964746874240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.184553:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092934700 with x1830964746874240 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.184560:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092934700 00000100:00100000:2.0:1746144667.187406:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746874496:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8609us (8883us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144667.187419:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4773 00002000:00100000:2.0:1746144667.187429:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff880093ee5180 x1830964746874496/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.187438:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee5180 with x1830964746874496 ext(4194304->4935679) 00002000:00010000:2.0:1746144667.187444:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee5180 00000100:00100000:0.0:1746144667.190871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.192278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.192415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.192440:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746874624 00000100:00100000:0.0:1746144667.192440:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746874752 00000100:00100000:3.0:1746144667.192448:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746874624 00000100:00100000:0.0:1746144667.192448:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746874752 00000100:00100000:3.0:1746144667.192486:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746874880 00000100:00100000:3.0:1746144667.192488:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746874880 00000100:00100000:0.0:1746144667.192547:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12285 00000100:00100000:0.0:1746144667.192555:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746874624:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.192577:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.192594:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa00 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.192618:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.192620:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.192629:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.192645:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.192657:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1bba00, rc 0) 00000100:00100000:3.0:1746144667.192705:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12286 00000100:00100000:3.0:1746144667.192711:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746874752:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.192719:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144667.192728:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746874624:12345-192.168.204.23@tcp:101:cat.0 Request processed in 174us (1868us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144667.192731:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b833 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa07 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144667.192733:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12285 00000100:00100000:0.0:1746144667.192749:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12287 00000100:00100000:0.0:1746144667.192753:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746874880:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.192758:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.192764:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa0e expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.192771:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568128:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144667.192772:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.192773:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.192777:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.192783:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 35 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.192789:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1ba200, rc 0) 00000100:00100000:3.0:1746144667.192835:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.192941:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746874880:12345-192.168.204.23@tcp:101:cat.0 Request processed in 185us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.192946:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12287 00000100:00100000:1.0:1746144667.194072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.194102:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746875008 00000100:00100000:0.0:1746144667.194106:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746875008 00000100:00100000:0.0:1746144667.194151:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12288 00000100:00100000:0.0:1746144667.194158:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746875008:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.194171:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.194181:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa15 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.194195:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.194197:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.194201:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 21 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.194212:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 21 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.194218:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1bb400, rc 0) 00000100:00100000:0.0:1746144667.194247:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746875008:12345-192.168.204.23@tcp:101:cat.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.194347:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12288 00000100:00100000:3.0:1746144667.195356:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568128:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.195385:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b833 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa07 expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.195402:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b833 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa07 expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.195961:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273a00, rc 0) 00000100:00100000:3.0:1746144667.196323:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746874752:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3609us (4046us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.196330:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12286 00000100:00100000:0.0:1746144667.198990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.199075:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746875264 00000100:00100000:2.0:1746144667.199084:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746875264 00000100:00100000:2.0:1746144667.199160:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4154 00000100:00100000:2.0:1746144667.199169:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+33:29387:x1830964746875264:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144667.199738:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+34:29387:x1830964746875264:12345-192.168.204.23@tcp:35:cat.0 Request processed in 569us (756us total) trans 8589944111 rc 0/0 00000100:00100000:2.0:1746144667.199750:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4154 00000100:00100000:0.0:1746144667.202056:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.202276:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746875520 00000100:00100000:3.0:1746144667.202284:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746875520 00000100:00100000:3.0:1746144667.202326:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10202 00000100:00100000:3.0:1746144667.202332:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:29399:x1830964746875520:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.202355:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.202374:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7a00/0xa7c849b16e01b848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa1c expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.202761:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.202775:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.202786:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144667.202875:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144667.202992:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7a00/0xa7c849b16e01b848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 325 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.203361:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 324 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.203370:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144667.203373:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144667.203377:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7c00, rc 0) 00000100:00100000:3.0:1746144667.203421:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+324:29399:x1830964746875520:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1088us (1372us total) trans 8589944112 rc 0/0 00000100:00100000:3.0:1746144667.203427:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10202 00000100:00100000:0.0:1746144667.209401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.209429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.209449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.209876:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746875776 00000100:00100000:3.0:1746144667.209885:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746875776 00002000:00100000:3.0:1746144667.209928:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093ee4a80 x1830964746875776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.209939:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4a80 with x1830964746875776 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.209944:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee4a80 00000100:00100000:3.0:1746144667.209975:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746876032 00000100:00100000:3.0:1746144667.209977:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746876032 00002000:00100000:3.0:1746144667.209986:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee6300 x1830964746876032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.209992:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6300 with x1830964746876032 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.209995:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee6300 00000100:00100000:3.0:1746144667.210002:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746876288 00000100:00100000:3.0:1746144667.210004:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746876288 00002000:00100000:3.0:1746144667.210012:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093ee7480 x1830964746876288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.210024:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7480 with x1830964746876288 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.210027:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee7480 00000100:00100000:3.0:1746144667.210042:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4774 00000100:00100000:3.0:1746144667.210048:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1961:x1830964746875776:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.210336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.210356:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746876544 00000100:00100000:3.0:1746144667.210359:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746876544 00000100:00100000:0.0:1746144667.210361:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4775 00000100:00100000:0.0:1746144667.210368:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746876032:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:3.0:1746144667.210371:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee4380 x1830964746876544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.210377:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4380 with x1830964746876544 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.210380:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee4380 00000100:00100000:3.0:1746144667.210391:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4776 00000100:00100000:3.0:1746144667.210395:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1960:x1830964746876288:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.210404:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4777 00000100:00100000:1.0:1746144667.210421:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746876544:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.234331:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746876544:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23906us (23985us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.234342:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4777 00002000:00100000:1.0:1746144667.234353:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093ee4380 x1830964746876544/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.234560:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4380 with x1830964746876544 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.234565:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee4380 00000100:00100000:1.0:1746144667.239207:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746876032:12345-192.168.204.23@tcp:3:cat.0 Request processed in 28831us (29768us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.239218:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4775 00002000:00100000:1.0:1746144667.239227:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093ee6300 x1830964746876032/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.239235:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6300 with x1830964746876032 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.239239:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee6300 00000100:00100000:3.0:1746144667.252314:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746876288:12345-192.168.204.23@tcp:3:cat.0 Request processed in 41909us (42856us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.252325:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4776 00002000:00100000:3.0:1746144667.252336:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093ee7480 x1830964746876288/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.252344:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee7480 with x1830964746876288 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.252349:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ee7480 00000100:00100000:3.0:1746144667.254058:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746875776:12345-192.168.204.23@tcp:3:cat.0 Request processed in 44003us (44660us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.254068:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4774 00002000:00100000:3.0:1746144667.254076:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093ee4a80 x1830964746875776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.254084:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee4a80 with x1830964746875776 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.254088:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ee4a80 00000100:00100000:0.0:1746144667.261484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.262252:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746876672 00000100:00100000:3.0:1746144667.262261:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746876672 00000100:00100000:3.0:1746144667.262358:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12289 00000100:00100000:3.0:1746144667.262366:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746876672:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.262381:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.262395:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097af6a00/0xa7c849b16e01b85d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa23 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.262437:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568256:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.262520:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.265600:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568256:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.265633:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097af6a00/0xa7c849b16e01b85d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa23 expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.265646:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097af6a00/0xa7c849b16e01b85d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa23 expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.265670:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6a00, rc 0) 00000100:00100000:3.0:1746144667.265720:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746876672:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3355us (4244us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.265726:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12289 00000100:00100000:0.0:1746144667.271416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.271493:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746876928 00000100:00100000:3.0:1746144667.271501:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746876928 00002000:00100000:3.0:1746144667.271534:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b32f480 x1830964746876928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.271543:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32f480 with x1830964746876928 ext(4194304->4935679) 00002000:00010000:3.0:1746144667.271547:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32f480 00000100:00100000:3.0:1746144667.271562:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4778 00000100:00100000:3.0:1746144667.271569:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746876928:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.279670:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746876928:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8093us (8253us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144667.279681:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4778 00002000:00100000:3.0:1746144667.279691:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009b32f480 x1830964746876928/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.279699:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b32f480 with x1830964746876928 ext(4194304->4935679) 00002000:00010000:3.0:1746144667.279704:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b32f480 00000100:00100000:0.0:1746144667.284046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.284772:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877056 00000100:00100000:3.0:1746144667.284779:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877056 00000100:00100000:3.0:1746144667.284827:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12290 00000100:00100000:3.0:1746144667.284833:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746877056:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.284846:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.284859:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097af6800/0xa7c849b16e01b864 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa2a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.284900:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568384:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.285755:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.287987:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568384:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.288021:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097af6800/0xa7c849b16e01b864 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa2a expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.288035:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097af6800/0xa7c849b16e01b864 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa2a expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.288127:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6800, rc 0) 00000100:00100000:3.0:1746144667.288200:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746877056:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3366us (4161us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.288208:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12290 00000100:00100000:0.0:1746144667.291832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.291875:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877184 00000100:00100000:3.0:1746144667.291883:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877184 00000100:00100000:3.0:1746144667.291928:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12291 00000100:00100000:3.0:1746144667.291936:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746877184:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.291952:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.291977:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097af6000/0xa7c849b16e01b86b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa31 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.292022:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568512:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.292102:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.294835:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568512:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.294860:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097af6000/0xa7c849b16e01b86b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa31 expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.294871:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097af6000/0xa7c849b16e01b86b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa31 expref: 20 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.295212:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6000, rc 0) 00000100:00100000:3.0:1746144667.295255:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746877184:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3319us (3428us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.295262:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12291 00000100:00100000:0.0:1746144667.340173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.340945:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877312 00000100:00100000:3.0:1746144667.340956:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877312 00000100:00100000:3.0:1746144667.341046:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12292 00000100:00100000:3.0:1746144667.341055:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:29399:x1830964746877312:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.341075:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.341095:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa38 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.341124:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 14 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.341152:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.341159:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.341160:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.341165:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3506176->4194303] (req 3506176->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.341195:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.341211:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144667.341224:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568640:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.341332:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 14 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.341340:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 14 pid: 10724 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.341349:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568768:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.341368:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.344418:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568640:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.344430:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747568768:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.344460:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3506176->4194303] (req 3506176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.344476:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7600, rc 0) 00000100:00100000:3.0:1746144667.345283:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:29399:x1830964746877312:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4227us (5159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.345291:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12292 00000100:00100000:0.0:1746144667.347072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.347157:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877440 00000100:00100000:1.0:1746144667.347165:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877440 00010000:00010000:1.0:1746144667.347198:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 746 lvb_type: 1 00000100:00100000:1.0:1746144667.347232:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6158 00000100:00100000:1.0:1746144667.347239:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746877440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.347256:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.347281:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.347292:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.347314:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb400/0xa7c849b16e01b841 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa15 expref: 20 pid: 8388 timeout: 746 lvb_type: 1 00010000:00010000:1.0:1746144667.347654:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.347693:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746877440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 455us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.347700:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6158 00000100:00100000:0.0:1746144667.352526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.352753:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877568 00000100:00100000:1.0:1746144667.352762:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877568 00010000:00010000:1.0:1746144667.352800:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 15 pid: 10724 timeout: 746 lvb_type: 0 00000100:00100000:1.0:1746144667.352843:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6159 00000100:00100000:1.0:1746144667.352852:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+15:1961:x1830964746877568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.352870:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.352894:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 15 pid: 10724 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.352907:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 15 pid: 10724 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.352930:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f381400/0xa7c849b16e01b7fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9cf expref: 15 pid: 10724 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.352959:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.352989:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.352997:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.353005:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.353041:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.353053:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f435f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747568896:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144667.353155:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144667.354952:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f435f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747568896:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144667.354980:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.355012:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746877568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2160us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.355022:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6159 00000100:00100000:0.0:1746144667.355223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.355278:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877824 00000100:00100000:3.0:1746144667.355284:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877824 00002000:00100000:3.0:1746144667.355327:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3506176->3510271) req@ffff88009b481f80 x1830964746877824/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.355337:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481f80 with x1830964746877824 ext(3506176->3510271) 00002000:00010000:3.0:1746144667.355341:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b481f80 00000100:00100000:3.0:1746144667.355355:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4779 00000100:00100000:3.0:1746144667.355362:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746877824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144667.358218:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746877824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 2845us (2984us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144667.358231:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4779 00002000:00100000:3.0:1746144667.358242:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3506176->3510271) req@ffff88009b481f80 x1830964746877824/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.358252:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b481f80 with x1830964746877824 ext(3506176->3510271) 00002000:00010000:3.0:1746144667.358257:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b481f80 00000100:00100000:0.0:1746144667.372176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.372326:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746877952 00000100:00100000:3.0:1746144667.372337:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746877952 00000100:00100000:3.0:1746144667.372722:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12293 00000100:00100000:3.0:1746144667.372731:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:29399:x1830964746877952:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.372751:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.372770:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa3f expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.372805:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.372812:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 36 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.372819:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.372820:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.372824:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 36 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.372855:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 36 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.372866:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 36 pid: 8388 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144667.372879:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747569024:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.374856:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.374872:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 19 pid: 8453 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.374884:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747569152:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.374920:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.380636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.380672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.380751:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746878080 00000100:00100000:2.0:1746144667.380761:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746878080 00010000:00010000:2.0:1746144667.380813:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 20 pid: 8453 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.380840:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746878208 00000100:00100000:2.0:1746144667.380843:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746878208 00010000:00010000:2.0:1746144667.380855:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 37 pid: 8388 timeout: 746 lvb_type: 1 00000100:00100000:2.0:1746144667.380876:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6160 00000100:00100000:2.0:1746144667.380883:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746878080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.380897:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.380922:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 20 pid: 8453 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.380932:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 20 pid: 8453 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.380956:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.381007:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746878080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.381012:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6160 00000100:00100000:2.0:1746144667.381027:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6161 00000100:00100000:2.0:1746144667.381033:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746878208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.381039:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.381046:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 37 pid: 8388 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144667.381054:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 37 pid: 8388 timeout: 746 lvb_type: 1 00010000:00010000:2.0:1746144667.381065:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.381067:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.381074:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.381082:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.381111:0:7309:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.381122:0:7309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747569280:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144667.381203:0:7309:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746144667.381607:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba200/0xa7c849b16e01b83a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa0e expref: 37 pid: 8388 timeout: 746 lvb_type: 1 00000100:00100000:3.0:1746144667.381622:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747569024:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.381633:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f380600/0xa7c849b16e01b809 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9dd expref: 19 pid: 8453 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.381641:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747569152:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.381663:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 36 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.381671:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7a00, rc 0) 00000100:00100000:3.0:1746144667.381694:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:29399:x1830964746877952:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8965us (9573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.381700:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12293 00000100:00100000:3.0:1746144667.385412:0:7309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7309:1830964747569280:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144667.385442:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144667.385479:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1960:x1830964746878208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4445us (4804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.385489:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6161 00000100:00100000:0.0:1746144667.387818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.388404:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746878464 00000100:00100000:3.0:1746144667.388416:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746878464 00002000:00100000:3.0:1746144667.388466:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4419584->4423679) req@ffff88009b482680 x1830964746878464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.388477:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b482680 with x1830964746878464 ext(4419584->4423679) 00002000:00010000:3.0:1746144667.388483:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b482680 00000100:00100000:3.0:1746144667.388509:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4780 00000100:00100000:3.0:1746144667.388516:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746878464:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144667.391124:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1963:x1830964746878464:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 2598us (3304us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144667.391150:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4780 00002000:00100000:3.0:1746144667.391158:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4419584->4423679) req@ffff88009b482680 x1830964746878464/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.391167:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b482680 with x1830964746878464 ext(4419584->4423679) 00002000:00010000:3.0:1746144667.391171:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b482680 00000100:00100000:0.0:1746144667.402255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.402335:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746878720 00000100:00100000:3.0:1746144667.402348:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746878720 00000100:00100000:3.0:1746144667.402406:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10203 00000100:00100000:3.0:1746144667.402413:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+34:29403:x1830964746878720:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.402443:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.402463:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6a00/0xa7c849b16e01b880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa46 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.402584:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402598:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402610:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402623:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402629:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402636:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402745:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6000/0xa7c849b16e01b895 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402753:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6000/0xa7c849b16e01b895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402759:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6000/0xa7c849b16e01b895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144667.402768:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144667.402851:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402859:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402864:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402870:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097af7400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144667.402873:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402880:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402889:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144667.402892:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144667.402895:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402904:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7400/0xa7c849b16e01b887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402920:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402924:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402928:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402933:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097af6800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144667.402935:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402939:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402945:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebeaa00) 00010000:00010000:3.0:1746144667.402947:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144667.402949:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.402953:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6800/0xa7c849b16e01b88e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144667.403000:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6a00/0xa7c849b16e01b880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa46 expref: 37 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.403012:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6000/0xa7c849b16e01b895 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa46 expref: 36 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.403024:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144667.403026:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144667.403028:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6000, rc 0) 00000100:00100000:3.0:1746144667.410213:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+36:29403:x1830964746878720:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7783us (7949us total) trans 8589944113 rc 0/0 00000100:00100000:3.0:1746144667.410369:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10203 00000100:00100000:2.0:1746144667.419585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.419664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.419758:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746878976 00000100:00100000:0.0:1746144667.419769:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746878976 00000100:00100000:0.0:1746144667.419824:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 648 00000100:00100000:0.0:1746144667.419832:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+36:1962:x1830964746878976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.419847:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144667.419875:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af6000/0xa7c849b16e01b895 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa46 expref: 36 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.419895:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144667.419900:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144667.420030:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746878848 00000100:00100000:3.0:1746144667.420034:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746878848 00000100:00100000:3.0:1746144667.420057:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12294 00000100:00100000:3.0:1746144667.420062:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:29403:x1830964746878848:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.420075:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.420089:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa4d expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.420112:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.420119:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.420121:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.420124:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2461696->2633727] (req 2461696->2633727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.420168:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 34 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.420243:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 34 pid: 22208 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.420256:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747569408:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.420305:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.422394:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+35:1962:x1830964746878976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2553us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.422407:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 648 00000100:00100000:2.0:1746144667.425818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.425864:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746879360 00000100:00100000:2.0:1746144667.425872:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746879360 00000100:00100000:0.0:1746144667.426045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.426069:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746879104 00000100:00100000:0.0:1746144667.426072:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746879104 00002000:00100000:0.0:1746144667.426106:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4423679) req@ffff88009ea0e680 x1830964746879104/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.426116:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e680 with x1830964746879104 ext(4194304->4423679) 00010000:00010000:0.0:1746144667.426124:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 35 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:0.0:1746144667.426156:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 35 pid: 22208 timeout: 746 lvb_type: 0 00002000:00010000:0.0:1746144667.426163:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0e680 00000100:00100000:0.0:1746144667.426184:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 957 00000100:00100000:0.0:1746144667.426191:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+35:1961:x1830964746879104:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:2.0:1746144667.426535:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10204 00000100:00100000:2.0:1746144667.426596:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+35:29407:x1830964746879360:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.426612:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.426629:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e01b8aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa54 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.426728:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426741:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426751:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426764:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426769:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426774:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426870:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b8bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426877:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426882:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144667.426889:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:2.0:1746144667.426977:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426983:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426989:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.426994:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3f2a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144667.426998:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427003:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427014:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144667.427016:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144667.427020:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427025:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2a00/0xa7c849b16e01b8b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427038:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427042:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427047:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427050:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e3f3e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144667.427052:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427056:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427061:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800938e0600) 00010000:00010000:2.0:1746144667.427063:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144667.427065:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427069:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f3e00/0xa7c849b16e01b8b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144667.427103:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e3f2600/0xa7c849b16e01b8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa54 expref: 38 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.427114:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b8bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa54 expref: 37 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.427119:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144667.427121:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144667.427123:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4273a00, rc 0) 00000100:00100000:2.0:1746144667.427166:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+37:29407:x1830964746879360:12345-192.168.204.23@tcp:101:cat.0 Request processed in 623us (1357us total) trans 8589944114 rc 0/0 00000100:00100000:2.0:1746144667.427172:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10204 00000100:00100000:3.0:1746144667.427559:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747569408:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.427584:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2461696->2633727] (req 2461696->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 20 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.427597:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af6400, rc 0) 00000100:00100000:3.0:1746144667.427619:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:29403:x1830964746878848:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7556us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.427626:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12294 00000100:00100000:2.0:1746144667.432506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.432540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.432561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.432588:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746879488 00000100:00100000:2.0:1746144667.432597:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746879488 00000100:00100000:2.0:1746144667.432644:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746879616 00000100:00100000:2.0:1746144667.432645:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746879616 00000100:00100000:2.0:1746144667.432660:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12295 00000100:00100000:2.0:1746144667.432666:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746879488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.432684:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.432700:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5112e00/0xa7c849b16e01b8cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa5b expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.432750:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747569536:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.432777:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12296 00000100:00100000:3.0:1746144667.432785:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746879616:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.432793:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.432803:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b8d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa62 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.432807:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.432829:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747569664:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.432851:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.432873:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746879744 00000100:00100000:0.0:1746144667.432876:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746879744 00000100:00100000:0.0:1746144667.432905:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 649 00000100:00100000:0.0:1746144667.432911:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+37:1962:x1830964746879744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.432920:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144667.432946:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4273a00/0xa7c849b16e01b8bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa54 expref: 37 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.432972:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144667.432976:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144667.433000:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+36:1962:x1830964746879744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.433006:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 649 00002000:00010000:0.0:1746144667.435330:0:22208:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144667 -> 1746144668 00002000:00010000:0.0:1746144667.435337:0:22208:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144667 -> 1746144668 00002000:00010000:0.0:1746144667.435340:0:22208:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime: 1746144667 -> 1746144668 00000100:00100000:0.0:1746144667.435368:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747569664:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144667.435395:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b8d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa62 expref: 15 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.435409:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b8d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa62 expref: 15 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.435420:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7800, rc 0) 00000100:00100000:0.0:1746144667.435463:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+14:1961:x1830964746879616:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2679us (2921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144667.435471:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12296 00002000:00010000:3.0:1746144667.436349:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144667 -> 1746144668 00002000:00010000:3.0:1746144667.436353:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144667 -> 1746144668 00002000:00010000:3.0:1746144667.436355:0:8388:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime: 1746144667 -> 1746144668 00000100:00100000:3.0:1746144667.436366:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c7d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747569536:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.436398:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5112e00/0xa7c849b16e01b8cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa5b expref: 21 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.436409:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5112e00/0xa7c849b16e01b8cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa5b expref: 21 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.436423:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5112e00, rc 0) 00000100:00100000:3.0:1746144667.436445:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746879488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3779us (3949us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.436451:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12295 00000100:00100000:3.0:1746144667.440626:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1961:x1830964746879104:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 14423us (14568us total) trans 17179873359 rc 0/0 00000100:00100000:3.0:1746144667.440638:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 957 00002000:00100000:3.0:1746144667.440651:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4423679) req@ffff88009ea0e680 x1830964746879104/t17179873359(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.440660:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0e680 with x1830964746879104 ext(4194304->4423679) 00010000:00010000:3.0:1746144667.440669:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.440683:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 746 lvb_type: 0 00002000:00010000:3.0:1746144667.440689:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0e680 00000100:00100000:0.0:1746144667.447398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.447438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.447460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.447490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.447529:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746880128 00000100:00100000:0.0:1746144667.447538:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746880128 00002000:00100000:0.0:1746144667.447587:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0dc00 x1830964746880128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.447597:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0dc00 with x1830964746880128 ext(0->1048575) 00002000:00010000:0.0:1746144667.447602:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0dc00 00000100:00100000:0.0:1746144667.447631:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746880256 00000100:00100000:0.0:1746144667.447633:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746880256 00002000:00100000:0.0:1746144667.447644:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0f100 x1830964746880256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.447657:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f100 with x1830964746880256 ext(1048576->2097151) 00002000:00010000:0.0:1746144667.447661:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0f100 00000100:00100000:0.0:1746144667.447670:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746880640 00000100:00100000:0.0:1746144667.447672:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746880640 00002000:00100000:0.0:1746144667.447682:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0f800 x1830964746880640/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.447688:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f800 with x1830964746880640 ext(1048576->2097151) 00002000:00010000:0.0:1746144667.447691:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0f800 00000100:00100000:0.0:1746144667.447698:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746880512 00000100:00100000:0.0:1746144667.447700:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746880512 00002000:00100000:0.0:1746144667.447708:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0fb80 x1830964746880512/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 504/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.447713:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0fb80 with x1830964746880512 ext(1048576->2097151) 00002000:00010000:0.0:1746144667.447716:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0fb80 00000100:00100000:0.0:1746144667.447727:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4781 00000100:00100000:0.0:1746144667.447734:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746880128:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.448651:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4782 00000100:00100000:3.0:1746144667.448661:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746880256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.449703:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4783 00000100:00100000:1.0:1746144667.449713:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+15:1962:x1830964746880640:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.451129:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4784 00000100:00100000:2.0:1746144667.451169:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746880512:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.452342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.453420:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746880896 00000100:00100000:3.0:1746144667.453430:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746880896 00010000:00010000:3.0:1746144667.453464:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.453492:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6162 00000100:00100000:3.0:1746144667.453499:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1960:x1830964746880896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144667.453510:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144667.453531:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.453543:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.453566:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01b879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4423679) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa3f expref: 37 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:3.0:1746144667.453586:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.453588:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.453596:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.453605:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.453640:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.453656:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747569792:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144667.453713:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.462829:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747569792:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.462853:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.462903:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1960:x1830964746880896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9402us (10561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.462915:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6162 00000100:00100000:3.0:1746144667.463648:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746880256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14989us (16207us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.463657:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4782 00002000:00100000:3.0:1746144667.463669:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009ea0f100 x1830964746880256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.463679:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f100 with x1830964746880256 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.463684:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0f100 00000100:00100000:0.0:1746144667.466314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.468207:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746881152 00000100:00100000:3.0:1746144667.468220:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746881152 00002000:00100000:3.0:1746144667.468270:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2465791) req@ffff880136448a80 x1830964746881152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.468282:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448a80 with x1830964746881152 ext(2461696->2465791) 00002000:00010000:3.0:1746144667.468287:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448a80 00000100:00100000:3.0:1746144667.468326:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4785 00000100:00100000:3.0:1746144667.468333:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746881152:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.470557:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746881152:12345-192.168.204.23@tcp:3:cat.0 Request processed in 2212us (4242us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144667.470569:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4785 00002000:00100000:3.0:1746144667.470580:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2465791) req@ffff880136448a80 x1830964746881152/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.470595:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448a80 with x1830964746881152 ext(2461696->2465791) 00002000:00010000:3.0:1746144667.470600:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448a80 00000100:00100000:2.0:1746144667.475387:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746880640:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25663us (27912us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.475401:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4783 00002000:00100000:2.0:1746144667.475414:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009ea0f800 x1830964746880640/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.475424:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0f800 with x1830964746880640 ext(1048576->2097151) 00002000:00010000:2.0:1746144667.475430:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0f800 00000100:00100000:2.0:1746144667.477358:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746880512:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26202us (29865us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746144667.477366:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4784 00002000:00100000:2.0:1746144667.477373:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009ea0fb80 x1830964746880512/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 504/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.477380:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0fb80 with x1830964746880512 ext(1048576->2097151) 00002000:00010000:2.0:1746144667.477384:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ea0fb80 00000100:00100000:1.0:1746144667.479812:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746880128:12345-192.168.204.23@tcp:3:cat.0 Request processed in 32070us (32422us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.479823:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4781 00002000:00100000:1.0:1746144667.479831:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0dc00 x1830964746880128/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.479839:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0dc00 with x1830964746880128 ext(0->1048575) 00002000:00010000:1.0:1746144667.479842:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ea0dc00 00000100:00100000:0.0:1746144667.482910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.486102:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746881408 00000100:00100000:1.0:1746144667.486117:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746881408 00002000:00100000:1.0:1746144667.486185:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2629632->2633727) req@ffff880136449500 x1830964746881408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.486195:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449500 with x1830964746881408 ext(2629632->2633727) 00002000:00010000:1.0:1746144667.486201:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449500 00000100:00100000:1.0:1746144667.486229:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4786 00000100:00100000:1.0:1746144667.486236:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746881408:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.486448:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746881408:12345-192.168.204.23@tcp:3:cat.0 Request processed in 211us (3546us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144667.486454:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4786 00002000:00100000:1.0:1746144667.486460:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2629632->2633727) req@ffff880136449500 x1830964746881408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.486466:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449500 with x1830964746881408 ext(2629632->2633727) 00002000:00010000:1.0:1746144667.486468:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449500 00000100:00100000:0.0:1746144667.488345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.488400:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746881664 00000100:00100000:2.0:1746144667.488406:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746881664 00000100:00100000:2.0:1746144667.488466:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4155 00000100:00100000:2.0:1746144667.488474:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+36:29403:x1830964746881664:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144667.491293:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+37:29403:x1830964746881664:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 2809us (2942us total) trans 8589944115 rc 0/0 00000100:00100000:2.0:1746144667.491304:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4155 00000100:00100000:0.0:1746144667.501213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.501328:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746881920 00000100:00100000:1.0:1746144667.501338:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746881920 00002000:00100000:1.0:1746144667.501386:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88013644bb80 x1830964746881920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 504/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.501401:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644bb80 with x1830964746881920 ext(2097152->3145727) 00002000:00010000:1.0:1746144667.501406:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644bb80 00000100:00100000:2.0:1746144667.502991:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4787 00000100:00100000:2.0:1746144667.503030:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746881920:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.509487:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746881920:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6474us (8271us total) trans 0 rc 876544/876544 00000100:00100000:2.0:1746144667.509500:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4787 00002000:00100000:2.0:1746144667.509512:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88013644bb80 x1830964746881920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 504/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.509521:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644bb80 with x1830964746881920 ext(2097152->3145727) 00002000:00010000:2.0:1746144667.509527:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644bb80 00000100:00100000:0.0:1746144667.514899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.515095:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882048 00000100:00100000:3.0:1746144667.515106:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882048 00000100:00100000:3.0:1746144667.515190:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12297 00000100:00100000:3.0:1746144667.515199:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+14:29407:x1830964746882048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.515221:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.515241:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa69 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.515272:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.515280:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.515282:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.515285:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 15 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.515316:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.515328:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 18 pid: 22208 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.515341:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747569920:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.515450:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.517493:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747569920:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.517520:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 15 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.517536:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b46a00, rc 0) 00000100:00100000:3.0:1746144667.517578:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+15:29407:x1830964746882048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2379us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.517587:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12297 00000100:00100000:0.0:1746144667.519129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.519247:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882176 00000100:00100000:2.0:1746144667.519255:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882176 00002000:00100000:2.0:1746144667.519316:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3506176->4194303) req@ffff880136448000 x1830964746882176/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.519326:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448000 with x1830964746882176 ext(3506176->4194303) 00010000:00010000:2.0:1746144667.519335:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 19 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.519349:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 19 pid: 22208 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746144667.519355:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136448000 00000100:00100000:2.0:1746144667.519457:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 958 00000100:00100000:2.0:1746144667.519466:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1960:x1830964746882176:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:2.0:1746144667.529213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.529242:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.529260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.529269:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882304 00000100:00100000:2.0:1746144667.529275:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882560 00000100:00100000:3.0:1746144667.529277:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882304 00000100:00100000:2.0:1746144667.529279:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882560 00000100:00100000:3.0:1746144667.529311:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882432 00000100:00100000:3.0:1746144667.529312:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882432 00000100:00100000:3.0:1746144667.529525:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12298 00000100:00100000:3.0:1746144667.529531:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746882304:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.529550:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144667.529564:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12299 00010000:00010000:3.0:1746144667.529566:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46400/0xa7c849b16e01b8e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa70 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.529575:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746882560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.529584:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.529596:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2800/0xa7c849b16e01b8e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa7e expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.529616:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747570048:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144667.529623:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747570176:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144667.529655:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12300 00000100:00100000:0.0:1746144667.529663:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746882432:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.529672:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.529682:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135756600/0xa7c849b16e01b8f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa77 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.529706:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.529706:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747570304:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.529707:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.529725:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.530872:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747570176:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144667.530898:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2800/0xa7c849b16e01b8e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa7e expref: 24 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.530909:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f2800/0xa7c849b16e01b8e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa7e expref: 24 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.530923:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e3f2800, rc 0) 00000100:00100000:2.0:1746144667.530949:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746882560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1378us (1705us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144667.530955:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12299 00000100:00100000:1.0:1746144667.530972:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136449c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747570304:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144667.530989:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135756600/0xa7c849b16e01b8f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa77 expref: 37 pid: 22208 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746144667.530992:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144667 -> 1746144668 00002000:00010000:2.0:1746144667.530995:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144667 -> 1746144668 00002000:00010000:2.0:1746144667.530997:0:8388:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime: 1746144667 -> 1746144668 00010000:00010000:1.0:1746144667.530997:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135756600/0xa7c849b16e01b8f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa77 expref: 37 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144667.531007:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747570048:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144667.531007:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135756600, rc 0) 00010000:00010000:2.0:1746144667.531018:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46400/0xa7c849b16e01b8e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa70 expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144667.531023:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1962:x1830964746882432:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1362us (1761us total) trans 0 rc 301/301 00010000:00010000:2.0:1746144667.531026:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46400/0xa7c849b16e01b8e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa70 expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144667.531028:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12300 00010000:00010000:2.0:1746144667.531033:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4b46400, rc 0) 00000100:00100000:2.0:1746144667.531046:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746882304:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1515us (1845us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144667.531051:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12298 00000100:00100000:2.0:1746144667.534783:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1960:x1830964746882176:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 15308us (15649us total) trans 21474840584 rc 0/0 00000100:00100000:2.0:1746144667.534796:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 958 00002000:00100000:2.0:1746144667.534809:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e8:0x0] (3506176->4194303) req@ffff880136448000 x1830964746882176/t21474840584(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.534819:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448000 with x1830964746882176 ext(3506176->4194303) 00010000:00010000:2.0:1746144667.534829:0:31507:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 21 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.534842:0:31507:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 21 pid: 22208 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746144667.534849:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136448000 00000100:00100000:0.0:1746144667.539715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.539818:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882688 00000100:00100000:2.0:1746144667.539829:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882688 00010000:00010000:2.0:1746144667.539880:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 21 pid: 22208 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.539909:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6163 00000100:00100000:2.0:1746144667.539917:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746882688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.539932:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.539998:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 21 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.540010:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 21 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.540038:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097af7600/0xa7c849b16e01b872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3506176->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa38 expref: 21 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.540053:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.540056:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.540063:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 14 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.540074:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 14 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.540108:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 14 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.540124:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747570432:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144667.540606:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.544731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.544843:0:31507:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746882944 00000100:00100000:2.0:1746144667.544854:0:31507:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746882944 00002000:00100000:2.0:1746144667.544922:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136448700 x1830964746882944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.544931:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448700 with x1830964746882944 ext(0->1048575) 00002000:00010000:2.0:1746144667.544938:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448700 00000100:00100000:2.0:1746144667.544981:0:31507:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4788 00000100:00100000:2.0:1746144667.544991:0:31507:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746882944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.549843:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747570432:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.549881:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.549924:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1961:x1830964746882688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 10006us (10218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.550233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.550273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.550301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.550330:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746883328 00000100:00100000:0.0:1746144667.550335:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746883328 00000100:00100000:3.0:1746144667.550396:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746883456 00000100:00100000:3.0:1746144667.550400:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746883456 00002000:00100000:3.0:1746144667.550415:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013644aa00 x1830964746883456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.550425:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644aa00 with x1830964746883456 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.550429:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644aa00 00000100:00100000:3.0:1746144667.550443:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746883712 00000100:00100000:3.0:1746144667.550445:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746883712 00002000:00100000:3.0:1746144667.550454:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136449c00 x1830964746883712/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.550461:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449c00 with x1830964746883712 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.550463:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449c00 00000100:00100000:3.0:1746144667.550478:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4789 00000100:00100000:3.0:1746144667.550483:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+16:1960:x1830964746883456:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:0.0:1746144667.551773:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013644b100 x1830964746883328/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.551782:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644b100 with x1830964746883328 ext(2097152->3145727) 00002000:00010000:0.0:1746144667.551785:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644b100 00000100:00100000:0.0:1746144667.551805:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4790 00000100:00100000:0.0:1746144667.551813:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746883712:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.552369:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4791 00000100:00100000:3.0:1746144667.552376:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746883328:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.553656:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6163 00000100:00100000:2.0:1746144667.562247:0:31507:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+36:1963:x1830964746882944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17248us (17518us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.562260:0:31507:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4788 00002000:00100000:2.0:1746144667.562271:0:31507:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff880136448700 x1830964746882944/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.562281:0:31507:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136448700 with x1830964746882944 ext(0->1048575) 00002000:00010000:2.0:1746144667.562287:0:31507:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136448700 00000100:00100000:3.0:1746144667.567028:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746883456:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16531us (16740us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.567042:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4789 00002000:00100000:3.0:1746144667.567055:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88013644aa00 x1830964746883456/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.567065:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644aa00 with x1830964746883456 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.567072:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644aa00 00000100:00100000:0.0:1746144667.571637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.572477:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746883840 00000100:00100000:2.0:1746144667.572487:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746883840 00000100:00100000:2.0:1746144667.572562:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12301 00000100:00100000:2.0:1746144667.572573:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:29411:x1830964746883840:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.572593:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.572612:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa85 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.572642:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.572651:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.572652:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144667.572656:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.572686:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 16 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.572697:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 16 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.572709:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747570560:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144667.572788:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.573231:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746883328:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20854us (22998us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.573241:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4791 00002000:00100000:3.0:1746144667.573250:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88013644b100 x1830964746883328/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.573259:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644b100 with x1830964746883328 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.573263:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644b100 00000100:00100000:1.0:1746144667.573290:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746883712:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21479us (22987us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.573297:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4790 00002000:00100000:1.0:1746144667.573302:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880136449c00 x1830964746883712/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.573309:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136449c00 with x1830964746883712 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.573314:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136449c00 00000100:00100000:0.0:1746144667.575403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.575481:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746883968 00000100:00100000:1.0:1746144667.575490:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746883968 00002000:00100000:1.0:1746144667.575534:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1527808->1576959) req@ffff88012cef8a80 x1830964746883968/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.575550:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8a80 with x1830964746883968 ext(1527808->1576959) 00010000:00010000:1.0:1746144667.575559:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 15 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.575572:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 15 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.575578:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cef8a80 00000100:00100000:1.0:1746144667.575611:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 959 00000100:00100000:2.0:1746144667.575616:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747570560:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144667.575617:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+15:1960:x1830964746883968:12345-192.168.204.23@tcp:4:cat.0 00010000:00010000:2.0:1746144667.575648:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 21 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.575666:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e71d400, rc 0) 00000100:00100000:2.0:1746144667.575696:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:29411:x1830964746883840:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3127us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.575703:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12301 00000100:00100000:1.0:1746144667.580709:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746883968:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5075us (5299us total) trans 21474840585 rc 0/0 00000100:00100000:1.0:1746144667.580722:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 959 00002000:00100000:1.0:1746144667.580736:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e6:0x0] (1527808->1576959) req@ffff88012cef8a80 x1830964746883968/t21474840585(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.580745:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8a80 with x1830964746883968 ext(1527808->1576959) 00010000:00010000:1.0:1746144667.580756:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 17 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.580770:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 17 pid: 30345 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.580777:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cef8a80 00000100:00100000:0.0:1746144667.582636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.582833:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746884096 00000100:00100000:2.0:1746144667.582842:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746884096 00000100:00100000:2.0:1746144667.582903:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12302 00000100:00100000:2.0:1746144667.582912:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746884096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.582931:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.584041:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e71d000/0xa7c849b16e01b8fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa8c expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.584099:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747570688:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144667.584190:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.585467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.585582:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746884224 00000100:00100000:2.0:1746144667.585590:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746884224 00010000:00010000:2.0:1746144667.585629:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 19 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.585652:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6164 00000100:00100000:2.0:1746144667.585659:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746884224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.585672:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.585693:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 19 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.585710:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 19 pid: 30345 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.585732:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.585734:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.585741:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.585750:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.585773:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.585774:0:8388:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88009b480e00 x1830964747570688) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 19 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.585782:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747570816:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144667.585793:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ef8a00/0xa7c849b16e01b7f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1527808->1576959) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9c8 expref: 19 pid: 30345 timeout: 746 lvb_type: 0 00000100:00100000:3.0:1746144667.585810:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747570688:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.585847:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e71d000/0xa7c849b16e01b8fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa8c expref: 18 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.585857:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e71d000/0xa7c849b16e01b8fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa8c expref: 18 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.585864:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e71d000, rc 0) 00000100:00100000:3.0:1746144667.586529:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746884096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3617us (3898us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.586536:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12302 00000100:00100000:2.0:1746144667.586930:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.588821:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747570816:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.588850:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.588887:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+16:1962:x1830964746884224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3228us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.588898:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6164 00000100:00100000:1.0:1746144667.589538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.589601:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746884480 00000100:00100000:2.0:1746144667.589608:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746884480 00002000:00100000:2.0:1746144667.589650:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f435f80 x1830964746884480/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.589665:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435f80 with x1830964746884480 ext(4194304->4935679) 00002000:00010000:2.0:1746144667.589669:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435f80 00000100:00100000:2.0:1746144667.589694:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4792 00000100:00100000:2.0:1746144667.589700:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746884480:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.592909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.593864:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746884736 00000100:00100000:3.0:1746144667.593875:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746884736 00002000:00100000:3.0:1746144667.593922:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012cefb480 x1830964746884736/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.593932:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb480 with x1830964746884736 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.593938:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cefb480 00000100:00100000:3.0:1746144667.593970:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4793 00000100:00100000:3.0:1746144667.593978:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746884736:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.598849:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746884480:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9136us (9300us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746144667.598862:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4792 00002000:00100000:2.0:1746144667.598874:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009f435f80 x1830964746884480/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.598885:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f435f80 with x1830964746884480 ext(4194304->4935679) 00002000:00010000:2.0:1746144667.598891:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f435f80 00000100:00100000:0.0:1746144667.608683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.608755:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746884864 00000100:00100000:3.0:1746144667.608767:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746884864 00000100:00100000:3.0:1746144667.609085:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12303 00000100:00100000:3.0:1746144667.609094:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746884864:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.610602:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.610627:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa93 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.610653:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.610654:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.610663:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 17 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.610679:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 17 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.610690:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a38e00, rc 0) 00000100:00100000:3.0:1746144667.610746:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746884864:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1653us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.610753:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12303 00000100:00100000:2.0:1746144667.611290:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746884736:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17310us (18388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.611300:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4793 00002000:00100000:2.0:1746144667.611309:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012cefb480 x1830964746884736/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.611319:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb480 with x1830964746884736 ext(1048576->2097151) 00002000:00010000:2.0:1746144667.611323:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cefb480 00000100:00100000:0.0:1746144667.623522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.624154:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885120 00000100:00100000:2.0:1746144667.624165:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885120 00000100:00100000:2.0:1746144667.624237:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4156 00000100:00100000:0.0:1746144667.624244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.624248:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+37:29407:x1830964746885120:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144667.624272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.624306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.624309:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885248 00000100:00100000:1.0:1746144667.624314:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885248 00000100:00100000:0.0:1746144667.624330:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885376 00000100:00100000:0.0:1746144667.624334:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885376 00000100:00100000:1.0:1746144667.624336:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885504 00000100:00100000:1.0:1746144667.624338:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885504 00000100:00100000:1.0:1746144667.624380:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12304 00000100:00100000:1.0:1746144667.624386:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29413:x1830964746885248:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144667.624399:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144667.624407:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12305 00000100:00100000:3.0:1746144667.624415:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1962:x1830964746885376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.624418:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fa9a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.624422:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.624430:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090a39600/0xa7c849b16e01b913 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152faa1 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.624444:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.624453:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144667.624454:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144667.624458:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3342336->3424255] (req 3342336->3424255) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 39 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.624631:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+38:29407:x1830964746885120:12345-192.168.204.23@tcp:35:cat.0 Request processed in 384us (1118us total) trans 8589944116 rc 0/0 00000100:00100000:2.0:1746144667.624637:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4156 00000100:00100000:2.0:1746144667.624674:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12306 00010000:00010000:1.0:1746144667.624674:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 19 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.624681:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747571072:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144667.624682:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746885504:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.624686:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 19 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.624690:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144667.624695:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747570944:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.624700:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152faa8 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.624713:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.624714:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.624721:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 22 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144667.624736:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144667.624736:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746144667.624746:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 22 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.624755:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437c000, rc 0) 00000100:00100000:2.0:1746144667.624770:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746885504:12345-192.168.204.23@tcp:101:cat.0 Request processed in 91us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.624775:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12306 00000100:00100000:1.0:1746144667.627383:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747570944:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144667.627416:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3342336->3424255] (req 3342336->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 39 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.627435:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c256000, rc 0) 00000100:00100000:1.0:1746144667.627480:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:29413:x1830964746885248:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3093us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.627488:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12304 00000100:00100000:3.0:1746144667.627829:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747571072:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144667.627831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144667.627852:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090a39600/0xa7c849b16e01b913 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa1 expref: 38 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.627863:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090a39600/0xa7c849b16e01b913 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa1 expref: 38 pid: 7257 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144667.627872:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885632 00000100:00100000:2.0:1746144667.627878:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885632 00010000:00010000:3.0:1746144667.627887:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090a39600, rc 0) 00000100:00100000:3.0:1746144667.627921:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:1962:x1830964746885376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3507us (3647us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.627928:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12305 00002000:00100000:2.0:1746144667.628522:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2633727) req@ffff88012c945880 x1830964746885632/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.628533:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945880 with x1830964746885632 ext(2461696->2633727) 00010000:00010000:2.0:1746144667.628541:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 20 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.628553:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 20 pid: 22208 timeout: 746 lvb_type: 0 00002000:00010000:2.0:1746144667.628560:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c945880 00000100:00100000:2.0:1746144667.628576:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 960 00000100:00100000:2.0:1746144667.628585:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746885632:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144667.629223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.630519:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885760 00000100:00100000:3.0:1746144667.630526:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885760 00000100:00100000:3.0:1746144667.630571:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12307 00000100:00100000:3.0:1746144667.630578:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+37:29411:x1830964746885760:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.630589:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.630607:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152faaf expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.630629:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.630631:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.630635:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 38 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.630646:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 38 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.630660:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e71ca00, rc 0) 00000100:00100000:3.0:1746144667.630692:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:29411:x1830964746885760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 115us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.630698:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12307 00000100:00100000:1.0:1746144667.632800:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746885632:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4208us (4959us total) trans 17179873360 rc 0/0 00000100:00100000:1.0:1746144667.632812:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 960 00002000:00100000:1.0:1746144667.632821:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2461696->2633727) req@ffff88012c945880 x1830964746885632/t17179873360(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.632830:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c945880 with x1830964746885632 ext(2461696->2633727) 00010000:00010000:1.0:1746144667.632838:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:1.0:1746144667.632853:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 746 lvb_type: 0 00002000:00010000:1.0:1746144667.632859:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c945880 00000100:00100000:0.0:1746144667.639481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.639576:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746885888 00000100:00100000:2.0:1746144667.639586:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746885888 00010000:00010000:2.0:1746144667.639638:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 746 lvb_type: 0 00000100:00100000:2.0:1746144667.639673:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6165 00000100:00100000:2.0:1746144667.639680:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746885888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144667.639692:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144667.639711:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.639720:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.639740:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af6400/0xa7c849b16e01b8a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2461696->2633727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa4d expref: 22 pid: 22208 timeout: 746 lvb_type: 0 00010000:00010000:2.0:1746144667.639769:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.639771:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.639778:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.639784:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.639790:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.639791:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.639793:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 37 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.639799:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 37 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.639826:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 37 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.639836:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747571200:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.639931:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 37 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.639937:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747571328:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144667.639971:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.642714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.642734:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b480a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747571200:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144667.642747:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b481c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747571328:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.642775:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144667.642819:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746885888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3138us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.642830:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6165 00000100:00100000:1.0:1746144667.643096:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746886144 00000100:00100000:1.0:1746144667.643104:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746886144 00002000:00100000:1.0:1746144667.643245:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3342336->3346431) req@ffff88012c947480 x1830964746886144/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.643255:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947480 with x1830964746886144 ext(3342336->3346431) 00002000:00010000:1.0:1746144667.643259:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c947480 00000100:00100000:1.0:1746144667.643381:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4794 00000100:00100000:1.0:1746144667.643390:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1962:x1830964746886144:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.643555:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1962:x1830964746886144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 165us (849us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144667.643560:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4794 00002000:00100000:1.0:1746144667.643566:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3342336->3346431) req@ffff88012c947480 x1830964746886144/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.643572:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c947480 with x1830964746886144 ext(3342336->3346431) 00002000:00010000:1.0:1746144667.643575:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c947480 00000100:00100000:0.0:1746144667.650494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.650550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.650609:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746886400 00000100:00100000:2.0:1746144667.650619:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746886400 00000100:00100000:1.0:1746144667.650632:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746886528 00000100:00100000:1.0:1746144667.650636:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746886528 00002000:00100000:2.0:1746144667.650674:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c946300 x1830964746886400/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.650674:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c944a80 x1830964746886528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 504/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.650683:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946300 with x1830964746886400 ext(2097152->3145727) 00002000:00010000:2.0:1746144667.650689:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c946300 00000100:00100000:2.0:1746144667.650708:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4795 00000100:00100000:2.0:1746144667.650716:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746886400:12345-192.168.204.23@tcp:3:cat.0 00002000:00100000:1.0:1746144667.650745:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944a80 with x1830964746886528 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.650750:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944a80 00000100:00100000:1.0:1746144667.651201:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4796 00000100:00100000:1.0:1746144667.651207:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746886528:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.653015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.655073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.655109:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746886912 00000100:00100000:3.0:1746144667.655119:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746886912 00002000:00100000:3.0:1746144667.655187:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093988e00 x1830964746886912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.655196:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988e00 with x1830964746886912 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.655201:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988e00 00000100:00100000:3.0:1746144667.655224:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4797 00000100:00100000:3.0:1746144667.655231:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746886912:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.655808:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746887168 00000100:00100000:0.0:1746144667.655812:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746887168 00002000:00100000:0.0:1746144667.655830:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f434000 x1830964746887168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.655837:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434000 with x1830964746887168 ext(3145728->4194303) 00002000:00010000:0.0:1746144667.655840:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434000 00000100:00100000:0.0:1746144667.655862:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4798 00000100:00100000:0.0:1746144667.655867:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746887168:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.666312:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746886400:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15581us (15812us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.666326:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4795 00002000:00100000:2.0:1746144667.666340:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012c946300 x1830964746886400/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.666350:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c946300 with x1830964746886400 ext(2097152->3145727) 00002000:00010000:2.0:1746144667.666355:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c946300 00000100:00100000:1.0:1746144667.670522:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746886528:12345-192.168.204.23@tcp:3:cat.0 Request processed in 19303us (19960us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746144667.670536:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4796 00002000:00100000:1.0:1746144667.670548:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012c944a80 x1830964746886528/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 504/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.670558:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c944a80 with x1830964746886528 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.670563:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c944a80 00000100:00100000:0.0:1746144667.678395:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746887168:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22515us (23318us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144667.678407:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4798 00002000:00100000:0.0:1746144667.678419:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f434000 x1830964746887168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.678429:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f434000 with x1830964746887168 ext(3145728->4194303) 00002000:00010000:0.0:1746144667.678437:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f434000 00000100:00100000:3.0:1746144667.678565:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746886912:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23333us (25555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.678573:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4797 00002000:00100000:3.0:1746144667.678579:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093988e00 x1830964746886912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.678586:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988e00 with x1830964746886912 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.678589:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988e00 00000100:00100000:0.0:1746144667.686804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.686928:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746887296 00000100:00100000:1.0:1746144667.686938:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746887296 00000100:00100000:1.0:1746144667.687004:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12308 00000100:00100000:1.0:1746144667.687012:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746887296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.687032:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.687057:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782400/0xa7c849b16e01b928 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fab6 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.687113:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571456:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.687235:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144667.688445:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571456:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144667.688479:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782400/0xa7c849b16e01b928 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fab6 expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.688491:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782400/0xa7c849b16e01b928 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fab6 expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.688518:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782400, rc 0) 00000100:00100000:1.0:1746144667.688551:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746887296:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1539us (1760us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144667.688559:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12308 00000100:00100000:0.0:1746144667.691270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.691432:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746887552 00000100:00100000:3.0:1746144667.691444:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746887552 00002000:00100000:3.0:1746144667.691497:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009398a300 x1830964746887552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.691514:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398a300 with x1830964746887552 ext(4194304->4935679) 00002000:00010000:3.0:1746144667.691520:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398a300 00000100:00100000:3.0:1746144667.691541:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4799 00000100:00100000:3.0:1746144667.691549:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746887552:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.698839:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746887552:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7278us (7566us total) trans 0 rc 741376/741376 00000100:00100000:3.0:1746144667.698850:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4799 00002000:00100000:3.0:1746144667.698863:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4935679) req@ffff88009398a300 x1830964746887552/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.698872:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398a300 with x1830964746887552 ext(4194304->4935679) 00002000:00010000:3.0:1746144667.698878:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398a300 00000100:00100000:0.0:1746144667.706093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.706209:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746887680 00000100:00100000:1.0:1746144667.706218:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746887680 00000100:00100000:1.0:1746144667.706269:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12309 00000100:00100000:1.0:1746144667.706276:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746887680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.706292:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.706309:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782000/0xa7c849b16e01b92f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fabd expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.706355:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571584:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.706439:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144667.712553:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571584:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144667.712596:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782000/0xa7c849b16e01b92f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fabd expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.712610:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782000/0xa7c849b16e01b92f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fabd expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.712634:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782000, rc 0) 00000100:00100000:1.0:1746144667.713912:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1961:x1830964746887680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7354us (7544us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144667.713922:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12309 00000100:00100000:0.0:1746144667.715366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.715493:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746887808 00000100:00100000:1.0:1746144667.715502:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746887808 00000100:00100000:1.0:1746144667.715550:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12310 00000100:00100000:1.0:1746144667.715557:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746887808:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.715578:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.715603:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783c00/0xa7c849b16e01b936 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fac4 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.715807:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571712:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.717880:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.720368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.720417:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746888064 00000100:00100000:1.0:1746144667.720427:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746888064 00000100:00100000:1.0:1746144667.720474:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10205 00000100:00100000:0.0:1746144667.720479:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571712:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.720481:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+38:29417:x1830964746888064:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144667.720505:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.720516:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783c00/0xa7c849b16e01b936 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fac4 expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.720520:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b93d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152facb expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.720528:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783c00/0xa7c849b16e01b936 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fac4 expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.720552:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783c00, rc 0) 00000100:00100000:0.0:1746144667.720605:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746887808:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5048us (5245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144667.720611:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12310 00010000:00010000:1.0:1746144667.720621:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720634:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720645:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720656:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720662:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720667:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720771:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b952 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720780:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b952 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720786:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b952 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144667.720800:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144667.720883:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720889:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720895:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720900:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009984d400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144667.720905:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720911:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720920:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144667.720923:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144667.720927:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.720931:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722150:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722160:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722166:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722175:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009984c000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144667.722178:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722183:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722191:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35dc00) 00010000:00010000:1.0:1746144667.722194:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144667.722196:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722201:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b94b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.722247:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b93d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152facb expref: 41 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.722260:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b952 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152facb expref: 40 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.722265:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.722268:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144667.722270:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099928c00, rc 0) 00000100:00100000:1.0:1746144667.722319:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+40:29417:x1830964746888064:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1838us (1961us total) trans 8589944117 rc 0/0 00000100:00100000:1.0:1746144667.722326:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10205 00010000:00010000:0.0:1746144667.725300:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144667.729649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.729709:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746888192 00000100:00100000:0.0:1746144667.729719:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746888192 00000100:00100000:0.0:1746144667.729786:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 650 00000100:00100000:0.0:1746144667.729795:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+40:1962:x1830964746888192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.729811:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144667.729844:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b952 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152facb expref: 40 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.729884:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144667.729891:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144667.729974:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+39:1962:x1830964746888192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 177us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.729982:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 650 00000100:00100000:0.0:1746144667.758208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.758296:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746888448 00000100:00100000:1.0:1746144667.758306:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746888448 00000100:00100000:1.0:1746144667.758372:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10206 00000100:00100000:1.0:1746144667.758381:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+39:29422:x1830964746888448:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.758408:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.758456:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fad2 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.758667:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758680:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758691:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758703:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758709:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758714:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758819:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b975 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758828:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b975 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758834:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b975 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144667.758842:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144667.758927:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758933:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758938:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758944:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009984de00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144667.758947:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758965:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758977:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144667.758979:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144667.758984:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.758989:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009984de00/0xa7c849b16e01b967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759017:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759022:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759026:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759030:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009984c000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144667.759032:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759037:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759042:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d100) 00010000:00010000:1.0:1746144667.759044:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144667.759045:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759049:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009984c000/0xa7c849b16e01b96e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144667.759086:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099928c00/0xa7c849b16e01b960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fad2 expref: 42 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.759098:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b975 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fad2 expref: 41 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.759104:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.759106:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144667.759108:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009984d400, rc 0) 00000100:00100000:1.0:1746144667.759194:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+41:29422:x1830964746888448:12345-192.168.204.23@tcp:101:cat.0 Request processed in 814us (997us total) trans 8589944118 rc 0/0 00000100:00100000:1.0:1746144667.759201:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10206 00000100:00100000:0.0:1746144667.778343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.778403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.778491:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746888576 00000100:00100000:2.0:1746144667.778502:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746888576 00000100:00100000:1.0:1746144667.778903:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746888704 00000100:00100000:1.0:1746144667.778907:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746888704 00000100:00100000:1.0:1746144667.778968:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 651 00000100:00100000:1.0:1746144667.778977:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+41:1960:x1830964746888704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.778993:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.779018:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009984d400/0xa7c849b16e01b975 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fad2 expref: 41 pid: 14710 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.779063:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12311 00000100:00100000:2.0:1746144667.779071:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746888576:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.779086:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.779102:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb600/0xa7c849b16e01b983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fad9 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.779185:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571840:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144667.779268:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5840 going to sleep for 11 seconds 00010000:00010000:1.0:1746144667.779496:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144667.779501:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.779527:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+40:1960:x1830964746888704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 552us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.779534:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 651 00000100:00100000:2.0:1746144667.785563:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747571840:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144667.785611:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb600/0xa7c849b16e01b983 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fad9 expref: 22 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.785625:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1bb600/0xa7c849b16e01b983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fad9 expref: 22 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.785695:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1bb600, rc 0) 00000100:00100000:2.0:1746144667.786402:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746888576:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7330us (8068us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144667.786412:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12311 00000100:00100000:0.0:1746144667.803871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.803974:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746888960 00000100:00100000:3.0:1746144667.803984:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746888960 00002000:00100000:3.0:1746144667.804030:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fb0c000 x1830964746888960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.804040:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0c000 with x1830964746888960 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.804046:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0c000 00000100:00100000:3.0:1746144667.804067:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4800 00000100:00100000:3.0:1746144667.804074:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746888960:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.819347:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+17:1962:x1830964746888960:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15260us (15474us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.819358:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4800 00002000:00100000:3.0:1746144667.819373:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009fb0c000 x1830964746888960/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.819382:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0c000 with x1830964746888960 ext(1048576->2097151) 00002000:00010000:3.0:1746144667.819388:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0c000 00000100:00100000:0.0:1746144667.831522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.831687:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889088 00000100:00100000:2.0:1746144667.831697:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889088 00000100:00100000:2.0:1746144667.831766:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12312 00000100:00100000:2.0:1746144667.831776:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:29422:x1830964746889088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.831797:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.831815:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fae0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.831843:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.831846:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.831854:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.831872:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.831883:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1ba000, rc 0) 00000100:00100000:2.0:1746144667.831944:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:29422:x1830964746889088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 170us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.831961:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12312 00000100:00100000:0.0:1746144667.843022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.843159:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889344 00000100:00100000:3.0:1746144667.843169:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889344 00002000:00100000:3.0:1746144667.843216:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fb0c700 x1830964746889344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.843225:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0c700 with x1830964746889344 ext(2097152->3145727) 00002000:00010000:3.0:1746144667.843231:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0c700 00000100:00100000:3.0:1746144667.843252:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4801 00000100:00100000:3.0:1746144667.843259:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746889344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.846283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.854825:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889472 00000100:00100000:3.0:1746144667.854839:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889472 00000100:00100000:3.0:1746144667.854912:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12313 00000100:00100000:3.0:1746144667.854920:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:29425:x1830964746889472:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144667.854939:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.854989:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fae7 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.855023:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 23 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.855030:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 39 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.855042:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.855043:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.855047:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [221184->577535] (req 221184->577535) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.855083:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 39 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.855095:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 39 pid: 8388 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144667.855107:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747571968:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.856552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144667.856609:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 23 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.856621:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 23 pid: 22208 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144667.856631:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747572096:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.857007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.857185:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889728 00000100:00100000:1.0:1746144667.857191:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889728 00000100:00100000:1.0:1746144667.857218:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889600 00000100:00100000:1.0:1746144667.857220:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889600 00000100:00100000:1.0:1746144667.857238:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12314 00000100:00100000:1.0:1746144667.857244:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:29417:x1830964746889728:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144667.857255:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.857267:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152faf5 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.857288:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.857296:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 21 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.857301:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.857303:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.857305:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [4173824->4194303] (req 4173824->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.857327:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 21 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.857335:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 21 pid: 8453 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144667.857343:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747572224:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144667.857373:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12315 00000100:00100000:1.0:1746144667.857377:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746889600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.857382:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.857390:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01b99f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152faee expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.857413:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747572352:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.857599:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.858053:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746889344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14793us (15041us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144667.858061:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4801 00002000:00100000:0.0:1746144667.858071:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88009fb0c700 x1830964746889344/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.858080:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0c700 with x1830964746889344 ext(2097152->3145727) 00002000:00010000:0.0:1746144667.858084:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0c700 00010000:00010000:1.0:1746144667.858198:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.858207:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 18 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144667.858215:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747572480:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144667.858238:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.858378:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747571968:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.859312:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.859462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.859842:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889856 00000100:00100000:1.0:1746144667.859847:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889856 00010000:00010000:1.0:1746144667.859874:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 42 pid: 8388 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144667.859895:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6166 00000100:00100000:1.0:1746144667.859899:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746889856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.859909:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.859929:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 42 pid: 8388 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144667.859938:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 42 pid: 8388 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144667.859969:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1bba00/0xa7c849b16e01b82c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa00 expref: 42 pid: 8388 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144667.860086:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747572096:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.860113:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [221184->577535] (req 221184->577535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 41 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.860130:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e71c000, rc 0) 00000100:00100000:3.0:1746144667.860180:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29425:x1830964746889472:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5261us (13903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.860187:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12313 00010000:00010000:1.0:1746144667.860361:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.860385:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746889856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 484us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.860391:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6166 00000100:00100000:0.0:1746144667.864390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.864409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.864429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.864452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.864481:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747572224:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.864484:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746889984 00000100:00100000:0.0:1746144667.864490:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746889984 00000100:00100000:1.0:1746144667.864493:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747572480:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144667.864520:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 22 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144667.864531:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [4173824->4194303] (req 4173824->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144667.864540:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746890240 00000100:00100000:0.0:1746144667.864542:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746890240 00010000:00010000:1.0:1746144667.864547:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009984c000, rc 0) 00010000:00010000:0.0:1746144667.864551:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 22 pid: 22208 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144667.864562:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746890368 00000100:00100000:0.0:1746144667.864564:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746890368 00010000:00010000:0.0:1746144667.864570:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144667.864582:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6167 00000100:00100000:0.0:1746144667.864589:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746889984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144667.864591:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:29417:x1830964746889728:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 7346us (8043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.864599:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12314 00010000:00010000:0.0:1746144667.864601:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144667.864616:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746890112 00000100:00100000:1.0:1746144667.864619:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746890112 00010000:00010000:0.0:1746144667.864622:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 22 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746144667.864631:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 22 pid: 8453 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144667.864636:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12316 00000100:00100000:1.0:1746144667.864641:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:29422:x1830964746890112:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.864654:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009437c000/0xa7c849b16e01b91a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faa8 expref: 22 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144667.864656:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.864666:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fafc expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.864666:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144667.864679:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144667.864680:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1961:x1830964746889984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 92us (301us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144667.864681:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144667.864685:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6167 00010000:00010000:1.0:1746144667.864688:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.864700:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.864707:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e7400, rc 0) 00000100:00100000:1.0:1746144667.864723:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:29422:x1830964746890112:12345-192.168.204.23@tcp:101:cat.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144667.864726:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6168 00000100:00100000:1.0:1746144667.864729:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12316 00000100:00100000:0.0:1746144667.864731:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746890240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.864737:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144667.864752:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6169 00010000:00010000:0.0:1746144667.864754:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 22 pid: 22208 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144667.864758:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746890368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144667.864762:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 22 pid: 22208 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144667.864764:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.864773:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144667.864775:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3f3a00/0xa7c849b16e01b81e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9eb expref: 22 pid: 22208 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144667.864783:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144667.864784:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144667.864785:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144667.864790:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747572352:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144667.864790:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.864793:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4b46a00/0xa7c849b16e01b8db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa69 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144667.864798:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.864804:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.864806:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.864809:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01b99f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faee expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.864809:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.864816:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.864819:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01b99f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faee expref: 39 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144667.864824:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.864831:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.864832:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092459200, rc 0) 00000100:00100000:0.0:1746144667.864834:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747572608:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144667.864839:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747572736:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144667.864885:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.864888:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1963:x1830964746889600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7509us (7879us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144667.864893:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12315 00000100:00100000:0.0:1746144667.864920:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.868379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.868502:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747572608:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144667.868521:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144667.868539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.868564:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746890624 00000100:00100000:0.0:1746144667.868570:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746890624 00002000:00100000:0.0:1746144667.868612:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (221184->225279) req@ffff88009fb0df80 x1830964746890624/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746144667.868620:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747572736:192.168.204.23@tcp:105: 00002000:00100000:0.0:1746144667.868622:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0df80 with x1830964746890624 ext(221184->225279) 00002000:00010000:0.0:1746144667.868628:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0df80 00010000:00010000:1.0:1746144667.868636:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144667.868645:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746890880 00000100:00100000:0.0:1746144667.868647:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746890880 00002000:00100000:0.0:1746144667.868659:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (4173824->4177919) req@ffff88009fb0e300 x1830964746890880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.868666:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0e300 with x1830964746890880 ext(4173824->4177919) 00002000:00010000:0.0:1746144667.868668:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0e300 00000100:00100000:0.0:1746144667.868680:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4802 00000100:00100000:0.0:1746144667.868687:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746890624:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144667.869109:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746890240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4375us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.869118:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6168 00000100:00100000:1.0:1746144667.869131:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746890368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4372us (4677us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.869157:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6169 00000100:00100000:2.0:1746144667.869162:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4803 00000100:00100000:2.0:1746144667.869182:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746890880:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144667.869279:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+18:1961:x1830964746890880:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 110us (739us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144667.869285:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4803 00002000:00100000:2.0:1746144667.869290:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (4173824->4177919) req@ffff88009fb0e300 x1830964746890880/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.869298:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0e300 with x1830964746890880 ext(4173824->4177919) 00002000:00010000:2.0:1746144667.869301:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0e300 00000100:00100000:0.0:1746144667.869739:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746890624:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1050us (1377us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144667.869746:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4802 00002000:00100000:0.0:1746144667.869751:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (221184->225279) req@ffff88009fb0df80 x1830964746890624/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/4536 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144667.869758:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0df80 with x1830964746890624 ext(221184->225279) 00002000:00010000:0.0:1746144667.869761:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0df80 00000100:00100000:0.0:1746144667.870811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.870989:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746891136 00000100:00100000:2.0:1746144667.870995:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746891136 00002000:00100000:2.0:1746144667.871028:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb0e680 x1830964746891136/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.871036:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0e680 with x1830964746891136 ext(2097152->3145727) 00002000:00010000:2.0:1746144667.871039:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0e680 00000100:00100000:2.0:1746144667.871054:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4804 00000100:00100000:2.0:1746144667.871062:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746891136:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144667.871482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.871518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.871877:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746891520 00000100:00100000:1.0:1746144667.871882:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746891520 00000100:00100000:0.0:1746144667.871882:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746891264 00000100:00100000:0.0:1746144667.871885:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746891264 00002000:00100000:1.0:1746144667.871901:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fd91500 x1830964746891520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 504/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.871908:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91500 with x1830964746891520 ext(0->1048575) 00002000:00010000:1.0:1746144667.871910:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd91500 00000100:00100000:1.0:1746144667.871922:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4805 00000100:00100000:1.0:1746144667.871926:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1962:x1830964746891520:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144667.871980:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12317 00000100:00100000:0.0:1746144667.871988:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:29417:x1830964746891264:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144667.872000:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.872019:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb03 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.872044:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 38 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.872052:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144667.872054:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144667.872057:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->4939775] (req 4194304->4939775) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.872085:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 38 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144667.872096:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 38 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144667.872108:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747572864:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144667.872309:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.876069:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747572864:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144667.876101:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->4939775] (req 4194304->4939775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.876120:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6000, rc 0) 00000100:00100000:2.0:1746144667.876200:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:29417:x1830964746891264:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4210us (4716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.876209:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12317 00000100:00100000:0.0:1746144667.877413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.877487:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746891648 00000100:00100000:2.0:1746144667.877495:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746891648 00002000:00100000:2.0:1746144667.877550:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3342336->3424255) req@ffff88009fb0ed80 x1830964746891648/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.877560:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0ed80 with x1830964746891648 ext(3342336->3424255) 00010000:00010000:2.0:1746144667.877567:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 40 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144667.877580:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 40 pid: 22208 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746144667.877587:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb0ed80 00000100:00100000:2.0:1746144667.877616:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 961 00000100:00100000:2.0:1746144667.877626:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746891648:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144667.881194:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746891136:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10121us (10371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.881205:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4804 00002000:00100000:2.0:1746144667.881218:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb0e680 x1830964746891136/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.881229:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0e680 with x1830964746891136 ext(2097152->3145727) 00002000:00010000:2.0:1746144667.881234:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0e680 00000100:00100000:2.0:1746144667.883207:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746891648:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5573us (5787us total) trans 17179873361 rc 0/0 00000100:00100000:2.0:1746144667.883218:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 961 00002000:00100000:2.0:1746144667.883227:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3eb:0x0] (3342336->3424255) req@ffff88009fb0ed80 x1830964746891648/t17179873361(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.883237:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0ed80 with x1830964746891648 ext(3342336->3424255) 00010000:00010000:2.0:1746144667.883247:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 42 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144667.883261:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 42 pid: 22208 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746144667.883268:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb0ed80 00000100:00100000:1.0:1746144667.884500:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1962:x1830964746891520:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12569us (12978us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746144667.884508:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4805 00002000:00100000:1.0:1746144667.884515:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fd91500 x1830964746891520/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 504/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.884522:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd91500 with x1830964746891520 ext(0->1048575) 00002000:00010000:1.0:1746144667.884526:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd91500 00000100:00100000:0.0:1746144667.888915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.889131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.889747:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746891776 00000100:00100000:1.0:1746144667.890209:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746891904 00000100:00100000:1.0:1746144667.890219:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746891904 00010000:00010000:1.0:1746144667.890263:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 40 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144667.890302:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6170 00000100:00100000:1.0:1746144667.890311:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746891904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.890327:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.890351:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 40 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.890368:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 40 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.890393:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c256000/0xa7c849b16e01b90c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3342336->3424255) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa9a expref: 40 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.890413:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.890415:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.890423:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 21 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.890431:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 21 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.890467:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 21 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.890480:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747572992:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144667.890541:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746891776 00000100:00100000:1.0:1746144667.891103:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.891171:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12318 00000100:00100000:2.0:1746144667.891180:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:29422:x1830964746891776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.891195:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.891207:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb0a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.891224:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.891226:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.891232:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.891243:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.891251:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3b0a00, rc 0) 00000100:00100000:2.0:1746144667.891277:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+23:29422:x1830964746891776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 100us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.891283:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12318 00000100:00100000:1.0:1746144667.894107:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747572992:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144667.894158:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.894199:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1961:x1830964746891904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3888us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.894209:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6170 00000100:00100000:0.0:1746144667.895128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.895216:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746892160 00000100:00100000:1.0:1746144667.895225:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746892160 00002000:00100000:1.0:1746144667.895265:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fb0f800 x1830964746892160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.895274:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0f800 with x1830964746892160 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.895279:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0f800 00000100:00100000:1.0:1746144667.895310:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4806 00000100:00100000:1.0:1746144667.895318:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746892160:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144667.899812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.899845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.899908:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746892288 00000100:00100000:2.0:1746144667.899916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.899918:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746892288 00000100:00100000:2.0:1746144667.899936:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746892672 00000100:00100000:2.0:1746144667.899940:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746892672 00000100:00100000:3.0:1746144667.899972:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746892416 00000100:00100000:3.0:1746144667.899974:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746892416 00000100:00100000:3.0:1746144667.900000:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12319 00000100:00100000:3.0:1746144667.900006:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746892288:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.900025:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.900041:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783c00/0xa7c849b16e01b9bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb11 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.900092:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747573120:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144667.900131:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12320 00000100:00100000:0.0:1746144667.900153:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746892416:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.900163:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.900174:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099928c00/0xa7c849b16e01b9c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb18 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.900177:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.900200:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747573248:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144667.900224:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144667.901012:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4157 00000100:00100000:2.0:1746144667.901022:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+40:29417:x1830964746892672:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144667.901222:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+41:29417:x1830964746892672:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 203us (1305us total) trans 8589944119 rc 0/0 00000100:00100000:2.0:1746144667.901229:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4157 00002000:00010000:3.0:1746144667.903821:0:8453:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size: 4934944 -> 4938848 00000100:00100000:3.0:1746144667.903844:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747573120:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.903875:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783c00/0xa7c849b16e01b9bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb11 expref: 40 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.903890:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783c00/0xa7c849b16e01b9bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb11 expref: 40 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144667.903892:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746892160:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 8574us (8766us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.903901:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4806 00002000:00100000:1.0:1746144667.903910:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009fb0f800 x1830964746892160/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.903918:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0f800 with x1830964746892160 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.903923:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0f800 00010000:00010000:3.0:1746144667.904000:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783c00, rc 0) 00000100:00100000:3.0:1746144667.904021:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746892288:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4015us (4221us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.904027:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12319 00000100:00100000:1.0:1746144667.904253:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747573248:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144667.904273:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099928c00/0xa7c849b16e01b9c2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb18 expref: 22 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.904282:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099928c00/0xa7c849b16e01b9c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb18 expref: 22 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.904294:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099928c00, rc 0) 00000100:00100000:1.0:1746144667.904382:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746892416:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4228us (4534us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144667.904391:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12320 00000100:00100000:0.0:1746144667.909128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.909486:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746892800 00000100:00100000:1.0:1746144667.909496:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746892800 00000100:00100000:1.0:1746144667.909556:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12321 00000100:00100000:1.0:1746144667.909564:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:29428:x1830964746892800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.909586:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.909607:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb1f expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.909635:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.909637:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.909644:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.909658:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.909673:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec92c00, rc 0) 00000100:00100000:1.0:1746144667.909733:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29428:x1830964746892800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 170us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.909739:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12321 00000100:00100000:0.0:1746144667.912815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.912885:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746892928 00000100:00100000:3.0:1746144667.912893:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746892928 00000100:00100000:3.0:1746144667.912939:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12322 00000100:00100000:3.0:1746144667.912946:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+18:29422:x1830964746892928:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.912970:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.912986:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb26 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.913016:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.913024:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.913025:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.913028:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.913056:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.913066:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144667.913083:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747573376:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.913191:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.914597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.914751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.914817:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746893184 00000100:00100000:1.0:1746144667.914822:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746893184 00002000:00100000:1.0:1746144667.914858:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb0dc00 x1830964746893184/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.914868:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0dc00 with x1830964746893184 ext(2097152->3145727) 00002000:00010000:1.0:1746144667.914874:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0dc00 00000100:00100000:1.0:1746144667.914888:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746893312 00000100:00100000:1.0:1746144667.914890:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746893312 00002000:00100000:1.0:1746144667.914901:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (4173824->4194303) req@ffff88012cef8380 x1830964746893312/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.914908:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8380 with x1830964746893312 ext(4173824->4194303) 00010000:00010000:1.0:1746144667.914914:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 20 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.914928:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 20 pid: 8388 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746144667.914934:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cef8380 00000100:00100000:2.0:1746144667.914943:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 962 00000100:00100000:1.0:1746144667.914963:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4807 00000100:00100000:1.0:1746144667.914969:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746893184:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144667.914976:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746893312:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:3.0:1746144667.915186:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747573376:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.915208:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.915222:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7800, rc 0) 00000100:00100000:3.0:1746144667.915245:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:29422:x1830964746892928:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2299us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.915251:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12322 00000100:00100000:3.0:1746144667.918426:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746893312:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 3463us (3662us total) trans 21474840586 rc 0/0 00000100:00100000:3.0:1746144667.918438:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 962 00002000:00100000:3.0:1746144667.918450:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (4173824->4194303) req@ffff88012cef8380 x1830964746893312/t21474840586(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.918459:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8380 with x1830964746893312 ext(4173824->4194303) 00010000:00010000:3.0:1746144667.918468:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144667.918481:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746144667.918487:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cef8380 00000100:00100000:1.0:1746144667.923528:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746893184:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8548us (8923us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.923541:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4807 00002000:00100000:1.0:1746144667.923555:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009fb0dc00 x1830964746893184/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.923565:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0dc00 with x1830964746893184 ext(2097152->3145727) 00002000:00010000:1.0:1746144667.923572:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0dc00 00000100:00100000:0.0:1746144667.925122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.925175:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746893440 00000100:00100000:1.0:1746144667.925183:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746893440 00010000:00010000:1.0:1746144667.925213:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144667.925245:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6171 00000100:00100000:1.0:1746144667.925251:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746893440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144667.925261:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144667.925281:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.925290:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.925309:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009984c000/0xa7c849b16e01b998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [4173824->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faf5 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144667.925331:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.925333:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144667.925339:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.925345:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144667.925376:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.925386:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747573504:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144667.925448:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.928925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.929171:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746893568 00000100:00100000:3.0:1746144667.929182:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746893568 00000100:00100000:3.0:1746144667.929231:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12323 00000100:00100000:3.0:1746144667.929240:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:29428:x1830964746893568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.929260:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.929279:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb2d expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.929308:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.929310:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144667.929319:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.929334:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.929345:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7400, rc 0) 00000100:00100000:3.0:1746144667.929390:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29428:x1830964746893568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 151us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.929396:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12323 00000100:00100000:1.0:1746144667.929533:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747573504:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144667.929560:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144667.929581:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746893440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4329us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144667.929590:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6171 00000100:00100000:0.0:1746144667.930196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.930260:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746893824 00000100:00100000:1.0:1746144667.930264:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746893824 00002000:00100000:1.0:1746144667.930293:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b730000 x1830964746893824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.930302:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730000 with x1830964746893824 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.930306:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b730000 00000100:00100000:1.0:1746144667.930321:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4808 00000100:00100000:1.0:1746144667.930326:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746893824:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144667.936068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.936326:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894080 00000100:00100000:3.0:1746144667.936337:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894080 00002000:00100000:3.0:1746144667.936386:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b730380 x1830964746894080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.936396:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730380 with x1830964746894080 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.936401:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b730380 00000100:00100000:3.0:1746144667.936437:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4809 00000100:00100000:3.0:1746144667.936446:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746894080:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144667.948295:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746893824:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 17953us (18084us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144667.948309:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4808 00002000:00100000:1.0:1746144667.948322:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009b730000 x1830964746893824/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144667.948332:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730000 with x1830964746893824 ext(3145728->4194303) 00002000:00010000:1.0:1746144667.948339:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b730000 00000100:00100000:3.0:1746144667.949106:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746894080:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12658us (13046us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144667.949116:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4809 00002000:00100000:3.0:1746144667.949123:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009b730380 x1830964746894080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144667.949130:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730380 with x1830964746894080 ext(3145728->4194303) 00002000:00010000:3.0:1746144667.949149:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b730380 00000100:00100000:0.0:1746144667.951261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.951325:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894208 00000100:00100000:2.0:1746144667.951335:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894208 00000100:00100000:2.0:1746144667.951407:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12324 00000100:00100000:2.0:1746144667.951415:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746894208:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.951435:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.951454:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1200/0xa7c849b16e01b9de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb34 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144667.951505:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747573632:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144667.951593:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.952060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.952115:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894336 00000100:00100000:3.0:1746144667.952120:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894336 00000100:00100000:3.0:1746144667.952174:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12325 00000100:00100000:3.0:1746144667.952181:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746894336:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.952189:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.952200:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01b9e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb3b expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.952228:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747573760:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.952278:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.955653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:2.0:1746144667.955762:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144667 -> 1746144668 00002000:00010000:2.0:1746144667.955766:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144667 -> 1746144668 00002000:00010000:2.0:1746144667.955768:0:7257:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime: 1746144667 -> 1746144668 00000100:00100000:2.0:1746144667.955791:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092935500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747573632:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144667.955835:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1200/0xa7c849b16e01b9de lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb34 expref: 26 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.955848:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b1200/0xa7c849b16e01b9de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb34 expref: 26 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144667.955870:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3b1200, rc 0) 00000100:00100000:3.0:1746144667.955897:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747573760:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144667.955914:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746894208:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4501us (4662us total) trans 0 rc 301/301 00010000:00010000:3.0:1746144667.955916:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01b9e5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb3b expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144667.955923:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12324 00010000:00010000:3.0:1746144667.955928:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01b9e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb3b expref: 25 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.955940:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7600, rc 0) 00000100:00100000:3.0:1746144667.955972:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746894336:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3791us (3920us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.955978:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12325 00000100:00100000:2.0:1746144667.956154:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894464 00000100:00100000:2.0:1746144667.956161:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894464 00000100:00100000:2.0:1746144667.956192:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12326 00000100:00100000:2.0:1746144667.956199:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29428:x1830964746894464:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144667.956214:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144667.956229:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb42 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.956251:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.956253:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144667.956260:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.956273:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144667.956282:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3b0400, rc 0) 00000100:00100000:2.0:1746144667.956302:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29428:x1830964746894464:12345-192.168.204.23@tcp:101:cat.0 Request processed in 104us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144667.956307:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12326 00000100:00100000:2.0:1746144667.960098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.961253:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894592 00000100:00100000:3.0:1746144667.961265:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894592 00000100:00100000:3.0:1746144667.961329:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12327 00000100:00100000:3.0:1746144667.961338:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746894592:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.961359:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.961377:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782000/0xa7c849b16e01b9f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb49 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.961439:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747573888:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.961540:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.961913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144667.962053:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894720 00000100:00100000:1.0:1746144667.962058:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894720 00000100:00100000:1.0:1746144667.962088:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12328 00000100:00100000:1.0:1746144667.962094:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746894720:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144667.962104:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144667.962113:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e01b9fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb50 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144667.962175:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747574016:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.962224:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144667.963495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.963540:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746894976 00000100:00100000:2.0:1746144667.963545:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746894976 00002000:00100000:2.0:1746144667.963593:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f39b100 x1830964746894976/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.963603:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b100 with x1830964746894976 ext(3145728->4194303) 00002000:00010000:2.0:1746144667.963607:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39b100 00000100:00100000:2.0:1746144667.963621:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4810 00000100:00100000:2.0:1746144667.963629:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746894976:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144667.964053:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747573888:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.964084:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782000/0xa7c849b16e01b9f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb49 expref: 26 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.964096:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782000/0xa7c849b16e01b9f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb49 expref: 26 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.964116:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782000, rc 0) 00000100:00100000:1.0:1746144667.964147:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747574016:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.964167:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746894592:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2829us (4077us total) trans 0 rc 301/301 00010000:00010000:1.0:1746144667.964168:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e01b9fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb50 expref: 25 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144667.964173:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12327 00010000:00010000:1.0:1746144667.964176:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b400/0xa7c849b16e01b9fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb50 expref: 25 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.964185:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b400, rc 0) 00000100:00100000:1.0:1746144667.964201:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746894720:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2108us (2289us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144667.964206:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12328 00000100:00100000:0.0:1746144667.966641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.966683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.966748:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746895104 00000100:00100000:3.0:1746144667.966758:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746895104 00000100:00100000:3.0:1746144667.966793:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746895232 00000100:00100000:3.0:1746144667.966796:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746895232 00000100:00100000:3.0:1746144667.966810:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12329 00000100:00100000:3.0:1746144667.966817:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746895104:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.966835:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.966852:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01ba01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb57 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.966908:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574144:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144667.966987:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144667.967661:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12330 00000100:00100000:0.0:1746144667.967669:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746895232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144667.967678:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144667.967688:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb5e expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144667.967714:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b731c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747574272:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144667.967759:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.970873:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574144:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.970891:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b731c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747574272:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.970910:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01ba01 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb57 expref: 26 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.970910:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba08 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb5e expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.970924:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01ba01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb57 expref: 26 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144667.970925:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb5e expref: 26 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.970937:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7600, rc 0) 00010000:00010000:1.0:1746144667.970937:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a600, rc 0) 00000100:00100000:3.0:1746144667.971201:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746895104:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4382us (4567us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.971210:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12329 00000100:00100000:1.0:1746144667.971210:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746895232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3541us (4525us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144667.971216:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12330 00000100:00100000:2.0:1746144667.971612:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746894976:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7984us (8118us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144667.971622:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4810 00002000:00100000:2.0:1746144667.971633:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009f39b100 x1830964746894976/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:308/0 lens 488/440 e 0 to 0 dl 1746144678 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.971642:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39b100 with x1830964746894976 ext(3145728->4194303) 00002000:00010000:2.0:1746144667.971647:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f39b100 00000100:00100000:0.0:1746144667.977912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144667.977979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.978164:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746895616 00000100:00100000:3.0:1746144667.978175:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746895616 00000100:00100000:3.0:1746144667.978223:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12331 00000100:00100000:3.0:1746144667.978231:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746895616:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.978251:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.978271:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01ba0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb65 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144667.978329:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574400:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144667.978471:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746895488 00000100:00100000:1.0:1746144667.978476:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746895488 00000100:00100000:3.0:1746144667.979425:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144667.979492:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4158 00000100:00100000:1.0:1746144667.979499:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+41:29422:x1830964746895488:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1746144667.979698:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+42:29422:x1830964746895488:12345-192.168.204.23@tcp:35:cat.0 Request processed in 199us (1797us total) trans 8589944120 rc 0/0 00000100:00100000:1.0:1746144667.979705:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4158 00000100:00100000:3.0:1746144667.980457:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574400:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144667.980486:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01ba0f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb65 expref: 41 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.980497:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7600/0xa7c849b16e01ba0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb65 expref: 41 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144667.980509:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7600, rc 0) 00000100:00100000:3.0:1746144667.980540:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1963:x1830964746895616:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2309us (2560us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144667.980546:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12331 00000100:00100000:0.0:1746144667.982206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144667.982405:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746895744 00000100:00100000:3.0:1746144667.982413:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746895744 00000100:00100000:3.0:1746144667.982454:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12332 00000100:00100000:3.0:1746144667.982460:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29428:x1830964746895744:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144667.982474:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144667.982490:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb6c expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.982517:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.982529:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.982531:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144667.982534:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->4939775] (req 4194304->4939775) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 41 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.982560:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.982572:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 22 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144667.982583:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574528:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144667.982648:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144667.984506:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144667.984534:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->4939775] (req 4194304->4939775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 41 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144667.984549:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097af7a00, rc 0) 00000100:00100000:3.0:1746144667.984845:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29428:x1830964746895744:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2382us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144667.984853:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12332 00000100:00100000:0.0:1746144667.985042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144667.985100:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746895872 00000100:00100000:2.0:1746144667.985107:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746895872 00002000:00100000:2.0:1746144667.985196:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4938847) req@ffff88009b732680 x1830964746895872/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/0 e 0 to 0 dl 1746144678 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.985204:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b732680 with x1830964746895872 ext(4194304->4938847) 00010000:00010000:2.0:1746144667.985211:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144667.985222:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746144667.985228:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b732680 00000100:00100000:2.0:1746144667.985245:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 963 00000100:00100000:2.0:1746144667.985253:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746895872:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144667.996643:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746895872:12345-192.168.204.23@tcp:4:cat.0 Request processed in 11376us (11586us total) trans 17179873362 rc 0/0 00000100:00100000:2.0:1746144667.996657:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 963 00002000:00100000:2.0:1746144667.996670:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4938847) req@ffff88009b732680 x1830964746895872/t17179873362(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:308/0 lens 488/448 e 0 to 0 dl 1746144678 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144667.996679:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b732680 with x1830964746895872 ext(4194304->4938847) 00010000:00010000:2.0:1746144667.996690:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144667.996705:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746144667.996712:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b732680 00000100:00100000:0.0:1746144668.003050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.003117:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746896000 00000100:00100000:1.0:1746144668.003127:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746896000 00010000:00010000:1.0:1746144668.003226:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.003264:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6172 00000100:00100000:1.0:1746144668.003273:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746896000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.003288:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.003312:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.003329:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.003359:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a6000/0xa7c849b16e01b9ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb03 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.003385:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.003387:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.003394:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.003402:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.003441:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.003453:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747574656:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.003532:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093b56480 going to sleep for 11 seconds 00000100:00080000:2.0:1746144668.004294:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746144668.006963:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747574656:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.007040:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.007092:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746896000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3819us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.007101:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6172 00000100:00100000:0.0:1746144668.008968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.009106:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746896256 00000100:00100000:2.0:1746144668.009115:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746896256 00002000:00100000:2.0:1746144668.009334:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88009b732d80 x1830964746896256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.009345:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b732d80 with x1830964746896256 ext(4194304->4939775) 00002000:00010000:2.0:1746144668.009350:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b732d80 00000100:00100000:2.0:1746144668.009386:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4811 00000100:00080000:0.0:1746144668.009453:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144668.009599:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746896256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.016671:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1961:x1830964746896256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7268us (7715us total) trans 0 rc 745472/745472 00000100:00100000:3.0:1746144668.016683:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4811 00002000:00100000:3.0:1746144668.016695:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88009b732d80 x1830964746896256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.016704:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b732d80 with x1830964746896256 ext(4194304->4939775) 00002000:00010000:3.0:1746144668.016710:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b732d80 00000100:00100000:0.0:1746144668.032739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.032854:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746896512 00000100:00100000:1.0:1746144668.032868:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746896512 00000100:00100000:1.0:1746144668.032942:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10207 00000100:00080000:0.0:1746144668.032944:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144668.032961:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+42:29433:x1830964746896512:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144668.033848:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144668.033870:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb73 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.034009:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034023:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034037:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034049:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034497:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034506:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034789:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e01ba32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034799:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e01ba32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034805:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e01ba32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144668.034813:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:1.0:1746144668.034893:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034902:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034909:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.034914:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f176400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144668.034917:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035630:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035643:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144668.035646:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144668.035650:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035656:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035687:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035693:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035698:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035702:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f177a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144668.035704:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035713:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035718:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d000) 00010000:00010000:1.0:1746144668.035720:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144668.035721:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035725:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.035770:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb73 expref: 45 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.035782:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e01ba32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb73 expref: 44 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.035789:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144668.035791:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746144668.035793:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f176c00, rc 0) 00000100:00100000:1.0:1746144668.035873:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+44:29433:x1830964746896512:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2922us (3143us total) trans 8589944121 rc 0/0 00000100:00100000:1.0:1746144668.035882:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10207 00000100:00100000:2.0:1746144668.042083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.042282:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746896640 00000100:00100000:1.0:1746144668.042293:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746896640 00000100:00100000:1.0:1746144668.042358:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 652 00000100:00100000:1.0:1746144668.042367:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+44:1962:x1830964746896640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.042386:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.042414:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176c00/0xa7c849b16e01ba32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb73 expref: 44 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.042430:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144668.042435:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.042881:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+43:1962:x1830964746896640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 514us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.042888:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 652 00000100:00100000:0.0:1746144668.108018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.108130:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746896768 00000100:00100000:3.0:1746144668.108173:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746896768 00000100:00100000:3.0:1746144668.108230:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12333 00000100:00100000:3.0:1746144668.108240:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+24:29433:x1830964746896768:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144668.108260:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.108280:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb7a expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.108311:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.108319:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 40 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.108326:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.108332:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144668.108334:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144668.108337:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2174976->2867199] (req 2174976->2867199) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.108369:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.108382:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.108394:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574784:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.110078:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 40 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.110094:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 40 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.110105:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574912:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.110584:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 40 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.110594:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 40 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.110602:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747575040:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.110621:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.112242:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574784:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.115296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.115324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.115367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.115392:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746896896 00000100:00100000:0.0:1746144668.115399:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746897024 00000100:00100000:2.0:1746144668.115401:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746896896 00000100:00100000:0.0:1746144668.115403:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746897024 00010000:00010000:2.0:1746144668.115440:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 41 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.115440:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 26 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.115466:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746897152 00000100:00100000:2.0:1746144668.115468:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746897152 00010000:00010000:2.0:1746144668.115480:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 42 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.115871:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6173 00000100:00100000:0.0:1746144668.115879:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1963:x1830964746896896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.115893:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144668.115897:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6174 00000100:00100000:2.0:1746144668.115905:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746897024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.115914:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.115915:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 42 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.115923:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 26 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.115927:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 42 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.115959:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6175 00000100:00100000:1.0:1746144668.115966:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1962:x1830964746897152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.115973:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144668.116051:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747574912:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.116059:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8453:1830964747575040:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.116107:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 26 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.116157:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 42 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.116167:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 42 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.116188:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7a00/0xa7c849b16e01ba16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->4939775) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb6c expref: 42 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.116211:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.116254:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746897152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 288us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.116261:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6175 00010000:00010000:0.0:1746144668.116645:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e71ca00/0xa7c849b16e01b921 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152faaf expref: 40 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.116657:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.116720:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746896896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 841us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.116725:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6173 00010000:00010000:2.0:1746144668.116795:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01b98a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae0 expref: 26 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.117089:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.117090:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->2867199] (req 2174976->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.117091:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.117099:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.117108:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.117119:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5113200, rc 0) 00010000:00010000:2.0:1746144668.117155:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 25 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.117158:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+25:29433:x1830964746896768:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8920us (9150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.117164:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12333 00000100:00100000:2.0:1746144668.117168:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747575168:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.117223:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.120021:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747575168:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.120375:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.120412:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746897024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4508us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.120426:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6174 00000100:00100000:0.0:1746144668.121750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.122025:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746897408 00000100:00100000:3.0:1746144668.122034:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746897408 00002000:00100000:3.0:1746144668.122082:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2174976->2179071) req@ffff88009b732a00 x1830964746897408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.122092:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b732a00 with x1830964746897408 ext(2174976->2179071) 00002000:00010000:3.0:1746144668.122097:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b732a00 00000100:00100000:3.0:1746144668.122257:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4812 00000100:00100000:3.0:1746144668.122265:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746897408:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144668.122434:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746897408:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 170us (690us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.122440:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4812 00002000:00100000:3.0:1746144668.122445:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2174976->2179071) req@ffff88009b732a00 x1830964746897408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.122452:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b732a00 with x1830964746897408 ext(2174976->2179071) 00002000:00010000:3.0:1746144668.122454:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b732a00 00000100:00100000:0.0:1746144668.131667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.131995:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746897664 00000100:00100000:1.0:1746144668.132007:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746897664 00002000:00100000:1.0:1746144668.132056:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2863104->2867199) req@ffff88009b731c00 x1830964746897664/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.132065:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b731c00 with x1830964746897664 ext(2863104->2867199) 00002000:00010000:1.0:1746144668.132071:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b731c00 00000100:00100000:1.0:1746144668.132738:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4813 00000100:00100000:1.0:1746144668.132748:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746897664:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144668.133031:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746897664:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 282us (1375us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144668.133039:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4813 00002000:00100000:1.0:1746144668.133046:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (2863104->2867199) req@ffff88009b731c00 x1830964746897664/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.133053:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b731c00 with x1830964746897664 ext(2863104->2867199) 00002000:00010000:1.0:1746144668.133056:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b731c00 00000100:00100000:0.0:1746144668.135577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.135666:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746897920 00000100:00100000:1.0:1746144668.135676:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746897920 00000100:00100000:1.0:1746144668.135731:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4159 00000100:00100000:1.0:1746144668.135739:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+43:29433:x1830964746897920:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:1.0:1746144668.135986:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+44:29433:x1830964746897920:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 246us (417us total) trans 8589944122 rc 0/0 00000100:00100000:1.0:1746144668.135992:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4159 00000100:00100000:0.0:1746144668.161829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.162986:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746898048 00000100:00100000:3.0:1746144668.162997:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746898048 00000100:00100000:3.0:1746144668.163684:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12334 00000100:00100000:3.0:1746144668.163695:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29436:x1830964746898048:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144668.163716:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.163737:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb81 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.163772:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.163781:0:8453:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.163788:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.163789:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.163793:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [3399680->3923967] (req 3399680->3923967) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.163826:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.163837:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 24 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.163849:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747575296:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.163974:0:8453:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.163987:0:8453:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 19 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.163995:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747575424:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.164017:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ed80 going to sleep for 11 seconds 00000100:00080000:0.0:1746144668.165282:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144668.170205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.170308:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746898176 00000100:00100000:2.0:1746144668.170317:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746898176 00010000:00010000:2.0:1746144668.170372:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 25 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.170409:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6176 00000100:00100000:2.0:1746144668.170419:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746898176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.170434:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.170459:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 25 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.170472:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 25 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.170500:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.170543:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746898176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.170550:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6176 00000100:00100000:0.0:1746144668.171448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.171719:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746898304 00000100:00100000:1.0:1746144668.171725:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746898304 00010000:00010000:1.0:1746144668.171756:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.171784:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6177 00000100:00100000:1.0:1746144668.171790:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746898304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.171800:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.171814:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.171825:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.171842:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.171844:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.171851:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.171859:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.171890:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 24 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.171902:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747575552:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.171973:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376b9900 going to sleep for 11 seconds 00010000:00010000:3.0:1746144668.172168:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3b0400/0xa7c849b16e01b9ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb42 expref: 24 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.172185:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747575296:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.172196:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097af7800/0xa7c849b16e01b9d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb26 expref: 20 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.172203:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747575424:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.172225:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.172233:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacde00, rc 0) 00000100:00100000:3.0:1746144668.172259:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29436:x1830964746898048:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 8566us (10442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.172266:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12334 00000100:00080000:0.0:1746144668.172426:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144668.173583:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747575552:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.173604:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.174113:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746898304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2321us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.174122:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6177 00000100:00100000:0.0:1746144668.174246:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.174741:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746898560 00000100:00100000:3.0:1746144668.174749:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746898560 00002000:00100000:3.0:1746144668.174787:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3399680->3403775) req@ffff88009fd94e00 x1830964746898560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.174802:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd94e00 with x1830964746898560 ext(3399680->3403775) 00002000:00010000:3.0:1746144668.174806:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd94e00 00000100:00100000:3.0:1746144668.174832:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4814 00000100:00100000:3.0:1746144668.174840:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746898560:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144668.176625:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746898560:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1777us (2369us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.176633:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4814 00002000:00100000:3.0:1746144668.176641:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3399680->3403775) req@ffff88009fd94e00 x1830964746898560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.176650:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd94e00 with x1830964746898560 ext(3399680->3403775) 00002000:00010000:3.0:1746144668.176654:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd94e00 00000100:00100000:3.0:1746144668.187760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.188240:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746898816 00000100:00100000:0.0:1746144668.188250:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746898816 00002000:00100000:0.0:1746144668.188293:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3919872->3923967) req@ffff8800a4dd5880 x1830964746898816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.188302:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5880 with x1830964746898816 ext(3919872->3923967) 00002000:00010000:0.0:1746144668.188307:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd5880 00000100:00100000:0.0:1746144668.188339:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4815 00000100:00100000:0.0:1746144668.188347:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746898816:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144668.188540:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746898816:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 193us (791us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144668.188547:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4815 00002000:00100000:0.0:1746144668.188552:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (3919872->3923967) req@ffff8800a4dd5880 x1830964746898816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.188560:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4dd5880 with x1830964746898816 ext(3919872->3923967) 00002000:00010000:0.0:1746144668.188563:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4dd5880 00000100:00100000:0.0:1746144668.205277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.205415:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746898944 00000100:00100000:1.0:1746144668.205425:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746898944 00000100:00100000:1.0:1746144668.205800:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10208 00000100:00100000:1.0:1746144668.205809:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+14:29441:x1830964746898944:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144668.205837:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144668.205856:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176000/0xa7c849b16e01ba4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb88 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.205918:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.205930:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.205940:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.205962:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.205967:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.205972:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.206077:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.206086:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 323 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.206093:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.206122:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 323 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.206159:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 323 pid: 20319 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.206171:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747575680:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.206255:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.208764:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747575680:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144668.208794:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144668.210366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.210460:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899200 00000100:00100000:2.0:1746144668.210470:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899200 00000100:00080000:0.0:1746144668.210797:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144668.210867:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4160 00000100:00100000:2.0:1746144668.210878:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+324:27209:x1830964746899200:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746144668.211120:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+325:27209:x1830964746899200:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 244us (760us total) trans 8589944123 rc 0/0 00000100:00100000:2.0:1746144668.211132:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4160 00000100:00100000:0.0:1746144668.212527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.212595:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899328 00000100:00100000:1.0:1746144668.212602:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899328 00010000:00010000:1.0:1746144668.212630:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 325 pid: 20319 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.212715:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6178 00000100:00100000:1.0:1746144668.212721:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+325:1960:x1830964746899328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.212732:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.212737:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 325 pid: 20319 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.212748:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 325 pid: 20319 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.212770:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097af7c00/0xa7c849b16e01b84f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa1c expref: 325 pid: 20319 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.212880:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144668.212885:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.212895:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.212901:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144668.213058:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144668.213191:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213198:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144668.213234:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:0.0:1746144668.213238:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144668.213252:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213262:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213271:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213281:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213287:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213292:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f177000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.213296:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144668.213326:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+324:1960:x1830964746899328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 605us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.213333:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6178 00010000:00010000:0.0:1746144668.213448:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213457:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144668.213460:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144668.213463:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213467:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177000/0xa7c849b16e01ba55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213483:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213487:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213493:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213497:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f177a00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.213499:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213503:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213508:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35dc00) 00010000:00010000:0.0:1746144668.213509:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144668.213511:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213514:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177a00/0xa7c849b16e01ba5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.213543:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176000/0xa7c849b16e01ba4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.213554:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 15 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.213560:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.213562:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144668.213564:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f176400, rc 0) 00000100:00100000:0.0:1746144668.213662:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29441:x1830964746898944:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7854us (8396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.213668:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10208 00000100:00100000:0.0:1746144668.215615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.215654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.215681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.215710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.215725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.215750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.215784:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899456 00000100:00100000:0.0:1746144668.215792:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899456 00000100:00100000:0.0:1746144668.215827:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899584 00000100:00100000:0.0:1746144668.215829:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899584 00000100:00100000:0.0:1746144668.215841:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899712 00000100:00100000:0.0:1746144668.215843:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899712 00000100:00100000:0.0:1746144668.215853:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899840 00000100:00100000:0.0:1746144668.215855:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899840 00000100:00100000:0.0:1746144668.215866:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746899968 00000100:00100000:0.0:1746144668.215868:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746899968 00000100:00100000:0.0:1746144668.215877:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900096 00000100:00100000:0.0:1746144668.215879:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900096 00000100:00100000:0.0:1746144668.215893:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12335 00000100:00100000:0.0:1746144668.215900:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746899456:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.215917:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.215933:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304b400/0xa7c849b16e01ba6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb8f expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.215995:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747575808:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144668.216068:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.216089:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12336 00000100:00100000:0.0:1746144668.216095:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746899584:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.216102:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.216112:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb96 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.216125:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.216127:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.216159:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216173:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216183:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304ae00, rc 0) 00000100:00100000:0.0:1746144668.216203:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746899584:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 109us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.216212:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12336 00000100:00100000:0.0:1746144668.216226:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12337 00000100:00100000:0.0:1746144668.216231:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746899712:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.216237:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.216243:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fb9d expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.216252:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.216253:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.216258:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216267:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216274:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304be00, rc 0) 00000100:00100000:0.0:1746144668.216287:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746899712:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.216292:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12337 00000100:00100000:0.0:1746144668.216301:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12338 00000100:00100000:0.0:1746144668.216305:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746899840:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.216311:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.216317:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fba4 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.216327:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.216328:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.216332:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 9 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216342:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 9 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216349:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a600, rc 0) 00000100:00100000:0.0:1746144668.216361:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1962:x1830964746899840:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 56us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.216366:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12338 00000100:00100000:0.0:1746144668.216375:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12339 00000100:00100000:0.0:1746144668.216379:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746899968:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.216385:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.216391:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01ba86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbab expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.216407:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01ba86 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbab expref: 9 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216415:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01ba86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbab expref: 9 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.216425:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a000, rc 0) 00000100:00100000:0.0:1746144668.216437:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1962:x1830964746899968:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 58us (712us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144668.216442:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12339 00000100:00100000:0.0:1746144668.216452:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12340 00000100:00100000:0.0:1746144668.216456:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746900096:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.216461:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.216467:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01ba8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbb2 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.216490:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747575936:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144668.216523:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.222466:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747575936:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144668.222504:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01ba8d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb2 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.222520:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01ba8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb2 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.222542:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304b000, rc 0) 00000100:00100000:1.0:1746144668.223031:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747575808:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144668.223049:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009304b400/0xa7c849b16e01ba6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb8f expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.223059:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304b400/0xa7c849b16e01ba6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb8f expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144668.223228:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1962:x1830964746900096:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6768us (7474us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144668.223236:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12340 00010000:00010000:1.0:1746144668.223743:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304b400, rc 0) 00000100:00100000:1.0:1746144668.223776:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1962:x1830964746899456:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7876us (8168us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144668.223785:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12335 00000100:00100000:0.0:1746144668.230933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.231580:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900352 00000100:00100000:2.0:1746144668.231590:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900352 00000100:00100000:2.0:1746144668.231649:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10209 00000100:00100000:2.0:1746144668.231656:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:29441:x1830964746900352:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.231676:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.231697:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01ba94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbb9 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.231791:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.231807:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.231819:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.231851:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.231862:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 16 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.231873:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747576064:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.231972:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.234751:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747576064:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.234788:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144668.234841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.235026:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900480 00000100:00100000:2.0:1746144668.235032:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900480 00010000:00010000:2.0:1746144668.235066:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 17 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.235103:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6179 00000100:00100000:2.0:1746144668.235111:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1961:x1830964746900480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.235122:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.235128:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 17 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.235153:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 17 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.235173:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f176400/0xa7c849b16e01ba63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb88 expref: 17 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.235797:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.235803:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.235813:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.235819:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.235851:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.235902:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746900480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 791us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.235912:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6179 00010000:00010000:3.0:1746144668.235936:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.235942:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144668.235970:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144668.236098:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01ba94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.236111:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.236366:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.236370:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144668.236372:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62cc00, rc 0) 00000100:00100000:3.0:1746144668.236406:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29441:x1830964746900352:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4750us (5483us total) trans 8589944124 rc 0/0 00000100:00100000:3.0:1746144668.236412:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10209 00000100:00100000:0.0:1746144668.239097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.239173:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900608 00000100:00100000:3.0:1746144668.239182:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900608 00000100:00100000:3.0:1746144668.239225:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10210 00000100:00100000:3.0:1746144668.239233:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29441:x1830964746900608:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.239255:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.239271:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacce00/0xa7c849b16e01baa9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbc0 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.239359:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.239374:0:14710:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.239380:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.239414:0:14710:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.239426:0:14710:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 17 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.239438:0:14710:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747576192:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.239502:0:14710:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.241974:0:14710:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14710:1830964747576192:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.242002:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144668.242287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.242361:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900736 00000100:00100000:2.0:1746144668.242368:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900736 00010000:00010000:2.0:1746144668.242413:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 18 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.242450:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6180 00000100:00100000:2.0:1746144668.242459:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+18:1960:x1830964746900736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.242471:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.242477:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 18 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.242490:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 18 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.242510:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01ba9b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbb9 expref: 18 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.242521:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.242525:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.242533:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.242538:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.242560:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.242593:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1960:x1830964746900736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.242599:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6180 00010000:00010000:3.0:1746144668.242714:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.242787:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144668.242830:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:3.0:1746144668.242835:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144668.242851:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.242890:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacce00/0xa7c849b16e01baa9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbc0 expref: 17 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.242906:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbc0 expref: 16 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.242912:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.242915:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144668.242917:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd200, rc 0) 00000100:00100000:3.0:1746144668.242960:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29441:x1830964746900608:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3728us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.242967:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10210 00000100:00100000:0.0:1746144668.244765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.244802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.244840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.245036:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900864 00000100:00100000:2.0:1746144668.245036:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746901120 00000100:00100000:3.0:1746144668.245043:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900864 00000100:00100000:2.0:1746144668.245043:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746901120 00000100:00100000:3.0:1746144668.245180:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746900992 00000100:00100000:3.0:1746144668.245183:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746900992 00000100:00100000:1.0:1746144668.245241:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12341 00000100:00100000:1.0:1746144668.245251:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746900864:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144668.245270:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144668.245287:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f177600/0xa7c849b16e01bab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbc7 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.245338:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747576320:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144668.245398:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.245479:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12342 00000100:00100000:2.0:1746144668.245487:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746901120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.245496:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.245506:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01babe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbd5 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.245517:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12343 00000100:00100000:0.0:1746144668.245524:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746900992:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144668.245532:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144668.245538:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747576448:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144668.245539:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b52c000/0xa7c849b16e01bac5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbce expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.245556:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b52c000/0xa7c849b16e01bac5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbce expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144668.245560:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746144668.245564:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b52c000/0xa7c849b16e01bac5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbce expref: 9 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.245581:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b52c000, rc 0) 00000100:00100000:0.0:1746144668.245601:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746900992:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 78us (760us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144668.245607:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12343 00000100:00100000:2.0:1746144668.247082:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747576448:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144668.247110:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01babe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbd5 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.247121:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01babe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbd5 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.247130:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304b000, rc 0) 00000100:00100000:1.0:1746144668.247176:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747576320:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144668.247177:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746901120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1690us (2373us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144668.247183:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12342 00010000:00010000:1.0:1746144668.247197:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f177600/0xa7c849b16e01bab7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbc7 expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.247206:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f177600/0xa7c849b16e01bab7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbc7 expref: 7 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.247213:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177600, rc 0) 00000100:00100000:1.0:1746144668.247231:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746900864:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1983us (2472us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144668.247237:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12341 00000100:00100000:0.0:1746144668.250055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.250129:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746901376 00000100:00100000:3.0:1746144668.250159:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746901376 00000100:00100000:3.0:1746144668.250203:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10211 00000100:00100000:3.0:1746144668.250211:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+16:29441:x1830964746901376:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.250231:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.250248:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bacc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbdc expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.250348:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc600/0xa7c849b16e01bad3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.250361:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc600/0xa7c849b16e01bad3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:3.0:1746144668.250372:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc600/0xa7c849b16e01bad3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:3.0:1746144668.250384:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00010000:00010000:3.0:1746144668.250497:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bacc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbdc expref: 19 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.250525:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc600/0xa7c849b16e01bad3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbdc expref: 18 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.250536:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.250539:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144668.250541:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacc600, rc 0) 00000100:00100000:3.0:1746144668.250586:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+18:29441:x1830964746901376:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 375us (540us total) trans 8589944125 rc 0/0 00000100:00100000:3.0:1746144668.250595:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10211 00000100:00100000:0.0:1746144668.252204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.252256:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.252285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.252311:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746901504 00000100:00100000:0.0:1746144668.252314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.252320:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746901504 00000100:00100000:0.0:1746144668.252328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.252342:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746901632 00000100:00100000:0.0:1746144668.252345:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746901632 00000100:00100000:2.0:1746144668.252363:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746901760 00000100:00100000:2.0:1746144668.252366:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746901760 00000100:00100000:0.0:1746144668.252481:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746901888 00000100:00100000:0.0:1746144668.252484:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746901888 00000100:00100000:0.0:1746144668.252498:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902016 00000100:00100000:0.0:1746144668.252499:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902016 00000100:00100000:0.0:1746144668.252514:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12344 00000100:00100000:0.0:1746144668.252520:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746901504:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144668.252562:0:22208:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.252580:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 38 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.252587:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144668.252589:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144668.252592:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.252621:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 38 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.252627:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12345 00010000:00010000:0.0:1746144668.252634:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 38 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.252635:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12346 00000100:00100000:2.0:1746144668.252636:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746901632:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:1.0:1746144668.252643:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746901760:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:0.0:1746144668.252647:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747576576:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.252657:0:4760:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.252662:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252669:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.252673:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.252681:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.252682:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.252689:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.252690:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 18 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.252695:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.252696:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.252696:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.252697:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.252698:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252699:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.252707:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144668.252716:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 18 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.252716:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 18 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.252724:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 18 pid: 8388 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.252725:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 18 pid: 8453 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144668.252727:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12347 00000100:00100000:2.0:1746144668.252733:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747576704:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.252733:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746901888:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:1.0:1746144668.252734:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747576832:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.252750:0:29370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.252761:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 38 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252765:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.252767:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.252772:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.252775:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.252779:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747576960:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.252787:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747577088:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.252856:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.252860:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 22 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252864:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 22 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.252868:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 22 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.252872:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747577216:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.252876:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747577344:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.252891:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.252895:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801376b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.252907:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12348 00000100:00100000:2.0:1746144668.252915:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746902016:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144668.252931:0:3010:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252942:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252962:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252969:0:3010:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 38 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252975:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746144668.252976:0:3010:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746144668.252978:0:3010:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.252997:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 38 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253004:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 38 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.253012:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747577472:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.253044:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253052:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.253060:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747577600:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.253079:0:3010:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 23 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253086:0:3010:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 23 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.253093:0:3010:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747577728:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.253103:0:3010:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00010000:00010000:0.0:1746144668.253373:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.253380:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.253385:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.253387:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.253390:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.253407:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 23 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.253415:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 23 pid: 8453 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144668.253424:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747577856:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.253471:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 8 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.253479:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144668.253487:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747577984:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.253511:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 38 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.253518:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 38 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.253525:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747578112:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.253537:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800998526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.253583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.253827:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902144 00000100:00100000:2.0:1746144668.253831:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902144 00000100:00100000:2.0:1746144668.253855:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12349 00000100:00100000:2.0:1746144668.253861:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746902144:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144668.253879:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253889:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253895:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253901:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253905:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746144668.253907:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746144668.253909:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253924:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253931:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 22 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.253939:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747578240:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.253983:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.253990:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 18 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.254002:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747578368:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.254023:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.254030:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.254038:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747578496:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.254052:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.256278:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747576704:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.256278:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747576832:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.256287:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747576576:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.256308:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.258095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.258193:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747576960:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.259001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.259153:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902528 00000100:00100000:2.0:1746144668.259161:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902528 00010000:00010000:2.0:1746144668.259210:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 19 pid: 8453 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.259237:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902400 00000100:00100000:2.0:1746144668.259239:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902400 00010000:00010000:2.0:1746144668.259249:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 20 pid: 8388 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.259270:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6181 00000100:00100000:2.0:1746144668.259278:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746902528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.259292:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.259314:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 20 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.259326:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 20 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.259348:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092458a00/0xa7c849b16e01b817 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f2 expref: 20 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.259363:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.259406:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746902528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 128us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.259413:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6181 00000100:00100000:2.0:1746144668.259429:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6182 00000100:00100000:2.0:1746144668.259436:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+18:1960:x1830964746902400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.259444:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.259454:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 18 pid: 8388 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.259462:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 18 pid: 8388 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.259478:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090a38e00/0xa7c849b16e01b905 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa93 expref: 18 pid: 8388 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.259487:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.259505:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+17:1960:x1830964746902400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 70us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.259510:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6182 00000100:00100000:0.0:1746144668.259800:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747577856:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.259825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.259843:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902272 00000100:00100000:0.0:1746144668.259846:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902272 00002000:00100000:0.0:1746144668.259876:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (221184->577535) req@ffff88009e9f9f80 x1830964746902272/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.259886:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9f9f80 with x1830964746902272 ext(221184->577535) 00010000:00010000:0.0:1746144668.259893:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.259904:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00002000:00010000:0.0:1746144668.259910:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9f9f80 00000100:00100000:0.0:1746144668.259923:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 964 00000100:00100000:0.0:1746144668.259928:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746902272:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144668.260306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.260317:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902656 00000100:00100000:0.0:1746144668.260320:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902656 00010000:00010000:0.0:1746144668.260332:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 10 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144668.260347:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6183 00000100:00100000:0.0:1746144668.260352:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746902656:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.260358:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.260368:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 10 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144668.261333:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747577088:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.261341:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10724:1830964747577344:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.261681:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747577472:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.261697:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092935180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747577600:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.261710:0:3010:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092934380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:3010:1830964747577728:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.261740:0:3010:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.261771:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747577216:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.261801:0:4760:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.261981:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 10 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.261993:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.262001:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304be00/0xa7c849b16e01ba78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb9d expref: 10 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.262073:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747578240:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.262081:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747578368:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.262088:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747578496:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.262104:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.263503:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.263743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.263767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.263800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.263820:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903040 00000100:00100000:2.0:1746144668.263827:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903040 00010000:00010000:2.0:1746144668.263860:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 23 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.263885:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6184 00000100:00100000:2.0:1746144668.263894:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1962:x1830964746903040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.263907:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.263928:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 23 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.263938:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 23 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.263968:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e71d400/0xa7c849b16e01b8f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fa85 expref: 23 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.263980:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.264009:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746903040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 118us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.264016:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6184 00000100:00100000:1.0:1746144668.264162:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903168 00000100:00100000:1.0:1746144668.264167:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903168 00002000:00100000:1.0:1746144668.264195:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2174976->2867199) req@ffff880093762a00 x1830964746903168/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.264204:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762a00 with x1830964746903168 ext(2174976->2867199) 00010000:00010000:1.0:1746144668.264210:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.264221:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746144668.264226:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093762a00 00000100:00100000:1.0:1746144668.264238:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903552 00000100:00100000:1.0:1746144668.264320:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903552 00002000:00100000:1.0:1746144668.264333:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3399680->3923967) req@ffff880093760a80 x1830964746903552/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.264340:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760a80 with x1830964746903552 ext(3399680->3923967) 00010000:00010000:1.0:1746144668.264345:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.264413:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 965 00000100:00100000:0.0:1746144668.264421:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746903168:12345-192.168.204.23@tcp:4:multiop.0 00010000:00010000:1.0:1746144668.264908:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746144668.264915:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093760a80 00000100:00100000:1.0:1746144668.265021:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 966 00000100:00100000:1.0:1746144668.265027:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746903552:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:1.0:1746144668.265542:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746902656:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5188us (5234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.265550:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6183 00000100:00100000:3.0:1746144668.267919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.269296:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903936 00000100:00100000:1.0:1746144668.269306:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903936 00010000:00010000:1.0:1746144668.269343:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 9 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144668.269380:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6185 00000100:00100000:1.0:1746144668.269387:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746903936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.269400:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.269421:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 9 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.269431:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 9 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.269454:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.269487:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746903936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 101us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.269492:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6185 00000100:00100000:1.0:1746144668.269544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.269553:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902912 00000100:00100000:1.0:1746144668.269556:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902912 00010000:00010000:1.0:1746144668.269564:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 41 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.269575:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6186 00000100:00100000:1.0:1746144668.269579:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1960:x1830964746902912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.269585:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.269592:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 41 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269604:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 41 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269614:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097af7400/0xa7c849b16e01b9d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb2d expref: 41 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269627:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.269638:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746902912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 58us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.269643:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6186 00000100:00100000:1.0:1746144668.269687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.269696:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904064 00000100:00100000:1.0:1746144668.269699:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904064 00010000:00010000:1.0:1746144668.269710:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 24 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.269726:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6187 00000100:00100000:1.0:1746144668.269730:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746904064:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.269739:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.269750:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 24 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269758:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 24 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269769:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01b9c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb1f expref: 24 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269778:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.269790:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1963:x1830964746904064:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.269795:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6187 00000100:00100000:1.0:1746144668.269850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.269860:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903424 00000100:00100000:1.0:1746144668.269862:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903424 00010000:00010000:1.0:1746144668.269871:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.269884:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6188 00000100:00100000:1.0:1746144668.269888:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746903424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.269894:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.269904:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269911:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269921:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e3f3600/0xa7c849b16e01b802 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9d6 expref: 23 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.269930:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.269932:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.269936:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.269959:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.269979:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.269992:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746903424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 103us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.269997:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6188 00010000:00010000:1.0:1746144668.270013:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270021:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270039:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270046:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270052:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270058:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f176c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144668.270062:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270074:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270083:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270088:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f176c00/0xa7c849b16e01baef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.270160:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746901760:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 17518us (17874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.270168:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12346 00000100:00100000:1.0:1746144668.270206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.270215:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903808 00000100:00100000:1.0:1746144668.270218:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903808 00010000:00010000:1.0:1746144668.270227:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 26 pid: 8453 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144668.270255:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6189 00000100:00100000:1.0:1746144668.270259:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746903808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.270265:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.270277:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 26 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.270285:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 26 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.270297:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01b825 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9f9 expref: 26 pid: 8453 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.270305:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.270319:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746903808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.270324:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6189 00000100:00100000:1.0:1746144668.270352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.270360:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746902784 00000100:00100000:1.0:1746144668.270362:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746902784 00010000:00010000:1.0:1746144668.270372:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:1.0:1746144668.270384:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6190 00000100:00100000:1.0:1746144668.270388:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746902784:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.270393:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.270401:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.270408:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.270419:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304ae00/0xa7c849b16e01ba71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb96 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00010000:00010000:1.0:1746144668.270431:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.270432:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.270434:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270440:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.270452:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.270462:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746902784:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.270467:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6190 00000100:00100000:1.0:1746144668.270491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.270498:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903296 00000100:00100000:1.0:1746144668.270500:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903296 00010000:00010000:1.0:1746144668.270508:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.270519:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6191 00000100:00100000:1.0:1746144668.270523:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746903296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.270528:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.270533:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.270540:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.270553:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3b0a00/0xa7c849b16e01b9b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb0a expref: 25 pid: 22208 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.270560:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.270569:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746903296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 47us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.270574:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6191 00000100:00100000:1.0:1746144668.270598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.270605:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746903680 00000100:00100000:1.0:1746144668.270607:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746903680 00010000:00010000:1.0:1746144668.270615:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 17 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.270625:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6192 00000100:00100000:1.0:1746144668.270629:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+17:1961:x1830964746903680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.270634:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.270639:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 17 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.270646:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 17 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.270655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144668.270655:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e7400/0xa7c849b16e01b9a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fafc expref: 17 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.270663:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.270674:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+16:1961:x1830964746903680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 44us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.270676:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904192 00000100:00100000:3.0:1746144668.270679:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904192 00000100:00100000:1.0:1746144668.270679:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6192 00010000:00010000:3.0:1746144668.270692:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 40 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.270714:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6193 00000100:00100000:3.0:1746144668.270719:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746904192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.270726:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.270735:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 40 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.270744:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 40 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.270755:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.270756:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.270759:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.270766:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.270781:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.270796:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746904192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.270801:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6193 00010000:00010000:0.0:1746144668.270968:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304a600/0xa7c849b16e01ba7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fba4 expref: 8 pid: 4760 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144668.270992:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747577984:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.271006:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e3f2c00/0xa7c849b16e01b810 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f9e4 expref: 39 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.271013:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747578112:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.271014:0:4760:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271024:0:4760:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271034:0:29370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271040:0:4760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271040:0:29370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271046:0:4760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271049:0:29370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271052:0:4760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271056:0:4760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304a800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144668.271059:0:4760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271062:0:29370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271064:0:4760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271068:0:29370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271072:0:4760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271074:0:29370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.271077:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304a800/0xa7c849b16e01bae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271079:0:29370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144668.271082:0:29370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271087:0:29370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271096:0:29370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.271101:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b800/0xa7c849b16e01baf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.271117:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746901632:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 18482us (18859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.271124:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12345 00000100:00100000:0.0:1746144668.271157:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1963:x1830964746901888:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 18424us (18842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.271164:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12347 00000100:00100000:1.0:1746144668.275928:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746903552:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 10886us (12113us total) trans 21474840587 rc 0/0 00000100:00100000:1.0:1746144668.275941:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 966 00002000:00100000:1.0:1746144668.275962:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3399680->3923967) req@ffff880093760a80 x1830964746903552/t21474840587(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/448 e 0 to 0 dl 1746144679 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.275972:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093760a80 with x1830964746903552 ext(3399680->3923967) 00010000:00010000:1.0:1746144668.275984:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.275997:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746144668.276005:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093760a80 00000100:00100000:1.0:1746144668.277178:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1963:x1830964746902272:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 17244us (17346us total) trans 17179873363 rc 0/0 00000100:00100000:1.0:1746144668.277187:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 964 00002000:00100000:1.0:1746144668.277196:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (221184->577535) req@ffff88009e9f9f80 x1830964746902272/t17179873363(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/448 e 0 to 0 dl 1746144679 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.277204:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9f9f80 with x1830964746902272 ext(221184->577535) 00010000:00010000:1.0:1746144668.277210:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.277226:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746144668.277235:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9f9f80 00000100:00100000:0.0:1746144668.280629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.280685:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904320 00000100:00100000:2.0:1746144668.280696:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904320 00000100:00100000:0.0:1746144668.280704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144668.280741:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.280768:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904448 00000100:00100000:2.0:1746144668.280770:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6194 00000100:00100000:3.0:1746144668.280771:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904448 00000100:00100000:2.0:1746144668.280778:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f98050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1962:x1830964746904320:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.280788:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.280792:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144668.280811:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6195 00010000:00010000:2.0:1746144668.280815:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.280816:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1962:x1830964746904448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.280828:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.280849:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01ba47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3399680->18446744073709551615] (req 3399680->3923967) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb81 expref: 22 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.280863:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.280865:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.280870:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280878:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280900:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144668.280917:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.280918:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280926:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.280932:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.280940:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.280957:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.280963:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e71c000/0xa7c849b16e01b991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 221184->577535) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fae7 expref: 39 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.280964:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280971:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.280975:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.280977:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.280978:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090efea00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144668.280979:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280982:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280988:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.280990:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.280997:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.281002:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090efea00/0xa7c849b16e01bb04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281007:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144668.281016:0:22208:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281021:0:22208:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281033:0:22208:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281039:0:22208:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281044:0:22208:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281049:0:22208:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144668.281051:0:22208:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.281055:0:22208:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.281061:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746902144:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 27200us (27477us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144668.281066:0:22208:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.281070:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12349 00010000:00010000:3.0:1746144668.281071:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29a200/0xa7c849b16e01bae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.281094:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f98050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1962:x1830964746904320:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 318us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.281099:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6194 00000100:00100000:3.0:1746144668.281107:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+6:1963:x1830964746901504:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 28587us (28910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.281113:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12344 00000100:00100000:3.0:1746144668.281649:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1962:x1830964746904448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 832us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.281655:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6195 00000100:00100000:1.0:1746144668.281696:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746903168:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 17275us (17926us total) trans 17179873364 rc 0/0 00000100:00100000:1.0:1746144668.281705:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 965 00002000:00100000:1.0:1746144668.281714:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2174976->2867199) req@ffff880093762a00 x1830964746903168/t17179873364(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/448 e 0 to 0 dl 1746144679 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.281723:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762a00 with x1830964746903168 ext(2174976->2867199) 00010000:00010000:1.0:1746144668.281730:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.281741:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00002000:00010000:1.0:1746144668.281747:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093762a00 00000100:00100000:0.0:1746144668.285520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.285654:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904576 00000100:00100000:3.0:1746144668.285666:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904576 00010000:00010000:3.0:1746144668.285703:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.285739:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6196 00000100:00100000:3.0:1746144668.285748:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746904576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.285763:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.285786:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.285799:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.285826:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01ba40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2174976->3145727] (req 2174976->2867199) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fb7a expref: 24 pid: 8453 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.285842:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.285844:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.285849:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.285858:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.285880:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.285934:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746904576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 187us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.285940:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6196 00010000:00010000:2.0:1746144668.286027:0:3010:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286035:0:3010:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286055:0:3010:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286062:0:3010:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286197:0:3010:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286203:0:3010:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144668.286206:0:3010:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286213:0:3010:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286224:0:3010:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.286229:0:3010:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5e00/0xa7c849b16e01bafd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3010 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.286284:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1963:x1830964746902016:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 33371us (33954us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.286292:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12348 00000100:00100000:0.0:1746144668.288343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.288414:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904832 00000100:00100000:2.0:1746144668.288422:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904832 00000100:00100000:2.0:1746144668.288578:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10212 00000100:00100000:2.0:1746144668.288588:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+18:29441:x1830964746904832:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746144668.288641:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.288663:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bab0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbc0 expref: 18 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288678:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.288682:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144668.288709:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.288720:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 323 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288727:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 323 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288734:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288740:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 323 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288745:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 43 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288750:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 8/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.288776:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 43 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288785:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 43 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.288796:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747578624:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.288880:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 323 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288886:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 323 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.288893:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747578752:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.288909:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288916:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.288922:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747578880:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.288937:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 323 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288951:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 323 pid: 20319 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.288957:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747579008:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.288975:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 323 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.288980:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 323 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.288986:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747579136:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.288998:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.292736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.292764:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746904960 00000100:00100000:3.0:1746144668.292772:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746904960 00000100:00100000:0.0:1746144668.292939:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093763b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747578624:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.292964:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747578752:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.293032:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 44 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.293061:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6197 00000100:00100000:3.0:1746144668.293069:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+44:1961:x1830964746904960:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.293083:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.293089:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 44 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.293102:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 44 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.293126:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4864c00/0xa7c849b16e01b507 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f81d expref: 44 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.293162:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.293167:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.293176:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.293218:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+43:1961:x1830964746904960:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 148us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.293225:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6197 00000100:00100000:3.0:1746144668.293373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.293384:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905088 00000100:00100000:3.0:1746144668.293387:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905088 00010000:00010000:3.0:1746144668.293398:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 324 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.293478:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747578880:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.293487:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747579008:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.293495:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747579136:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.293537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144668.293542:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144668.293552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.293573:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905344 00000100:00100000:1.0:1746144668.293577:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905344 00000100:00100000:0.0:1746144668.293590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144668.293591:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 325 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.293606:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905216 00000100:00100000:1.0:1746144668.293607:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905216 00010000:00010000:1.0:1746144668.293614:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 326 pid: 20319 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.293631:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905472 00000100:00100000:1.0:1746144668.293632:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905472 00000100:00100000:2.0:1746144668.293638:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6198 00010000:00010000:1.0:1746144668.293640:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.293648:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+326:1960:x1830964746905344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144668.293650:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6199 00000100:00100000:1.0:1746144668.293655:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+326:1960:x1830964746905216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.293657:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.293661:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.293662:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 326 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.293665:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 326 pid: 20319 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.293672:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 326 pid: 20319 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.293921:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 326 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.293935:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130327800/0xa7c849b16e01b04c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f51b expref: 326 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.293954:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.293957:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.293962:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.293986:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+325:1960:x1830964746905344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 341us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.293991:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6198 00000100:00100000:2.0:1746144668.294005:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6200 00000100:00100000:2.0:1746144668.294011:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+43:1960:x1830964746905472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.294018:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.294022:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.294029:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.294038:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01b08b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f55a expref: 43 pid: 15388 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.294047:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.294050:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.294054:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.294067:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+42:1960:x1830964746905472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 58us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.294072:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6200 00010000:00010000:1.0:1746144668.294585:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6400/0xa7c849b16e01b084 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f553 expref: 324 pid: 20319 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.294717:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6201 00000100:00100000:0.0:1746144668.294725:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+323:1960:x1830964746905088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.294735:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.294737:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.294739:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 323 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.294742:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.294751:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144668.294755:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 323 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.294766:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01b466 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152f7b4 expref: 323 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.294774:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+322:1960:x1830964746905216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1118us (1220us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144668.294779:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:1.0:1746144668.294780:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6199 00010000:00010000:0.0:1746144668.294782:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144668.294792:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144668.294799:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144668.295394:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144668.295418:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.295426:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144668.295427:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+321:1960:x1830964746905088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 703us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.295433:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6201 00000040:00080000:1.0:1746144668.296307:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2985, 88 off249632 00000004:00080000:1.0:1746144668.296316:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505180576ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296386:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2897, 88 off241880 00000004:00080000:1.0:1746144668.296391:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505256274ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296500:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2898, 88 off241968 00000004:00080000:1.0:1746144668.296505:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505370736ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296515:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2986, 88 off249720 00000004:00080000:1.0:1746144668.296517:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505382716ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296523:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2987, 88 off249808 00000004:00080000:1.0:1746144668.296526:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505391639ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296532:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2899, 88 off242056 00000004:00080000:1.0:1746144668.296534:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505399854ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296540:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2900, 88 off242144 00000004:00080000:1.0:1746144668.296542:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505407821ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296548:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2901, 88 off242232 00000004:00080000:1.0:1746144668.296550:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505415699ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296556:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2988, 88 off249896 00000004:00080000:1.0:1746144668.296559:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505424599ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296566:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2902, 88 off242320 00000004:00080000:1.0:1746144668.296568:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505434041ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296611:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2989, 88 off249984 00000004:00080000:1.0:1746144668.296615:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505480219ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296625:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2903, 88 off242408 00000004:00080000:1.0:1746144668.296627:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505492944ns, next at 593480289301ns, rc = 0 00000040:00080000:1.0:1746144668.296633:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2990, 88 off250072 00000004:00080000:1.0:1746144668.296636:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505501924ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296649:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2991, 88 off250160 00000004:00080000:1.0:1746144668.296651:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505517094ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296657:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2992, 88 off250248 00000004:00080000:1.0:1746144668.296659:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505524736ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296665:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2993, 88 off250336 00000004:00080000:1.0:1746144668.296667:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647505532349ns, next at 593496143484ns, rc = 0 00000040:00080000:1.0:1746144668.296672:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2904, 88 off242496 00000004:00080000:1.0:1746144668.296675:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647505540129ns, next at 593480289301ns, rc = 0 00000001:00080000:0.0:1746144668.319251:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944107 is committed 00000001:00080000:0.0:1746144668.319266:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944069 is committed 00000001:00080000:0.0:1746144668.319274:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944126 is committed 00000004:00080000:0.0:1746144668.319281:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2089 committed 00000004:00080000:0.0:1746144668.319288:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2174 committed 00000004:00080000:0.0:1746144668.319293:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2173 committed 00000004:00080000:0.0:1746144668.319295:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2172 committed 00000004:00080000:0.0:1746144668.319297:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2171 committed 00000004:00080000:0.0:1746144668.319299:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2088 committed 00000004:00080000:0.0:1746144668.319301:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2170 committed 00000004:00080000:0.0:1746144668.319302:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746144668.319304:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2169 committed 00000004:00080000:0.0:1746144668.319307:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2086 committed 00000004:00080000:0.0:1746144668.319309:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2085 committed 00000004:00080000:0.0:1746144668.319310:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2084 committed 00000004:00080000:0.0:1746144668.319311:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2168 committed 00000004:00080000:0.0:1746144668.319313:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2167 committed 00000004:00080000:0.0:1746144668.319315:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2083 committed 00000004:00080000:0.0:1746144668.319316:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2082 committed 00000004:00080000:0.0:1746144668.319318:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2166 committed 00000001:00080000:0.0:1746144668.319323:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944122 is committed 00000001:00080000:0.0:1746144668.319338:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944097 is committed 00000001:00080000:0.0:1746144668.319383:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944123 is committed 00000004:00010000:1.0:1746144668.319642:0:20319:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e9f9180 reply state ffff880099a97c00 transno 8589944126 ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144668.319656:0:20319:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746144668.319760:0:20319:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746144668.319778:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746904832:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 31187us (31437us total) trans 8589944126 rc 0/0 00000100:00100000:1.0:1746144668.319786:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10212 00010000:00010000:1.0:1746144668.319821:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.319829:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.319837:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.319842:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090efe800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144668.319846:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.319853:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.319868:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144668.319871:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144668.319875:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144668.319879:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe800/0xa7c849b16e01bb0b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144668.321473:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747579648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144668.321533:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.321641:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747579392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144668.322189:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747579264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144668.323223:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747579648 00000100:00100000:3.0:1746144668.323233:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747579648 00000100:00100000:3.0:1746144668.323285:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12350 00000100:00100000:3.0:1746144668.323291:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3293:x1830964747579648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.323447:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.323486:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747580160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144668.323514:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747579520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.323625:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747579904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.323642:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.323657:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747580416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.323672:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.323683:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747580928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.323698:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.323719:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747579392 00000100:00100000:1.0:1746144668.323722:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747579392 00000100:00100000:1.0:1746144668.323743:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747579904 00000100:00100000:1.0:1746144668.323745:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747579904 00000100:00100000:1.0:1746144668.323754:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580416 00000100:00100000:1.0:1746144668.323756:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580416 00000100:00100000:1.0:1746144668.323769:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580928 00000100:00100000:1.0:1746144668.323770:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580928 00000100:00100000:1.0:1746144668.323781:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12351 00000100:00100000:1.0:1746144668.323785:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3295:x1830964747579392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.323958:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1830964747579392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (510us total) trans 17179873365 rc 0/0 00000100:00100000:1.0:1746144668.323963:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12351 00000100:00100000:1.0:1746144668.323977:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12352 00000100:00100000:1.0:1746144668.323982:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3295:x1830964747579904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.324081:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3295:x1830964747579904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (437us total) trans 17179873366 rc 0/0 00000100:00100000:1.0:1746144668.324086:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12352 00000100:00100000:1.0:1746144668.324094:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12353 00000100:00100000:1.0:1746144668.324098:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1830964747580416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.324227:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3295:x1830964747580416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (554us total) trans 21474840588 rc 0/0 00000100:00100000:1.0:1746144668.324233:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12353 00000100:00100000:1.0:1746144668.324242:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12354 00000100:00100000:1.0:1746144668.324247:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1830964747580928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.324329:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3295:x1830964747580928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (630us total) trans 21474840589 rc 0/0 00000100:00100000:1.0:1746144668.324334:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12354 00000100:00100000:1.0:1746144668.324351:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.324366:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747580672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.324380:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.324387:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747581184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.324398:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.324411:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580160 00000100:00100000:1.0:1746144668.324414:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580160 00000100:00100000:1.0:1746144668.324426:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580672 00000100:00100000:1.0:1746144668.324427:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580672 00000100:00100000:1.0:1746144668.324434:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581184 00000100:00100000:1.0:1746144668.324435:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581184 00000100:00100000:1.0:1746144668.324444:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12355 00000100:00100000:1.0:1746144668.324447:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747580160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.324518:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747580160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (166us total) trans 17179873367 rc 0/0 00000100:00100000:1.0:1746144668.324522:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12355 00000100:00100000:1.0:1746144668.324529:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12356 00000100:00100000:1.0:1746144668.324533:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747580672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144668.324591:0:7257:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144668.324594:0:7257:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144668.324596:0:7257:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144668.324598:0:7257:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144668.324600:0:7257:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144668.324618:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747580672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (237us total) trans 21474840590 rc 0/0 00000100:00100000:1.0:1746144668.324622:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12356 00000100:00100000:1.0:1746144668.324630:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12357 00000100:00100000:1.0:1746144668.324634:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747581184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.324709:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747581184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (309us total) trans 21474840591 rc 0/0 00000100:00100000:1.0:1746144668.324714:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12357 00000100:00100000:1.0:1746144668.324744:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840570 gen 2 00000004:00080000:1.0:1746144668.324750:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287b800, transno 21474840510 00000004:00080000:1.0:1746144668.324757:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287a680, transno 21474840511 00000004:00080000:1.0:1746144668.324760:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287b480, transno 21474840512 00000004:00080000:1.0:1746144668.324762:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287ad80, transno 21474840513 00000004:00080000:1.0:1746144668.324764:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092879f80, transno 21474840514 00000004:00080000:1.0:1746144668.324767:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092878e00, transno 21474840515 00000004:00080000:1.0:1746144668.324769:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287bb80, transno 21474840516 00000004:00080000:1.0:1746144668.324771:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092878700, transno 21474840517 00000004:00080000:1.0:1746144668.324773:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092878a80, transno 21474840521 00000004:00080000:1.0:1746144668.324775:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092879500, transno 21474840522 00000004:00080000:1.0:1746144668.324777:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092879180, transno 21474840523 00000004:00080000:1.0:1746144668.324779:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c944e00, transno 21474840524 00000004:00080000:1.0:1746144668.324781:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287aa00, transno 21474840525 00000004:00080000:1.0:1746144668.324784:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c946680, transno 21474840526 00000004:00080000:1.0:1746144668.324786:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092879880, transno 21474840527 00000004:00080000:1.0:1746144668.324788:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c947800, transno 21474840528 00000004:00080000:1.0:1746144668.324791:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb45880, transno 21474840529 00000004:00080000:1.0:1746144668.324793:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb47800, transno 21474840530 00000004:00080000:1.0:1746144668.324796:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44380, transno 21474840531 00000004:00080000:1.0:1746144668.324798:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb46300, transno 21474840532 00000004:00080000:1.0:1746144668.324800:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44a80, transno 21474840533 00000004:00080000:1.0:1746144668.324803:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb45180, transno 21474840534 00000004:00080000:1.0:1746144668.324805:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb47480, transno 21474840535 00000004:00080000:1.0:1746144668.324807:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb46d80, transno 21474840536 00000004:00080000:1.0:1746144668.324810:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ad880, transno 21474840537 00000004:00080000:1.0:1746144668.324813:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920af480, transno 21474840538 00000004:00080000:1.0:1746144668.324815:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ad500, transno 21474840539 00000004:00080000:1.0:1746144668.324817:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920aca80, transno 21474840540 00000004:00080000:1.0:1746144668.324819:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ac700, transno 21474840541 00000004:00080000:1.0:1746144668.324821:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ae680, transno 21474840542 00000004:00080000:1.0:1746144668.324824:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ace00, transno 21474840543 00000004:00080000:1.0:1746144668.324826:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800920ae300, transno 21474840544 00000004:00080000:1.0:1746144668.324829:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a0380, transno 21474840545 00000004:00080000:1.0:1746144668.324831:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a0700, transno 21474840546 00000004:00080000:1.0:1746144668.324833:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a1180, transno 21474840547 00000004:00080000:1.0:1746144668.324835:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644a300, transno 21474840548 00000004:00080000:1.0:1746144668.324838:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a0e00, transno 21474840549 00000004:00080000:1.0:1746144668.324840:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136449180, transno 21474840550 00000004:00080000:1.0:1746144668.324842:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a3100, transno 21474840551 00000004:00080000:1.0:1746144668.324845:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136448380, transno 21474840552 00000004:00080000:1.0:1746144668.324847:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44000, transno 21474840555 00000004:00080000:1.0:1746144668.324849:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0700, transno 21474840556 00000004:00080000:1.0:1746144668.324851:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a1500, transno 21474840557 00000004:00080000:1.0:1746144668.324853:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a2d80, transno 21474840558 00000004:00080000:1.0:1746144668.324856:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb47100, transno 21474840559 00000004:00080000:1.0:1746144668.324858:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a3480, transno 21474840560 00000004:00080000:1.0:1746144668.324860:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0a80, transno 21474840561 00000004:00080000:1.0:1746144668.324862:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a1180, transno 21474840562 00000004:00080000:1.0:1746144668.324865:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ef100, transno 21474840563 00000004:00080000:1.0:1746144668.324867:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eea00, transno 21474840564 00000004:00080000:1.0:1746144668.324869:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ef480, transno 21474840565 00000004:00080000:1.0:1746144668.324871:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eca80, transno 21474840566 00000004:00080000:1.0:1746144668.324873:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ec700, transno 21474840567 00000004:00080000:1.0:1746144668.324875:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ed180, transno 21474840568 00000004:00080000:1.0:1746144668.324879:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ed500, transno 21474840569 00000004:00080000:1.0:1746144668.324881:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ec380, transno 21474840570 00000100:00100000:1.0:1746144668.324886:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009398bb80 x1830964747580672/t21474840590(21474840590) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144684 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746144668.324897:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009398bb80/2, rc 0, transno 21474840590 00000100:00100000:1.0:1746144668.324901:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747580672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.324911:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd96300/2, rc 0, transno 21474840591 00000100:00100000:1.0:1746144668.324914:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747581184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.324922:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873344 gen 2 00000004:00080000:1.0:1746144668.324925:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32c000, transno 17179873273 00000004:00080000:1.0:1746144668.324931:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32ed80, transno 17179873274 00000004:00080000:1.0:1746144668.324934:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32d880, transno 17179873275 00000004:00080000:1.0:1746144668.324936:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32dc00, transno 17179873276 00000004:00080000:1.0:1746144668.324938:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32f800, transno 17179873277 00000004:00080000:1.0:1746144668.324939:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32c700, transno 17179873278 00000004:00080000:1.0:1746144668.324952:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32f100, transno 17179873279 00000004:00080000:1.0:1746144668.324954:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b32c380, transno 17179873280 00000004:00080000:1.0:1746144668.324956:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b573b80, transno 17179873281 00000004:00080000:1.0:1746144668.324958:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b571f80, transno 17179873285 00000004:00080000:1.0:1746144668.324960:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b571880, transno 17179873286 00000004:00080000:1.0:1746144668.324962:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b570000, transno 17179873287 00000004:00080000:1.0:1746144668.324964:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b572300, transno 17179873288 00000004:00080000:1.0:1746144668.324966:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b570e00, transno 17179873289 00000004:00080000:1.0:1746144668.324968:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b570a80, transno 17179873290 00000004:00080000:1.0:1746144668.324971:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093988380, transno 17179873291 00000004:00080000:1.0:1746144668.324973:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b571500, transno 17179873292 00000004:00080000:1.0:1746144668.324976:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b570380, transno 17179873293 00000004:00080000:1.0:1746144668.324978:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4380, transno 17179873294 00000004:00080000:1.0:1746144668.324981:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4e00, transno 17179873295 00000004:00080000:1.0:1746144668.324983:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f7480, transno 17179873296 00000004:00080000:1.0:1746144668.324985:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f7100, transno 17179873297 00000004:00080000:1.0:1746144668.324988:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009398ad80, transno 17179873298 00000004:00080000:1.0:1746144668.324990:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4a80, transno 17179873299 00000004:00080000:1.0:1746144668.324992:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f5880, transno 17179873300 00000004:00080000:1.0:1746144668.324994:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4000, transno 17179873301 00000004:00080000:1.0:1746144668.324997:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f6a00, transno 17179873302 00000004:00080000:1.0:1746144668.324999:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f398380, transno 17179873305 00000004:00080000:1.0:1746144668.325002:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12c380, transno 17179873306 00000004:00080000:1.0:1746144668.325004:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39b800, transno 17179873307 00000004:00080000:1.0:1746144668.325006:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12ca80, transno 17179873308 00000004:00080000:1.0:1746144668.325008:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f399500, transno 17179873309 00000004:00080000:1.0:1746144668.325010:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12f480, transno 17179873310 00000004:00080000:1.0:1746144668.325012:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12f800, transno 17179873311 00000004:00080000:1.0:1746144668.325014:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12c000, transno 17179873312 00000004:00080000:1.0:1746144668.325016:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943fad80, transno 17179873313 00000004:00080000:1.0:1746144668.325019:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01c000, transno 17179873314 00000004:00080000:1.0:1746144668.325021:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01ce00, transno 17179873315 00000004:00080000:1.0:1746144668.325023:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01ed80, transno 17179873316 00000004:00080000:1.0:1746144668.325025:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01e680, transno 17179873317 00000004:00080000:1.0:1746144668.325027:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01df80, transno 17179873318 00000004:00080000:1.0:1746144668.325029:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01f480, transno 17179873319 00000004:00080000:1.0:1746144668.325031:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01c380, transno 17179873320 00000004:00080000:1.0:1746144668.325033:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f01d180, transno 17179873321 00000004:00080000:1.0:1746144668.325035:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b572d80, transno 17179873322 00000004:00080000:1.0:1746144668.325037:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a2a00, transno 17179873327 00000004:00080000:1.0:1746144668.325039:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a1880, transno 17179873328 00000004:00080000:1.0:1746144668.325041:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a3b80, transno 17179873329 00000004:00080000:1.0:1746144668.325043:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a1f80, transno 17179873330 00000004:00080000:1.0:1746144668.325046:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0e00, transno 17179873331 00000004:00080000:1.0:1746144668.325049:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a2680, transno 17179873332 00000004:00080000:1.0:1746144668.325051:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ee4700, transno 17179873333 00000004:00080000:1.0:1746144668.325053:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0380, transno 17179873334 00000004:00080000:1.0:1746144668.325056:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a3100, transno 17179873335 00000004:00080000:1.0:1746144668.325058:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8dc00, transno 17179873336 00000004:00080000:1.0:1746144668.325060:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8ca80, transno 17179873337 00000004:00080000:1.0:1746144668.325062:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51edf80, transno 17179873338 00000004:00080000:1.0:1746144668.325064:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8d500, transno 17179873339 00000004:00080000:1.0:1746144668.325066:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8ea00, transno 17179873340 00000004:00080000:1.0:1746144668.325068:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ee300, transno 17179873341 00000004:00080000:1.0:1746144668.325070:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099b8d180, transno 17179873342 00000004:00080000:1.0:1746144668.325073:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eed80, transno 17179873343 00000004:00080000:1.0:1746144668.325075:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b813b80, transno 17179873344 00000100:00100000:1.0:1746144668.325079:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009e9fb480 x1830964747580160/t17179873367(17179873367) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144684 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746144668.325085:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fb480/2, rc 0, transno 17179873367 00000100:00100000:1.0:1746144668.325089:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747580160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.325453:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 6 in flight, 56 done 00000004:00080000:1.0:1746144668.325716:0:14755:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 7 in flight, 63 done 00000004:00080000:1.0:1746144668.325765:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009398b800/2, rc 0, transno 21474840588 00000100:00100000:1.0:1746144668.325769:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747580416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.325776:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd94380/2, rc 0, transno 21474840589 00000100:00100000:1.0:1746144668.325778:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747580928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.325786:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9f9500/2, rc 0, transno 17179873365 00000100:00100000:1.0:1746144668.325789:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747579392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.325795:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fad80/2, rc 0, transno 17179873366 00000100:00100000:1.0:1746144668.325798:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747579904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.325808:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144668.325814:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747581312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.325834:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.325853:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581312 00000100:00100000:1.0:1746144668.325856:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581312 00000100:00100000:1.0:1746144668.325875:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12358 00000100:00100000:1.0:1746144668.325880:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747581312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.325996:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3293:x1830964747581312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (160us total) trans 17179873368 rc 0/0 00000100:00100000:1.0:1746144668.326001:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12358 00000004:00080000:1.0:1746144668.326019:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c944e00/2, rc 0, transno 17179873368 00000100:00100000:1.0:1746144668.326022:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747581312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144668.326525:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.326552:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747580032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144668.326570:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.326578:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747580544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.326590:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.326600:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747581056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.326612:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.326632:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747579520 00000100:00100000:0.0:1746144668.326635:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747579520 00000100:00100000:0.0:1746144668.326651:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580032 00000100:00100000:0.0:1746144668.326653:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580032 00000100:00100000:0.0:1746144668.326662:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580544 00000100:00100000:0.0:1746144668.326664:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580544 00000100:00100000:0.0:1746144668.326670:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581056 00000100:00100000:0.0:1746144668.326671:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581056 00000100:00100000:0.0:1746144668.326679:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12359 00000100:00100000:0.0:1746144668.326684:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1830964747579520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.326807:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747579520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (282us total) trans 21474840592 rc 0/0 00000100:00100000:0.0:1746144668.326812:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12359 00000100:00100000:0.0:1746144668.326824:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12360 00000100:00100000:0.0:1746144668.326828:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3296:x1830964747580032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144668.326915:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1830964747580032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (344us total) trans 17179873369 rc 0/0 00000100:00100000:0.0:1746144668.326920:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12360 00000100:00100000:0.0:1746144668.326929:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12361 00000100:00100000:0.0:1746144668.326933:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1830964747580544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.327018:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747580544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (426us total) trans 21474840593 rc 0/0 00000100:00100000:0.0:1746144668.327023:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12361 00000100:00100000:0.0:1746144668.327031:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12362 00000100:00100000:0.0:1746144668.327035:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1830964747581056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.327116:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747581056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (502us total) trans 21474840594 rc 0/0 00000100:00100000:0.0:1746144668.327121:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12362 00000004:00080000:0.0:1746144668.327168:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093989c00/2, rc 0, transno 21474840592 00000100:00100000:0.0:1746144668.327172:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747579520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144668.327179:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fb100/2, rc 0, transno 17179873369 00000100:00100000:0.0:1746144668.327181:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747580032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144668.327187:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009398b100/2, rc 0, transno 21474840593 00000100:00100000:0.0:1746144668.327189:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747580544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144668.327194:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd95f80/2, rc 0, transno 21474840594 00000100:00100000:0.0:1746144668.327197:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747581056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144668.327352:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144668.327376:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747579776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144668.327393:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144668.327403:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747580288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144668.327416:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144668.327425:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747580800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144668.327438:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144668.327456:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747579264 00000100:00100000:2.0:1746144668.327459:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747579264 00000100:00100000:2.0:1746144668.327486:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747579776 00000100:00100000:2.0:1746144668.327488:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747579776 00000100:00100000:2.0:1746144668.327496:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580288 00000100:00100000:2.0:1746144668.327498:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580288 00000100:00100000:2.0:1746144668.327505:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747580800 00000100:00100000:2.0:1746144668.327506:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747580800 00000100:00100000:2.0:1746144668.327514:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12363 00000100:00100000:2.0:1746144668.327518:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747579264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144668.327617:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747579264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (264us total) trans 17179873370 rc 0/0 00000100:00100000:2.0:1746144668.327622:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12363 00000100:00100000:2.0:1746144668.327633:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12364 00000100:00100000:2.0:1746144668.327639:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747579776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144668.327714:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747579776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (319us total) trans 17179873371 rc 0/0 00000100:00100000:2.0:1746144668.327718:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12364 00000100:00100000:2.0:1746144668.327726:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12365 00000100:00100000:2.0:1746144668.327732:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747580288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144668.327805:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3294:x1830964747580288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (387us total) trans 17179873372 rc 0/0 00000100:00100000:2.0:1746144668.327810:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12365 00000100:00100000:2.0:1746144668.327818:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12366 00000100:00100000:2.0:1746144668.327824:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747580800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144668.327899:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747580800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (460us total) trans 21474840595 rc 0/0 00000100:00100000:2.0:1746144668.327904:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12366 00000004:00080000:2.0:1746144668.327926:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9f9880/2, rc 0, transno 17179873370 00000100:00100000:2.0:1746144668.327929:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747579264:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144668.327934:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9faa00/2, rc 0, transno 17179873371 00000100:00100000:2.0:1746144668.327936:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747579776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144668.327951:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fb800/2, rc 0, transno 17179873372 00000100:00100000:2.0:1746144668.327953:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747580288:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144668.327960:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093989180/2, rc 0, transno 21474840595 00000100:00100000:2.0:1746144668.327962:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093989180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747580800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144668.328253:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747579648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4962us (6721us total) trans 17179873373 rc 0/0 00000100:00100000:3.0:1746144668.328259:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12350 00000100:00080000:3.0:1746144668.328276:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746144668.328281:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746144668.328343:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fa680/2, rc 0, transno 17179873373 00000100:00100000:0.0:1746144668.328347:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747579648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.329699:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.329784:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905600 00000100:00100000:2.0:1746144668.329790:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905600 00000100:00100000:3.0:1746144668.331117:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10213 00000100:00100000:3.0:1746144668.331130:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29441:x1830964746905600:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.331176:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.331197:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbe3 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.331257:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.331271:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.331288:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.331291:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144668.331294:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012daccc00, rc 0) 00000100:00100000:3.0:1746144668.331356:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746905600:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 230us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.331361:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10213 00000100:00100000:0.0:1746144668.337413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.337475:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905728 00000100:00100000:2.0:1746144668.337486:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905728 00000100:00100000:2.0:1746144668.337564:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10214 00000100:00100000:2.0:1746144668.337575:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746905728:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.337598:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.337617:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304bc00/0xa7c849b16e01bb19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbea expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.337707:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01bb20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.337721:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01bb20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.337733:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01bb20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144668.337760:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 16777217 00000004:00200000:2.0:1746144668.337763:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144668.337777:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01bb20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.337801:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304bc00/0xa7c849b16e01bb19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbea expref: 10 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.337815:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01bb20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbea expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.337822:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.337825:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144668.337828:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304a200, rc 0) 00000100:00100000:2.0:1746144668.338613:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746905728:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1038us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.338620:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10214 00000100:00100000:2.0:1746144668.345728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.345765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.345789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.345802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.345814:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905856 00000100:00100000:2.0:1746144668.345819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.345825:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905856 00000100:00100000:3.0:1746144668.345868:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746905984 00000100:00100000:3.0:1746144668.345870:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746905984 00000100:00100000:3.0:1746144668.345883:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746906112 00000100:00100000:3.0:1746144668.345884:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746906112 00000100:00100000:1.0:1746144668.345891:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746906240 00000100:00100000:3.0:1746144668.345894:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746906368 00000100:00100000:3.0:1746144668.345896:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746906368 00000100:00100000:1.0:1746144668.345896:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746906240 00000100:00100000:3.0:1746144668.345909:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12367 00000100:00100000:2.0:1746144668.345914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.345917:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746905856:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:2.0:1746144668.345931:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746906496 00000100:00100000:2.0:1746144668.345933:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746906496 00010000:00010000:3.0:1746144668.345936:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.345968:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbf1 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144668.345996:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d9c, atime: 0x68140d9c, ctime: 0x68140d9c, blocks: 0x809 00010000:00010000:3.0:1746144668.346015:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.346017:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.346028:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.346045:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 8 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.346056:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacca00, rc 0) 00000100:00100000:3.0:1746144668.346101:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746905856:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 185us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.346108:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12367 00000100:00100000:1.0:1746144668.346115:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12368 00000100:00100000:1.0:1746144668.346122:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746905984:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:3.0:1746144668.346124:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12369 00000100:00100000:3.0:1746144668.346130:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746906112:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144668.346131:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.346151:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.346161:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbff expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.346161:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fbf8 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144668.346176:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d9b, atime: 0x68140d9b, ctime: 0x68140d9b, blocks: 0x821 00002000:00010000:1.0:1746144668.346176:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d9c, atime: 0x68140d9c, ctime: 0x68140d9b, blocks: 0x81f 00010000:00010000:3.0:1746144668.346184:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.346185:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.346186:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.346186:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.346191:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.346191:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.346200:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.346202:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.346207:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd400, rc 0) 00010000:00010000:1.0:1746144668.346209:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b51d200, rc 0) 00000100:00100000:3.0:1746144668.346222:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746906112:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 93us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.346226:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746905984:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 105us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.346228:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12369 00000100:00100000:1.0:1746144668.346232:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12368 00000100:00100000:3.0:1746144668.346238:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12370 00000100:00100000:1.0:1746144668.346242:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12371 00000100:00100000:3.0:1746144668.346243:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746906368:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:1.0:1746144668.346246:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746906240:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.346248:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144668.346251:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.346255:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc0d expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.346259:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc06 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144668.346265:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4938848, mtime: 0x68140d9c, atime: 0x68140d9c, ctime: 0x68140d9c, blocks: 0x15f1 00002000:00010000:1.0:1746144668.346269:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d9a, atime: 0x68140d98, ctime: 0x68140d9a, blocks: 0x821 00010000:00010000:3.0:1746144668.346272:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.346274:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.346275:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.346276:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.346278:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.346279:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.346287:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144668.346287:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.346293:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd000, rc 0) 00010000:00010000:1.0:1746144668.346293:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b061400, rc 0) 00000100:00100000:1.0:1746144668.346304:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746906240:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 59us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.346309:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746906368:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 66us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.346312:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12371 00000100:00100000:3.0:1746144668.346315:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12370 00000100:00100000:2.0:1746144668.346602:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12372 00000100:00100000:2.0:1746144668.346786:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746906496:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.346794:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.346803:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc14 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144668.346817:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d9c, atime: 0x68140d9c, ctime: 0x68140d9c, blocks: 0x1029 00010000:00010000:2.0:1746144668.346824:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.346826:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.346830:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.346839:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.346846:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009304b000, rc 0) 00000100:00100000:2.0:1746144668.346879:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746906496:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 271us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.346884:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12372 00000100:00100000:0.0:1746144668.355448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.356989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.359202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.361894:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746906880 00000100:00100000:1.0:1746144668.361907:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746906880 00000100:00100000:1.0:1746144668.361986:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746907008 00000100:00100000:1.0:1746144668.361990:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746907008 00000100:00100000:1.0:1746144668.362046:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746907392 00000100:00100000:1.0:1746144668.362048:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746907392 00000100:00100000:1.0:1746144668.362073:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4816 00000100:00100000:1.0:1746144668.362081:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746907008:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144668.362117:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.362131:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.362147:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.362153:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.362166:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.362722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.362748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.362761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.362772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.362800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.362834:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746907648 00000100:00100000:0.0:1746144668.362842:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746907648 00000100:00100000:0.0:1746144668.362883:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746907520 00000100:00100000:0.0:1746144668.362886:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746907520 00000100:00100000:0.0:1746144668.362900:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746907904 00000100:00100000:0.0:1746144668.362901:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746907904 00000100:00100000:3.0:1746144668.362904:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746908160 00000100:00100000:3.0:1746144668.362909:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746908160 00000100:00100000:0.0:1746144668.362915:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746908032 00000100:00100000:0.0:1746144668.362916:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746908032 00000100:00100000:0.0:1746144668.362929:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4817 00000100:00100000:0.0:1746144668.362936:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746907392:12345-192.168.204.23@tcp:3:lfs.0 00000100:00100000:3.0:1746144668.362949:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4818 00000100:00100000:3.0:1746144668.362956:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746907648:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144668.362978:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.362980:0:21596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.362988:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.362989:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.362992:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.362996:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.362998:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.363000:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.363003:0:21596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.363014:0:21596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.363524:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747581440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144668.363569:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.363624:0:13589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581440 00000100:00100000:1.0:1746144668.363627:0:13589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581440 00000100:00100000:1.0:1746144668.363649:0:13589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746144668.363655:0:13589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747581440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746144668.363671:0:13589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 481886208 pending 15335424 free 3853516800 avail 3851419648 00000100:00100000:1.0:1746144668.363704:0:13589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747581440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.363710:0:13589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746144668.363751:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747581440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746144668.364256:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4819 00000100:00100000:3.0:1746144668.364263:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746907520:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144668.364283:0:31508:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.364508:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4820 00000100:00100000:0.0:1746144668.364517:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746907904:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144668.364540:0:31509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.364549:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.364551:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.364554:0:31509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.364564:0:31509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.365686:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4821 00000100:00100000:0.0:1746144668.365693:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746908032:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144668.365710:0:1570:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.365719:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144668.365772:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4822 00000100:00100000:2.0:1746144668.365799:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1960:x1830964746908160:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:2.0:1746144668.365822:0:31506:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.365864:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.365869:0:1570:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.365878:0:1570:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.365880:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.365882:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.365887:0:31506:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.365898:0:31506:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.366280:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.366282:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.366286:0:31508:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.366297:0:31508:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.367936:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4823 00000100:00100000:3.0:1746144668.367973:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746906880:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144668.368007:0:31505:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.368018:0:31505:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.368020:0:31505:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.368023:0:31505:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.368032:0:31505:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.377087:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746144668.377106:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3295:1830964747581568:0@lo:400:kworker.0 00000100:00100000:1.0:1746144668.377189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.377230:0:14707:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581568 00000100:00100000:1.0:1746144668.377240:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144668.377240:0:14707:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581568 00000100:00100000:1.0:1746144668.377266:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.377278:0:14707:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1746144668.377282:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144668.377285:0:14707:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099410c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3295:x1830964747581568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144668.377287:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1830964747581824:0@lo:400:kworker.0 00000100:00100000:1.0:1746144668.377306:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.377347:0:14707:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099410c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3295:x1830964747581568:12345-0@lo:400:kworker.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.377352:0:14707:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00010000:0.0:1746144668.377638:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.377649:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581696 00010000:00010000:0.0:1746144668.377649:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.377655:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581696 00010000:00010000:0.0:1746144668.377656:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.377662:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b51d000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144668.377666:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.377673:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.377686:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.377687:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00010000:00010000:0.0:1746144668.377692:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b51d000/0xa7c849b16e01bb51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.377693:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747581696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144668.377745:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746907008:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 15664us (20762us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144668.377752:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4816 00000100:00100000:0.0:1746144668.377773:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830964747582080:0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.377797:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144668.377803:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581824 00000100:00100000:2.0:1746144668.377808:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581824 00000100:00100000:0.0:1746144668.377816:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746144668.377821:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1830964747581952:0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.377833:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144668.377851:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747582080 00000100:00100000:2.0:1746144668.377853:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747582080 00000100:00100000:2.0:1746144668.377868:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747581952 00000100:00100000:2.0:1746144668.377870:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747581952 00000100:00100000:0.0:1746144668.377900:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3295:1830964747581568:0@lo:400:kworker.0 00000100:00100000:2.0:1746144668.378098:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1746144668.378104:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1746144668.378108:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1830964747581824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.378111:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830964747582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.378161:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830964747582080:12345-0@lo:400:kworker.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.378166:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1746144668.378167:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1830964747581824:12345-0@lo:400:kworker.0 Request processed in 63us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.378173:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1746144668.378178:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1746144668.378182:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830964747581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.378200:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830964747581952:12345-0@lo:400:kworker.0 Request processed in 18us (366us total) trans 0 rc 0/0 00000100:00080000:2.0:1746144668.378201:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144668.378205:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1746144668.378223:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1830964747581952:0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.378230:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830964747582080:0@lo:400:kworker.0 00000100:00100000:0.0:1746144668.378251:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1830964747581824:0@lo:400:kworker.0 00002000:00000024:1.0:1746144668.378279:0:8455:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 537985024 pending 32374784 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746144668.378317:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747581696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 625us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.378323:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1746144668.378954:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747581696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1746144668.385088:0:8457:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.385103:0:8457:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.385111:0:8457:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.385116:0:8457:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacdc00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144668.385120:0:8457:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.385128:0:8457:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.385177:0:8457:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.385184:0:8457:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bb5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.385271:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746907648:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 22311us (22552us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.385281:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4818 00010000:00010000:2.0:1746144668.390126:0:21596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.390202:0:21596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.390210:0:21596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.390217:0:21596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e9e6c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144668.390220:0:21596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.390227:0:21596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.390240:0:21596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.390245:0:21596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9e6c00/0xa7c849b16e01bb58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.390748:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746907392:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 27808us (31550us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144668.390757:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4817 00010000:00010000:1.0:1746144668.393886:0:31509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.393903:0:31509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.393911:0:31509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.393923:0:31509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092458c00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144668.393927:0:31509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.393935:0:31509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.393962:0:31509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.393969:0:31509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092458c00/0xa7c849b16e01bb6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.396196:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746907904:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 31665us (33418us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144668.396208:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4820 00010000:00010000:1.0:1746144668.397313:0:1570:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.397328:0:1570:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.397335:0:1570:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.397342:0:1570:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092459200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144668.397348:0:1570:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.397355:0:1570:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.397374:0:1570:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.397380:0:1570:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01bb74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.397453:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746908032:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 31757us (34654us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144668.397460:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4821 00010000:00010000:3.0:1746144668.404967:0:31508:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.404981:0:31508:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.404987:0:31508:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.404993:0:31508:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacd200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144668.404996:0:31508:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.405002:0:31508:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.405016:0:31508:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.405025:0:31508:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd200/0xa7c849b16e01bb66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.405762:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746907520:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 41496us (43008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.405772:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4819 00010000:00010000:3.0:1746144668.406087:0:31506:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.406094:0:31506:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.406100:0:31506:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.406105:0:31506:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009304a000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144668.406107:0:31506:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.406112:0:31506:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.406122:0:31506:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.406127:0:31506:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009304a000/0xa7c849b16e01bb7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.406195:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746908160:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 40414us (43421us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.406201:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4822 00010000:00010000:3.0:1746144668.408599:0:31505:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.408612:0:31505:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.408619:0:31505:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.408625:0:31505:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dacde00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144668.408628:0:31505:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.408634:0:31505:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.408647:0:31505:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.408652:0:31505:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacde00/0xa7c849b16e01bb82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31505 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.408715:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746906880:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 40744us (53275us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.408724:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4823 00000100:00100000:0.0:1746144668.417669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.417769:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746908544 00000100:00100000:2.0:1746144668.417776:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746908544 00000100:00100000:2.0:1746144668.417832:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10215 00000100:00100000:2.0:1746144668.417840:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746908544:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746144668.417885:0:14708:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.417905:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009304a200/0xa7c849b16e01bb20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbea expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.417932:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.417935:0:14708:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144668.417973:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.417982:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.417989:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00010000:2.0:1746144668.418125:0:14708:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800937a3100 reply state ffff88009f09b000 transno 8589944127 ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:2.0:1746144668.418132:0:14708:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144668.418239:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29441:x1830964746908544:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 399us (576us total) trans 8589944127 rc 0/0 00000100:00100000:2.0:1746144668.418245:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10215 00000100:00100000:0.0:1746144668.419767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.419824:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746908672 00000100:00100000:2.0:1746144668.419830:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746908672 00010000:00010000:1.0:1746144668.419839:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144668.419848:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144668.419853:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144668.419858:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144668.419861:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144668.419867:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144668.419878:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00000100:00100000:2.0:1746144668.419880:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12373 00010000:00010000:1.0:1746144668.419881:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144668.419884:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00000100:00100000:2.0:1746144668.419887:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746908672:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144668.419888:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xa7c849b16e01bb89 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.419901:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.419913:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc1b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.419939:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.419957:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.419959:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.419962:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.419987:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.419997:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.420008:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747582208:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.420078:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.421658:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747582208:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.421685:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.421697:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b000, rc 0) 00000100:00100000:2.0:1746144668.421724:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746908672:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1838us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.421731:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12373 00000100:00100000:0.0:1746144668.422928:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.423008:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746908800 00000100:00100000:2.0:1746144668.423016:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746908800 00010000:00010000:2.0:1746144668.423046:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.423377:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6202 00000100:00100000:2.0:1746144668.423387:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746908800:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.423398:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.423417:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.423428:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.423445:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bb27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf1 expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.423456:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.423458:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.423464:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.423471:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.423495:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.423505:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747582336:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.423579:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.425990:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747582336:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.426013:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.426058:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746908800:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2672us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.426067:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6202 00000100:00100000:0.0:1746144668.426586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.426930:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746908928 00000100:00100000:2.0:1746144668.426936:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746908928 00000100:00100000:2.0:1746144668.426990:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12374 00000100:00100000:2.0:1746144668.426997:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746908928:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.427011:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.427026:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc22 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.427049:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.427056:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.427057:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.427059:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.427081:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.427091:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.427105:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747582464:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.427231:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.428490:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747582464:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.428510:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.428521:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b200, rc 0) 00000100:00100000:2.0:1746144668.428717:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746908928:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1719us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.428723:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12374 00000100:00100000:0.0:1746144668.430450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.430503:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909056 00000100:00100000:2.0:1746144668.430509:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909056 00010000:00010000:2.0:1746144668.430541:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.430574:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6203 00000100:00100000:2.0:1746144668.430581:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746909056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.430592:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.430609:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.430619:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.430642:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b51d200/0xa7c849b16e01bb2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbf8 expref: 9 pid: 30345 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.430652:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.430654:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.430659:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.430667:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.430690:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.430699:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747582592:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.430773:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.434699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.434802:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909184 00000100:00100000:3.0:1746144668.434809:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909184 00000100:00100000:3.0:1746144668.434848:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12375 00000100:00100000:3.0:1746144668.434855:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746909184:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.434873:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144668.434960:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747582592:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.434982:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.435026:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746909056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4446us (4581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.435033:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6203 00010000:00010000:3.0:1746144668.435079:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc29 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.435104:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.435110:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.435112:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.435115:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.435164:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.435174:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144668.435185:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747582720:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.435235:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.437528:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747582720:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.437548:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.437561:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacc400, rc 0) 00000100:00100000:3.0:1746144668.437588:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746909184:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2733us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.437595:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12375 00000100:00100000:2.0:1746144668.438377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.438691:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909312 00000100:00100000:0.0:1746144668.438697:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909312 00010000:00010000:0.0:1746144668.438721:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00000100:00100000:0.0:1746144668.438771:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6204 00000100:00100000:0.0:1746144668.438778:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746909312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.438789:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.438806:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746144668.438816:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746144668.438832:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacd400/0xa7c849b16e01bb35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbff expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:0.0:1746144668.438853:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.438855:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.438860:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.438867:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.438892:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.438902:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747582848:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144668.439510:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099852cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.442065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.442265:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747582848:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.442282:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.442314:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746909312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3536us (3938us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.442324:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6204 00000100:00100000:3.0:1746144668.442717:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909440 00000100:00100000:3.0:1746144668.442723:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909440 00000100:00100000:3.0:1746144668.442761:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12376 00000100:00100000:3.0:1746144668.442767:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746909440:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.442780:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.442792:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc30 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.442813:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.442819:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.442821:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.442823:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.442844:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 9 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.442854:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 9 pid: 30345 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144668.442864:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747582976:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.442907:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.445642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.445947:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747582976:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.445969:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.445983:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacc000, rc 0) 00000100:00100000:2.0:1746144668.446304:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909568 00000100:00100000:2.0:1746144668.446309:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909568 00010000:00010000:2.0:1746144668.446340:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 10 pid: 30345 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.446361:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6205 00000100:00100000:2.0:1746144668.446367:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746909568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.446377:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.446392:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 10 pid: 30345 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.446402:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 10 pid: 30345 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.446420:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b061400/0xa7c849b16e01bb43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc06 expref: 10 pid: 30345 timeout: 747 lvb_type: 1 00010000:00010000:2.0:1746144668.446441:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.446442:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.446447:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.446454:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.446477:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.446487:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747583104:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144668.446624:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746909440:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3856us (4564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.446630:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12376 00000100:00100000:2.0:1746144668.447178:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.450250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.450318:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747583104:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.450346:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.450820:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746909568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4452us (5181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.450829:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6205 00000100:00100000:3.0:1746144668.451177:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909696 00000100:00100000:3.0:1746144668.451182:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909696 00000100:00100000:3.0:1746144668.451216:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12377 00000100:00100000:3.0:1746144668.451223:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746909696:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144668.451236:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.451248:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc37 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.451276:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.451284:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.451285:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.451288:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.451314:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.451323:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144668.451333:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747583232:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.451390:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.453674:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747583232:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.453696:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.453708:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacca00, rc 0) 00000100:00100000:3.0:1746144668.453924:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746909696:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2699us (3677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.453932:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12377 00000100:00100000:0.0:1746144668.454106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.454392:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909824 00000100:00100000:3.0:1746144668.454397:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909824 00010000:00010000:3.0:1746144668.454416:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144668.454435:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6206 00000100:00100000:3.0:1746144668.454441:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746909824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.454450:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.454470:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746144668.454480:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746144668.454499:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacd000/0xa7c849b16e01bb3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc0d expref: 9 pid: 10724 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746144668.454511:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.454513:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.454520:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.454527:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.454553:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.454562:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747583360:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144668.454604:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.457176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.457294:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747583360:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144668.457310:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.457355:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746909824:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2914us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.457366:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6206 00000100:00100000:2.0:1746144668.457370:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746909952 00000100:00100000:2.0:1746144668.457376:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746909952 00000100:00100000:2.0:1746144668.457652:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12378 00000100:00100000:2.0:1746144668.457660:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746909952:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.457675:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.457690:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc3e expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.457711:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.457718:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.457719:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.457722:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.457742:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.457755:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 747 lvb_type: 1 00000100:00100000:2.0:1746144668.457764:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747583488:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.457826:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.459978:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747583488:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.460012:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.460026:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ba00, rc 0) 00000100:00100000:2.0:1746144668.460059:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746909952:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2400us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.460065:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12378 00000100:00100000:0.0:1746144668.462614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.462790:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910080 00000100:00100000:3.0:1746144668.462798:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910080 00010000:00010000:3.0:1746144668.462831:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 747 lvb_type: 1 00000100:00100000:3.0:1746144668.462867:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6207 00000100:00100000:3.0:1746144668.462874:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746910080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.462887:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.462907:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746144668.462916:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746144668.462934:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009304b000/0xa7c849b16e01bb4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc14 expref: 9 pid: 8451 timeout: 747 lvb_type: 1 00010000:00010000:3.0:1746144668.462960:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.462962:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.462968:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.462975:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.463003:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.463018:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747583616:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144668.463093:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.465795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.465828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.465854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.465875:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910336 00000100:00100000:0.0:1746144668.465881:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910336 00000100:00100000:0.0:1746144668.465911:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910592 00000100:00100000:0.0:1746144668.465913:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910592 00000100:00100000:0.0:1746144668.465922:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910848 00000100:00100000:0.0:1746144668.465924:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910848 00000100:00100000:0.0:1746144668.465936:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12379 00000100:00100000:0.0:1746144668.465952:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746910336:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144668.466103:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144668.466106:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466108:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466110:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144667 -> 1746144669 00002000:00010000:0.0:1746144668.466111:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746144668.466172:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746910336:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 230us (384us total) trans 21474840596 rc 0/0 00000100:00100000:0.0:1746144668.466179:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12379 00000100:00100000:0.0:1746144668.466193:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12380 00000100:00100000:0.0:1746144668.466197:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746910592:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144668.466281:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144668.466284:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144666 -> 1746144668 00002000:00010000:0.0:1746144668.466286:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144664 -> 1746144668 00002000:00010000:0.0:1746144668.466287:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144666 -> 1746144669 00002000:00010000:0.0:1746144668.466289:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144668.466305:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746910592:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 107us (476us total) trans 17179873374 rc 0/0 00000100:00100000:0.0:1746144668.466310:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12380 00000100:00100000:0.0:1746144668.466319:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12381 00000100:00100000:0.0:1746144668.466324:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746910848:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144668.466382:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746144668.466384:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466386:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466387:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144668 -> 1746144669 00002000:00010000:0.0:1746144668.466389:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746144668.466404:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746910848:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 80us (549us total) trans 21474840597 rc 0/0 00000100:00100000:0.0:1746144668.466409:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12381 00000100:00100000:0.0:1746144668.466444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.466457:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910208 00000100:00100000:0.0:1746144668.466461:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910208 00000100:00100000:0.0:1746144668.466474:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12382 00000100:00100000:0.0:1746144668.466478:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746910208:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144668.466536:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144668.466538:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466540:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466541:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144668 -> 1746144669 00002000:00010000:0.0:1746144668.466543:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746144668.466559:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746910208:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 79us (114us total) trans 17179873375 rc 0/0 00000100:00100000:0.0:1746144668.466564:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12382 00000100:00100000:0.0:1746144668.466607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.466619:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910464 00000100:00100000:0.0:1746144668.466621:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910464 00000100:00100000:0.0:1746144668.466634:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12383 00000100:00100000:0.0:1746144668.466638:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746910464:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144668.466694:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144668.466696:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144667 -> 1746144668 00002000:00010000:0.0:1746144668.466698:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144667 -> 1746144668 00002000:00010000:0.0:1746144668.466699:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144667 -> 1746144669 00002000:00010000:0.0:1746144668.466701:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144668.466716:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746910464:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 77us (108us total) trans 21474840598 rc 0/0 00000100:00100000:0.0:1746144668.466720:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12383 00000100:00100000:0.0:1746144668.466763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.466775:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746910720 00000100:00100000:0.0:1746144668.466778:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746910720 00000100:00100000:0.0:1746144668.466791:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12384 00000100:00100000:0.0:1746144668.466795:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746910720:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144668.466850:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:0.0:1746144668.466852:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466854:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:0.0:1746144668.466855:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144668 -> 1746144669 00002000:00010000:0.0:1746144668.466857:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:0.0:1746144668.466872:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746910720:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 76us (108us total) trans 17179873376 rc 0/0 00000100:00100000:0.0:1746144668.466877:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12384 00000100:00100000:3.0:1746144668.467240:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7102:1830964747583616:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144668.467254:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.467274:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746910080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4400us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.467281:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6207 00000100:00100000:0.0:1746144668.469272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.469330:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746911104 00000100:00100000:2.0:1746144668.469341:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746911104 00000100:00100000:2.0:1746144668.470317:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4161 00000100:00100000:2.0:1746144668.470329:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29441:x1830964746911104:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:2.0:1746144668.470382:0:16840:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc600/0xa7c849b16e01bad3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbdc expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.470419:0:16840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.470430:0:16840:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.470440:0:16840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.470466:0:16840:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.470476:0:16840:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 9 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.470488:0:16840:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16840:1830964747583744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.471242:0:16840:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.474574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.474762:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746911232 00000100:00100000:3.0:1746144668.474769:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746911232 00010000:00010000:3.0:1746144668.474800:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 10 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.474822:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6208 00000100:00100000:3.0:1746144668.474828:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746911232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.474839:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.474844:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 10 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.474854:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 10 pid: 14710 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.474870:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.474874:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16840 initiator: MDT0 00010000:00010000:3.0:1746144668.474881:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16840 initiator: MDT0 00010000:00010000:3.0:1746144668.474887:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16840 initiator: MDT0 00010000:00010000:3.0:1746144668.474899:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.474952:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746911232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 123us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.474958:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6208 00010000:00010000:2.0:1746144668.475298:0:16840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012daccc00/0xa7c849b16e01bb12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbe3 expref: 9 pid: 14710 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.475321:0:16840:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16840:1830964747583744:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.475344:0:16840:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.475350:0:16840:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.475355:0:16840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16840 initiator: MDT0 00000040:00080000:2.0:1746144668.475853:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2994, 88 off250424 00000004:00080000:2.0:1746144668.475858:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684723064ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.475902:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2905, 88 off242584 00000004:00080000:2.0:1746144668.475905:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684770629ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.475925:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2906, 88 off242672 00000004:00080000:2.0:1746144668.475928:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684793609ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.475934:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2995, 88 off250512 00000004:00080000:2.0:1746144668.475936:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684802047ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.475953:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2996, 88 off250600 00000004:00080000:2.0:1746144668.475955:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684820927ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.475961:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2907, 88 off242760 00000004:00080000:2.0:1746144668.475963:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684828724ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.475968:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2908, 88 off242848 00000004:00080000:2.0:1746144668.475970:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684835706ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.475975:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2909, 88 off242936 00000004:00080000:2.0:1746144668.475977:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684842849ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.475983:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2997, 88 off250688 00000004:00080000:2.0:1746144668.475985:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684850584ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.475990:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2910, 88 off243024 00000004:00080000:2.0:1746144668.475993:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684858091ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.475998:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2998, 88 off250776 00000004:00080000:2.0:1746144668.476001:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684866154ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.476007:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2911, 88 off243112 00000004:00080000:2.0:1746144668.476009:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684874544ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.476015:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2999, 88 off250864 00000004:00080000:2.0:1746144668.476019:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684884219ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.476024:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3000, 88 off250952 00000004:00080000:2.0:1746144668.476027:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684892096ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.476032:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3001, 88 off251040 00000004:00080000:2.0:1746144668.476034:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684899596ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.476040:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3002, 88 off251128 00000004:00080000:2.0:1746144668.476042:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647684907559ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.476047:0:16840:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2912, 88 off243200 00000004:00080000:2.0:1746144668.476049:0:16840:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647684914804ns, next at 593480289301ns, rc = 0 00000001:00080000:1.0:1746144668.499767:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944128 is committed 00000004:00080000:1.0:1746144668.499778:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2097 committed 00000004:00080000:1.0:1746144668.499784:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2183 committed 00000004:00080000:1.0:1746144668.499789:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2182 committed 00000004:00080000:1.0:1746144668.499791:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2181 committed 00000004:00080000:1.0:1746144668.499792:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2180 committed 00000004:00080000:1.0:1746144668.499794:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2096 committed 00000004:00080000:1.0:1746144668.499796:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2179 committed 00000004:00080000:1.0:1746144668.499797:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2095 committed 00000004:00080000:1.0:1746144668.499799:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2178 committed 00000004:00080000:1.0:1746144668.499800:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2094 committed 00000004:00080000:1.0:1746144668.499802:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2093 committed 00000004:00080000:1.0:1746144668.499803:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2092 committed 00000004:00080000:1.0:1746144668.499804:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2177 committed 00000004:00080000:1.0:1746144668.499806:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2176 committed 00000004:00080000:1.0:1746144668.499807:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2091 committed 00000004:00080000:1.0:1746144668.499808:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2090 committed 00000004:00080000:1.0:1746144668.499809:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2175 committed 00000100:00100000:1.0:1746144668.499965:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747583872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500016:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500039:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500054:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500064:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500080:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500092:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500105:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500121:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746144668.500126:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500167:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500179:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500192:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500202:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500223:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500250:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500265:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500276:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500288:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500297:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500310:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500320:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500332:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500341:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746144668.500345:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500365:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500379:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500385:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500397:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500403:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.500414:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.500433:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747583872 00000100:00100000:1.0:1746144668.500438:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747583872 00000100:00100000:1.0:1746144668.500462:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584384 00000100:00100000:1.0:1746144668.500464:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584384 00000100:00100000:1.0:1746144668.500470:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584896 00000100:00100000:1.0:1746144668.500472:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584896 00000100:00100000:1.0:1746144668.500478:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585408 00000100:00100000:1.0:1746144668.500480:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585408 00000100:00100000:1.0:1746144668.500486:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584000 00000100:00100000:1.0:1746144668.500488:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584000 00000100:00100000:1.0:1746144668.500493:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584512 00000100:00100000:1.0:1746144668.500494:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584512 00000100:00100000:1.0:1746144668.500499:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585024 00000100:00100000:1.0:1746144668.500501:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585024 00000100:00100000:1.0:1746144668.500506:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585536 00000100:00100000:1.0:1746144668.500507:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585536 00000100:00100000:1.0:1746144668.500512:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584128 00000100:00100000:1.0:1746144668.500513:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584128 00000100:00100000:1.0:1746144668.500518:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584640 00000100:00100000:1.0:1746144668.500520:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584640 00000100:00100000:1.0:1746144668.500525:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585152 00000100:00100000:1.0:1746144668.500527:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585152 00000100:00100000:1.0:1746144668.500532:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585664 00000100:00100000:1.0:1746144668.500533:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585664 00000100:00100000:1.0:1746144668.500538:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584256 00000100:00100000:1.0:1746144668.500540:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584256 00000100:00100000:1.0:1746144668.500545:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747584768 00000100:00100000:1.0:1746144668.500547:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747584768 00000100:00100000:1.0:1746144668.500552:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585280 00000100:00100000:1.0:1746144668.500553:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585280 00000100:00100000:1.0:1746144668.500560:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585792 00000100:00100000:1.0:1746144668.500562:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585792 00000100:00100000:1.0:1746144668.500571:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12385 00000100:00100000:1.0:1746144668.500577:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747583872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144668.500720:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144668.500723:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.500725:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.500727:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.500729:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746144668.500754:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747583872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (738us total) trans 21474840599 rc 0/0 00000100:00100000:1.0:1746144668.500760:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12385 00000100:00100000:1.0:1746144668.500770:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12386 00000100:00100000:1.0:1746144668.500774:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747584384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.500839:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747584384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (783us total) trans 21474840600 rc 0/0 00000100:00100000:1.0:1746144668.500843:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12386 00000100:00100000:1.0:1746144668.500851:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12387 00000100:00100000:1.0:1746144668.500855:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747584896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144668.500933:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746144668.500936:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.500948:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.500950:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.500952:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746144668.500969:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747584896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (888us total) trans 17179873377 rc 0/0 00000100:00100000:1.0:1746144668.500973:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12387 00000100:00100000:1.0:1746144668.501059:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12388 00000100:00100000:1.0:1746144668.501064:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747585408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.501154:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747585408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1026us total) trans 17179873378 rc 0/0 00000100:00100000:1.0:1746144668.501159:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12388 00000100:00100000:1.0:1746144668.501168:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12389 00000100:00100000:1.0:1746144668.501172:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747584000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144668.501232:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144668.501234:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501236:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501237:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.501239:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144668.501256:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747584000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1088us total) trans 21474840601 rc 0/0 00000100:00100000:1.0:1746144668.501261:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12389 00000100:00100000:1.0:1746144668.501269:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12390 00000100:00100000:1.0:1746144668.501273:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3293:x1830964747584512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.501331:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747584512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1137us total) trans 21474840602 rc 0/0 00000100:00100000:1.0:1746144668.501335:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12390 00000100:00100000:1.0:1746144668.501342:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12391 00000100:00100000:1.0:1746144668.501345:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747585024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144668.501394:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144668.501396:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501397:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501399:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.501400:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144668.501413:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747585024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1199us total) trans 17179873379 rc 0/0 00000100:00100000:1.0:1746144668.501416:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12391 00000100:00100000:1.0:1746144668.501423:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12392 00000100:00100000:1.0:1746144668.501426:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3293:x1830964747585536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.501477:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747585536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1240us total) trans 17179873380 rc 0/0 00000100:00100000:1.0:1746144668.501481:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12392 00000100:00100000:1.0:1746144668.501487:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12393 00000100:00100000:1.0:1746144668.501490:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830964747584128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144668.501537:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144668.501539:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501541:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501543:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.501544:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144668.501560:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747584128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1294us total) trans 21474840603 rc 0/0 00000100:00100000:1.0:1746144668.501563:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12393 00000100:00100000:1.0:1746144668.501570:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12394 00000100:00100000:1.0:1746144668.501573:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830964747584640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.501624:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747584640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (1336us total) trans 21474840604 rc 0/0 00000100:00100000:1.0:1746144668.501628:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12394 00000100:00100000:1.0:1746144668.501635:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12395 00000100:00100000:1.0:1746144668.501638:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747585152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144668.501685:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:1.0:1746144668.501687:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501688:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.501690:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.501692:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:1.0:1746144668.501703:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747585152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1392us total) trans 17179873381 rc 0/0 00000100:00100000:1.0:1746144668.501707:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12395 00000100:00100000:1.0:1746144668.501713:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12396 00000100:00100000:1.0:1746144668.501716:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747585664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.501768:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747585664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (1435us total) trans 17179873382 rc 0/0 00000100:00100000:1.0:1746144668.501773:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12396 00000100:00100000:1.0:1746144668.501781:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12397 00000100:00100000:1.0:1746144668.501784:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830964747584256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144668.501831:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144668.501833:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144668.501835:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144668.501836:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144668.501838:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144668.501852:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747584256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1495us total) trans 21474840605 rc 0/0 00000100:00100000:1.0:1746144668.501856:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12397 00000100:00100000:1.0:1746144668.501863:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12398 00000100:00100000:1.0:1746144668.501866:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830964747584768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.501917:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747584768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (1537us total) trans 21474840606 rc 0/0 00000100:00100000:1.0:1746144668.501921:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12398 00000100:00100000:1.0:1746144668.501928:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12399 00000100:00100000:1.0:1746144668.501931:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747585280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.501998:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747585280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1599us total) trans 17179873383 rc 0/0 00000100:00100000:1.0:1746144668.502002:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12399 00000100:00100000:1.0:1746144668.502009:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12400 00000100:00100000:1.0:1746144668.502012:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830964747585792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.502062:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747585792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (1647us total) trans 17179873384 rc 0/0 00000100:00100000:1.0:1746144668.502066:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12400 00000004:00080000:1.0:1746144668.502198:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4a80/2, rc 0, transno 21474840605 00000100:00100000:1.0:1746144668.502202:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584256:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502207:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f398380/2, rc 0, transno 21474840606 00000100:00100000:1.0:1746144668.502209:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502214:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12ca80/2, rc 0, transno 17179873383 00000100:00100000:1.0:1746144668.502219:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.502225:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b573b80/2, rc 0, transno 17179873384 00000100:00100000:1.0:1746144668.502227:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.502231:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f7100/2, rc 0, transno 21474840603 00000100:00100000:1.0:1746144668.502233:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584128:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502237:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f6a00/2, rc 0, transno 21474840604 00000100:00100000:1.0:1746144668.502240:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747584640:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502244:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12c380/2, rc 0, transno 17179873381 00000100:00100000:1.0:1746144668.502246:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.502250:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12c000/2, rc 0, transno 17179873382 00000100:00100000:1.0:1746144668.502252:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747585664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.502280:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.502294:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746144668.502308:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f7480/2, rc 0, transno 21474840601 00000100:00100000:1.0:1746144668.502311:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502315:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4000/2, rc 0, transno 21474840602 00000100:00100000:1.0:1746144668.502317:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584512:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502322:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f399500/2, rc 0, transno 17179873379 00000100:00100000:1.0:1746144668.502323:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585024:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.502327:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12f800/2, rc 0, transno 17179873380 00000100:00100000:1.0:1746144668.502329:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.502334:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f4e00/2, rc 0, transno 21474840599 00000100:00100000:1.0:1746144668.502336:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747583872:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502341:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f5880/2, rc 0, transno 21474840600 00000100:00100000:1.0:1746144668.502343:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144668.502347:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f39b800/2, rc 0, transno 17179873377 00000100:00100000:1.0:1746144668.502349:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747584896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.502354:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12f480/2, rc 0, transno 17179873378 00000100:00100000:1.0:1746144668.502356:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.502365:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747585920 00000100:00100000:1.0:1746144668.502367:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747585920 00000100:00100000:1.0:1746144668.502379:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12401 00000100:00100000:1.0:1746144668.502382:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747585920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.502441:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3293:x1830964747585920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (145us total) trans 17179873385 rc 0/0 00000100:00100000:1.0:1746144668.502445:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12401 00000004:00080000:1.0:1746144668.502458:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287bb80/2, rc 0, transno 17179873385 00000100:00100000:1.0:1746144668.502460:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747585920:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746144668.502535:0:16840:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a51ec700 reply state ffff880099efbc00 transno 8589944128 ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16840 initiator: MDT0 00000100:00100000:2.0:1746144668.502544:0:16840:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746144668.502550:0:16840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.502552:0:16840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144668.502559:0:16840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacc600/0xa7c849b16e01bad3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fbdc expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746144668.502618:0:16840:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746144668.502625:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29441:x1830964746911104:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 32302us (33360us total) trans 8589944128 rc 0/0 00000100:00100000:2.0:1746144668.502631:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4161 00010000:00010000:2.0:1746144668.502726:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.502732:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.502737:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.502742:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.502744:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.502749:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.502763:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.502765:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144668.502767:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16840 initiator: MDT0 00010000:00010000:2.0:1746144668.502771:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xa7c849b16e01bbba lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16840 initiator: MDT0 00000100:00100000:0.0:1746144668.511240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.512128:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746911360 00000100:00100000:2.0:1746144668.512408:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746911360 00000100:00100000:2.0:1746144668.512449:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10216 00000100:00100000:2.0:1746144668.512457:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29441:x1830964746911360:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144668.512475:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.512489:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc45 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.512536:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 7 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.512547:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 7 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.512562:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.512564:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144668.512567:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a2e7c00, rc 0) 00000100:00100000:2.0:1746144668.512604:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29441:x1830964746911360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 148us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.512609:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10216 00000100:00100000:0.0:1746144668.519520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.519714:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746911616 00000100:00100000:2.0:1746144668.519721:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746911616 00000100:00100000:2.0:1746144668.519770:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4162 00000100:00100000:2.0:1746144668.519778:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29441:x1830964746911616:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746144668.520018:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29441:x1830964746911616:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 240us (502us total) trans 8589944129 rc 0/0 00000100:00100000:2.0:1746144668.520024:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4162 00000100:00100000:0.0:1746144668.550439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.550492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.550521:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746911872 00000100:00100000:2.0:1746144668.550529:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746911872 00000100:00100000:2.0:1746144668.550579:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746912128 00000100:00100000:2.0:1746144668.550581:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746912128 00000100:00100000:2.0:1746144668.550601:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10217 00000100:00100000:2.0:1746144668.550609:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:29449:x1830964746911872:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144668.550630:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.550645:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e01bbc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc4c expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.550734:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550745:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550754:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550764:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550769:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550773:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550858:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01bbdd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550865:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01bbdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550870:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01bbdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:2.0:1746144668.550878:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144668.550957:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550964:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550969:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550973:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29ae00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.550976:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550982:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.550990:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144668.550992:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144668.550996:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551003:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01bbcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551016:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551020:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551024:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551027:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.551029:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551033:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551038:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ee48e00) 00010000:00010000:2.0:1746144668.551039:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144668.551041:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:2.0:1746144668.551044:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bbd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00000100:00100000:0.0:1746144668.551065:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10218 00010000:00010000:2.0:1746144668.551071:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b400/0xa7c849b16e01bbc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc4c expref: 299 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.551071:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+6:29451:x1830964746912128:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.551080:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01bbdd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc4c expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.551082:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.551088:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bbeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc53 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.551090:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.551091:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144668.551093:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29aa00, rc 0) 00010000:00010000:0.0:1746144668.551123:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551129:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551157:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144668.551162:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29449:x1830964746911872:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 553us (729us total) trans 8589944130 rc 0/0 00010000:00010000:0.0:1746144668.551165:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00000100:00100000:2.0:1746144668.551168:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10217 00010000:00010000:0.0:1746144668.551170:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551174:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551213:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551223:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551228:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144668.551233:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:0.0:1746144668.551263:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551268:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551272:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551276:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.551278:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551282:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551288:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144668.551290:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144668.551292:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551295:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bbf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551307:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551311:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551315:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551318:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.551320:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551324:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551327:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041300) 00010000:00010000:0.0:1746144668.551329:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144668.551330:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551334:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bbf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.551353:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bbeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 9 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.551360:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 8 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.551365:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.551366:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144668.551368:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19da00, rc 0) 00000100:00100000:0.0:1746144668.551382:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29451:x1830964746912128:12345-192.168.204.23@tcp:101:cat.0 Request processed in 313us (890us total) trans 8589944131 rc 0/0 00000100:00100000:0.0:1746144668.551387:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10218 00000100:00100000:1.0:1746144668.554758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.554799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.554859:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746912384 00000100:00100000:3.0:1746144668.554866:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746912384 00000100:00100000:0.0:1746144668.554872:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746912640 00000100:00100000:0.0:1746144668.554876:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746912640 00000100:00100000:0.0:1746144668.554901:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10219 00000100:00100000:0.0:1746144668.554907:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29450:x1830964746912640:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144668.554923:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.554950:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bc0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc61 expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.554987:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10220 00000100:00100000:3.0:1746144668.554993:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29449:x1830964746912384:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144668.555000:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.555002:0:14708:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746144668.555017:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01bbdd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc4c expref: 300 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.555036:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.555038:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.555042:0:14708:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144668.555047:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bc1c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc5a expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.555047:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555054:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555066:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.555069:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144668.555071:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555075:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.555077:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 7 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.555082:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.555088:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.555108:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 7 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.555117:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 7 pid: 15388 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.555126:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747586048:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.555177:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555335:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555341:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000004:00200000:0.0:1746144668.555349:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144668.555375:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 7 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.555381:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 7 pid: 14708 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.555388:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747586176:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.555402:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00010000:00010000:0.0:1746144668.555422:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555428:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555433:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.555438:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.555441:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557303:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557322:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.557324:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746144668.557328:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557332:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d800/0xa7c849b16e01bc31 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557349:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557353:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557357:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557361:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.557363:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557366:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557371:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144668.557372:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144668.557375:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557378:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d400/0xa7c849b16e01bc15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557383:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557388:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557391:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557395:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19c400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.557396:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557400:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557404:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009bb63200) 00010000:00010000:0.0:1746144668.557405:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144668.557407:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557410:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c400/0xa7c849b16e01bc23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557446:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bc0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc61 expref: 301 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.557452:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d600/0xa7c849b16e01bc0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc61 expref: 301 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.557458:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19d600, rc 0) 00000100:00100000:3.0:1746144668.557465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.557487:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29450:x1830964746912640:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2580us (2688us total) trans 8589944132 rc 301/301 00000100:00100000:0.0:1746144668.557497:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10219 00000100:00100000:0.0:1746144668.557512:0:15388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746913280 00000100:00100000:0.0:1746144668.557516:0:15388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746913280 00000100:00100000:3.0:1746144668.557529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.557535:0:15388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10221 00000100:00100000:0.0:1746144668.557540:0:15388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29448:x1830964746913280:12345-192.168.204.23@tcp:101:multiop.0 00000100:00100000:3.0:1746144668.557544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144668.557553:0:15388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.557561:0:15388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01bc3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc6f expref: -99 pid: 15388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.557572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.557589:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746912768 00000100:00100000:3.0:1746144668.557591:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746912768 00010000:00010000:3.0:1746144668.557605:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 10 pid: 15388 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.557623:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746912896 00000100:00100000:3.0:1746144668.557625:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746912896 00010000:00010000:0.0:1746144668.557625:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557633:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 8 pid: 14708 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.557634:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557640:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144668.557644:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6209 00010000:00010000:0.0:1746144668.557648:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144668.557649:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746912768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.557652:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557656:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.557657:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557660:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 10 pid: 15388 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.557667:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 10 pid: 15388 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.557678:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.557681:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.557687:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.557690:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.557706:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746912768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.557711:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6209 00010000:00010000:0.0:1746144668.557720:0:15388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144668.557721:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6210 00000100:00100000:3.0:1746144668.557725:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746912896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.557726:0:15388:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557731:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.557731:0:15388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557734:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 8 pid: 14708 timeout: 747 lvb_type: 0 00000004:00200000:0.0:1746144668.557737:0:15388:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144668.557740:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 8 pid: 14708 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.557749:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.557752:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.557757:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.557761:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.557771:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144668.557781:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144668.557783:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746912896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 58us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144668.557786:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144668.557787:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6210 00010000:00010000:0.0:1746144668.557790:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557794:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19de00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.557795:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557799:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557804:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.557806:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746144668.557808:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557811:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19de00/0xa7c849b16e01bc54 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557818:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557822:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557829:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557833:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19dc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144668.557834:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557838:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557842:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00000100:00100000:3.0:1746144668.557843:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746913024 00010000:00010000:0.0:1746144668.557843:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746144668.557845:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746913024 00010000:00010000:0.0:1746144668.557845:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557848:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19dc00/0xa7c849b16e01bc46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557853:0:15388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557856:0:15388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15388 initiator: MDT0 00000100:00100000:3.0:1746144668.557860:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10222 00010000:00010000:0.0:1746144668.557860:0:15388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557863:0:15388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19cc00 already unused, calling callback (ffffffffa1376690) 00000100:00100000:3.0:1746144668.557864:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+11:29451:x1830964746913024:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144668.557864:0:15388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557868:0:15388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557871:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.557875:0:15388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041d00) 00010000:00010000:0.0:1746144668.557877:0:15388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144668.557878:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc68 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.557878:0:15388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:0.0:1746144668.557882:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19cc00/0xa7c849b16e01bc4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15388 initiator: MDT0 00010000:00010000:3.0:1746144668.557896:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144668.557897:0:15388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01bc3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc6f expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.557902:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 12 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.557903:0:15388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ca00/0xa7c849b16e01bc3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc6f expref: 12 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.557908:0:15388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19ca00, rc 0) 00010000:00010000:3.0:1746144668.557910:0:22257:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.557918:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 11 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.557925:0:15388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16261e74-be72-4bb6-b857-d78345d984f7+11:29448:x1830964746913280:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 385us (461us total) trans 8589944133 rc 301/301 00010000:00010000:3.0:1746144668.557926:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.557928:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746144668.557930:0:15388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10221 00010000:00010000:3.0:1746144668.557931:0:22257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 11 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.557936:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9e6600, rc 0) 00000100:00100000:3.0:1746144668.557964:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:29451:x1830964746913024:12345-192.168.204.23@tcp:101:cat.0 Request processed in 100us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.557969:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10222 00010000:00010000:2.0:1746144668.558061:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01bc00 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc53 expref: 9 pid: 15388 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.558073:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747586048:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.558082:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a2e7c00/0xa7c849b16e01bbc1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc45 expref: 7 pid: 14708 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.558089:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747586176:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.558103:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.558109:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.558113:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00000004:02000000:2.0:1746144668.558162:0:14708:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:2.0:1746144668.558620:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3003, 88 off251216 00000004:00080000:2.0:1746144668.558625:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767489974ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558674:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2913, 88 off243288 00000004:00080000:2.0:1746144668.558679:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767544274ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558690:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2914, 88 off243376 00000004:00080000:2.0:1746144668.558692:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767557789ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558699:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3004, 88 off251304 00000004:00080000:2.0:1746144668.558701:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767566544ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558706:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3005, 88 off251392 00000004:00080000:2.0:1746144668.558709:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767574359ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558719:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2915, 88 off243464 00000004:00080000:2.0:1746144668.558722:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767588064ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558728:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2916, 88 off243552 00000004:00080000:2.0:1746144668.558730:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767595931ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558882:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2917, 88 off243640 00000004:00080000:2.0:1746144668.558886:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767751164ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558894:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3006, 88 off251480 00000004:00080000:2.0:1746144668.558897:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767762147ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558903:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2918, 88 off243728 00000004:00080000:2.0:1746144668.558905:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767770799ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558911:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3007, 88 off251568 00000004:00080000:2.0:1746144668.558913:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767778569ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558918:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2919, 88 off243816 00000004:00080000:2.0:1746144668.558920:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647767785827ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144668.558925:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3008, 88 off251656 00000004:00080000:2.0:1746144668.558927:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767792874ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558933:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3009, 88 off251744 00000004:00080000:2.0:1746144668.558935:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767800776ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558950:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3010, 88 off251832 00000004:00080000:2.0:1746144668.558953:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767818326ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.558959:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3011, 88 off251920 00000004:00080000:2.0:1746144668.558961:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647767826857ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144668.559174:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2920, 88 off243904 00000004:00080000:2.0:1746144668.559179:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647768044531ns, next at 593480289301ns, rc = 0 00000100:00100000:1.0:1746144668.559929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.560016:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746913536 00000100:00100000:0.0:1746144668.560022:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746913536 00000100:00100000:0.0:1746144668.560062:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4163 00000100:00100000:0.0:1746144668.560068:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29450:x1830964746913536:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144668.560194:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29450:x1830964746913536:12345-192.168.204.23@tcp:35:cat.0 Request processed in 126us (268us total) trans 8589944135 rc 0/0 00000100:00100000:0.0:1746144668.560201:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4163 00000100:00100000:1.0:1746144668.570701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.571466:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746913664 00000100:00100000:0.0:1746144668.571474:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746913664 00000100:00100000:0.0:1746144668.571509:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10223 00000100:00100000:0.0:1746144668.571520:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29450:x1830964746913664:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144668.571535:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.571724:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bc69 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc76 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.571834:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.571844:0:14710:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.571851:0:14710:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000001:00080000:1.0:1746144668.579664:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944135 is committed 00000001:00080000:1.0:1746144668.579674:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944133 is committed 00000004:00080000:1.0:1746144668.579682:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2105 committed 00000004:00080000:1.0:1746144668.579687:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2192 committed 00000004:00080000:1.0:1746144668.579692:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2191 committed 00000004:00080000:1.0:1746144668.579693:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2190 committed 00000004:00080000:1.0:1746144668.579695:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2189 committed 00000004:00080000:1.0:1746144668.579697:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2104 committed 00000004:00080000:1.0:1746144668.579698:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2188 committed 00000004:00080000:1.0:1746144668.579699:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2103 committed 00000004:00080000:1.0:1746144668.579700:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2187 committed 00000004:00080000:1.0:1746144668.579701:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2102 committed 00000004:00080000:1.0:1746144668.579702:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2101 committed 00000004:00080000:1.0:1746144668.579704:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2100 committed 00000004:00080000:1.0:1746144668.579705:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2186 committed 00000004:00080000:1.0:1746144668.579706:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2185 committed 00000004:00080000:1.0:1746144668.579707:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2099 committed 00000004:00080000:1.0:1746144668.579708:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2098 committed 00000004:00080000:1.0:1746144668.579710:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2184 committed 00000001:00080000:1.0:1746144668.579714:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944129 is committed 00000100:00100000:3.0:1746144668.579764:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747586304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144668.579810:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144668.579834:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747586816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144668.579845:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144668.579853:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746144668.579856:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747586688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144668.579866:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144668.579882:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747586304 00000100:00100000:3.0:1746144668.579887:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747586304 00000100:00100000:3.0:1746144668.579911:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747586816 00000100:00100000:3.0:1746144668.579913:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747586816 00000100:00100000:3.0:1746144668.579920:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747586688 00000100:00100000:3.0:1746144668.579921:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747586688 00000100:00100000:3.0:1746144668.579930:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12402 00000100:00100000:3.0:1746144668.579936:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747586304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144668.580078:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144668.580081:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144668.580083:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144668.580084:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144668.580086:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746144668.580112:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3294:x1830964747586304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (301us total) trans 21474840607 rc 0/0 00000100:00100000:3.0:1746144668.580117:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12402 00000100:00100000:3.0:1746144668.580129:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12403 00000100:00100000:3.0:1746144668.580153:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747586816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144668.580214:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144668.580216:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144668.580218:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144668.580219:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144668.580221:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144668.580237:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3294:x1830964747586816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (391us total) trans 21474840608 rc 0/0 00000100:00100000:3.0:1746144668.580242:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12403 00000100:00100000:3.0:1746144668.580250:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12404 00000100:00100000:3.0:1746144668.580254:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747586688:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746144668.580430:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 300 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.580440:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.580443:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746144668.580446:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.580453:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.580457:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144668.580463:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 6 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.580472:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 6 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.580477:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 6 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.580495:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 6 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.580503:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747587072:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.580557:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.580675:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747586560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.580696:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.580706:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747587200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.580716:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.580724:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144668.580728:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747586432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144668.580739:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144668.580745:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747586944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.580755:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746144668.580769:0:14710:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.580775:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:0.0:1746144668.580805:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:0.0:1746144668.580808:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144668.580819:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:0.0:1746144668.580840:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bc69 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.580852:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 300 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.580858:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.580860:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144668.580862:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19c200, rc 0) 00000100:00100000:0.0:1746144668.580880:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29450:x1830964746913664:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9365us (10185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.580885:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10223 00000100:00100000:2.0:1746144668.581024:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747586560 00000100:00100000:2.0:1746144668.581028:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747586560 00000100:00100000:2.0:1746144668.581049:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587200 00000100:00100000:2.0:1746144668.581051:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587200 00000100:00100000:2.0:1746144668.581059:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747586432 00000100:00100000:2.0:1746144668.581060:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747586432 00000100:00100000:2.0:1746144668.581068:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747586944 00000100:00100000:2.0:1746144668.581069:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747586944 00000100:00100000:2.0:1746144668.581078:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12405 00000100:00100000:2.0:1746144668.581082:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3296:x1830964747586560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144668.581092:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12406 00000100:00100000:2.0:1746144668.581095:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3296:x1830964747587200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144668.581103:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12407 00000100:00100000:2.0:1746144668.581106:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3296:x1830964747586432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144668.581211:0:29370:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746144668.581214:0:29370:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:2.0:1746144668.581215:0:29370:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:2.0:1746144668.581217:0:29370:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144668.581219:0:29370:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1746144668.581237:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3296:x1830964747586432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (497us total) trans 17179873386 rc 0/0 00000100:00100000:2.0:1746144668.581242:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12407 00000100:00100000:2.0:1746144668.581250:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12408 00000100:00100000:2.0:1746144668.581255:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3296:x1830964747586944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.581540:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.581560:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581570:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581579:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581586:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747588352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581595:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581612:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746144668.581615:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.581630:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581639:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581652:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581666:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747587584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581678:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581684:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747588096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581695:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581701:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746144668.581704:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747587712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581716:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581721:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747588224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581731:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.581747:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587328 00000100:00100000:1.0:1746144668.581750:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587328 00000100:00100000:1.0:1746144668.581761:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587840 00000100:00100000:1.0:1746144668.581763:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587840 00000100:00100000:1.0:1746144668.581768:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747588352 00000100:00100000:1.0:1746144668.581769:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747588352 00000100:00100000:1.0:1746144668.581774:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587456 00000100:00100000:1.0:1746144668.581775:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587456 00000100:00100000:1.0:1746144668.581781:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587968 00000100:00100000:1.0:1746144668.581782:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587968 00000100:00100000:1.0:1746144668.581786:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587584 00000100:00100000:1.0:1746144668.581788:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587584 00000100:00100000:1.0:1746144668.581794:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747588096 00000100:00100000:1.0:1746144668.581795:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747588096 00000100:00100000:1.0:1746144668.581801:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747587712 00000100:00100000:1.0:1746144668.581802:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747587712 00000100:00100000:1.0:1746144668.581807:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747588224 00000100:00100000:1.0:1746144668.581808:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747588224 00000100:00100000:1.0:1746144668.581815:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12409 00000100:00100000:1.0:1746144668.581819:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747587328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.581831:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12410 00000100:00100000:1.0:1746144668.581834:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747587840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.581924:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747587840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (342us total) trans 17179873387 rc 0/0 00000100:00100000:1.0:1746144668.581929:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12410 00000100:00100000:1.0:1746144668.581952:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12411 00000100:00100000:1.0:1746144668.581956:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747588352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582023:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747588352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (426us total) trans 17179873388 rc 0/0 00000100:00100000:1.0:1746144668.582027:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12411 00000100:00100000:1.0:1746144668.582035:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12412 00000100:00100000:1.0:1746144668.582038:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747587456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144668.582050:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12413 00000100:00100000:1.0:1746144668.582053:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1830964747587968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582123:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747587968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (471us total) trans 17179873389 rc 0/0 00000100:00100000:1.0:1746144668.582127:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12413 00000100:00100000:1.0:1746144668.582153:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12414 00000100:00100000:1.0:1746144668.582157:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3295:x1830964747587584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144668.582221:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144668.582224:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.582226:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.582228:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.582229:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144668.582249:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747587584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (570us total) trans 17179873390 rc 0/0 00000100:00100000:1.0:1746144668.582254:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12414 00000100:00100000:1.0:1746144668.582262:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12415 00000100:00100000:1.0:1746144668.582267:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3295:x1830964747588096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582335:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747588096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (638us total) trans 17179873391 rc 0/0 00000100:00100000:1.0:1746144668.582340:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12415 00000100:00100000:1.0:1746144668.582349:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12416 00000100:00100000:1.0:1746144668.582353:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3295:x1830964747587712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144668.582411:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:1.0:1746144668.582414:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.582415:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144668.582417:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144668.582418:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:1.0:1746144668.582435:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747587712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (718us total) trans 17179873392 rc 0/0 00000100:00100000:1.0:1746144668.582440:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12416 00000100:00100000:1.0:1746144668.582450:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12417 00000100:00100000:1.0:1746144668.582453:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3295:x1830964747588224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582520:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3295:x1830964747588224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (786us total) trans 17179873393 rc 0/0 00000100:00100000:1.0:1746144668.582525:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12417 00000004:00080000:1.0:1746144668.582552:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f39a300/2, rc 0, transno 17179873392 00000100:00100000:1.0:1746144668.582559:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747587712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.582566:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093761880/2, rc 0, transno 17179873393 00000100:00100000:1.0:1746144668.582569:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747588224:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.582576:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092879880/2, rc 0, transno 17179873390 00000100:00100000:1.0:1746144668.582579:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747587584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.582585:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093761500/2, rc 0, transno 17179873391 00000100:00100000:1.0:1746144668.582587:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747588096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.582600:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093762300/2, rc 0, transno 17179873389 00000100:00100000:1.0:1746144668.582602:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.582608:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f399f80/2, rc 0, transno 17179873387 00000100:00100000:1.0:1746144668.582610:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144668.582616:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093763b80/2, rc 0, transno 17179873388 00000100:00100000:1.0:1746144668.582618:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747588352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582646:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144668.582651:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747588480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582669:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144668.582684:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747588480 00000100:00100000:1.0:1746144668.582687:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747588480 00000100:00100000:1.0:1746144668.582699:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12418 00000100:00100000:1.0:1746144668.582703:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830964747588480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144668.582777:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830964747588480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (106us total) trans 17179873394 rc 0/0 00000100:00100000:1.0:1746144668.582782:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12418 00000004:00080000:1.0:1746144668.582798:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd96d80/2, rc 0, transno 17179873394 00000100:00100000:1.0:1746144668.582801:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747588480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144668.582924:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ef100/2, rc 0, transno 21474840608 00000100:00100000:3.0:1746144668.582928:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747586816:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144668.582936:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ec700/2, rc 0, transno 21474840607 00000100:00100000:3.0:1746144668.582951:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747586304:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144668.582990:0:10724:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746144668.582992:0:10724:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144668.582994:0:10724:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144668.582995:0:10724:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144668.582997:0:10724:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746144668.583020:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3294:x1830964747586688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2766us (3153us total) trans 21474840609 rc 0/0 00000100:00100000:3.0:1746144668.583026:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12404 00000004:00080000:3.0:1746144668.583047:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eed80/2, rc 0, transno 21474840609 00000100:00100000:3.0:1746144668.583050:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747586688:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144668.583154:0:3010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144668.583157:0:3010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144668.583158:0:3010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144668.583160:0:3010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144668.583162:0:3010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746144668.583182:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+29:3296:x1830964747586560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2099us (2485us total) trans 21474840610 rc 0/0 00000100:00100000:3.0:1746144668.583187:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12405 00000100:00100000:3.0:1746144668.583276:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3296:x1830964747587200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2179us (2558us total) trans 21474840611 rc 0/0 00000100:00100000:3.0:1746144668.583281:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12406 00000100:00100000:3.0:1746144668.583462:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3296:x1830964747586944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2206us (2704us total) trans 21474840612 rc 0/0 00000100:00100000:3.0:1746144668.583466:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12408 00000100:00100000:3.0:1746144668.583553:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747587328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1732us (1991us total) trans 21474840613 rc 0/0 00000100:00100000:3.0:1746144668.583557:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12409 00000100:00100000:3.0:1746144668.583635:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3293:x1830964747587456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1595us (2003us total) trans 21474840614 rc 0/0 00000100:00100000:3.0:1746144668.583640:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12412 00000004:00080000:3.0:1746144668.583660:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51edf80/2, rc 0, transno 21474840614 00000100:00100000:3.0:1746144668.583663:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144668.583670:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eca80/2, rc 0, transno 21474840613 00000100:00100000:3.0:1746144668.583673:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747587328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144668.584348:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009287aa00/2, rc 0, transno 17179873386 00000100:00100000:0.0:1746144668.584353:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009287aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747586432:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144668.584360:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51eea00/2, rc 0, transno 21474840612 00000100:00100000:0.0:1746144668.584363:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747586944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144668.584369:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ed500/2, rc 0, transno 21474840610 00000100:00100000:0.0:1746144668.584371:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747586560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746144668.584376:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ef480/2, rc 0, transno 21474840611 00000100:00100000:0.0:1746144668.584378:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747587200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144668.585205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.585230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.585248:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746913920 00000100:00100000:0.0:1746144668.585253:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746913920 00000100:00100000:0.0:1746144668.585280:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10224 00000100:00100000:0.0:1746144668.585285:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+7:29448:x1830964746913920:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144668.585301:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.585316:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e01bc77 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc7d expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.585361:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e01bc77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc7d expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.585372:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e01bc77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc7d expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.585388:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144668.585391:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144668.585393:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d35200, rc 0) 00000100:00100000:0.0:1746144668.585419:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29448:x1830964746913920:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 134us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.585424:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10224 00000100:00100000:2.0:1746144668.585544:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747587072:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.585574:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacdc00/0xa7c849b16e01bc1c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 299 pid: 14708 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746144668.585584:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 298 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.585595:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dacd600, rc 0) 00000100:00100000:2.0:1746144668.585614:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29449:x1830964746912384:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 30622us (30863us total) trans 8589944134 rc 0/0 00000100:00100000:2.0:1746144668.585619:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10220 00000100:00100000:3.0:1746144668.585867:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746913792 00000100:00100000:3.0:1746144668.585871:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746913792 00000100:00100000:3.0:1746144668.585901:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4164 00000100:00100000:3.0:1746144668.585906:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29451:x1830964746913792:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:3.0:1746144668.585973:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+8:29451:x1830964746913792:12345-192.168.204.23@tcp:49:cat.0 Request processed in 66us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.585978:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4164 00000100:00100000:0.0:1746144668.587437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.587590:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914048 00000100:00100000:2.0:1746144668.587595:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914048 00000100:00100000:2.0:1746144668.587628:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10225 00000100:00100000:2.0:1746144668.587634:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29450:x1830964746914048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.587646:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.587657:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bc7e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc84 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.587693:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bc7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc84 expref: 299 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.587703:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bc7e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc84 expref: 299 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.587716:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.587718:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144668.587721:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ee00, rc 0) 00000100:00100000:2.0:1746144668.588275:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29450:x1830964746914048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 639us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.588282:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10225 00000100:00100000:0.0:1746144668.588814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.589017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.589338:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914176 00000100:00100000:2.0:1746144668.589343:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914176 00000100:00100000:2.0:1746144668.589381:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 653 00000100:00100000:2.0:1746144668.589387:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746914176:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.589399:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.589413:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d35200/0xa7c849b16e01bc77 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc7d expref: 8 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.589426:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.589430:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.589584:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914304 00000100:00100000:3.0:1746144668.589587:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914304 00000100:00100000:3.0:1746144668.589609:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12419 00000100:00100000:3.0:1746144668.589613:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:29449:x1830964746914304:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144668.589624:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.589634:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc8b expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.589653:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 10 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.589660:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.589661:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.589664:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 22 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.589689:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 10 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.589698:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.589708:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747588608:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.589784:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+7:1961:x1830964746914176:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 397us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.589790:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 653 00000100:00100000:3.0:1746144668.590187:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.590731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.590816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.591006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.591120:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914432 00000100:00100000:2.0:1746144668.591125:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914432 00000100:00100000:2.0:1746144668.591167:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914560 00000100:00100000:2.0:1746144668.591169:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914560 00000100:00100000:2.0:1746144668.591184:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12420 00000100:00100000:2.0:1746144668.591189:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:29451:x1830964746914432:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.591198:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.591210:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc92 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.591227:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 10 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.591237:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.591238:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.591241:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.591259:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 10 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.591266:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.591273:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747588736:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.591359:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12421 00000100:00100000:3.0:1746144668.591366:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+16:29448:x1830964746914560:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144668.591374:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.591381:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fc99 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.591392:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.591393:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.591396:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2666495] (req 2379776->2666495) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 17 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.591409:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2666495] (req 2379776->2666495) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 17 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.591416:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec92c00, rc 0) 00000100:00100000:2.0:1746144668.591647:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.591661:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915200 00000100:00100000:2.0:1746144668.591664:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915200 00000100:00100000:2.0:1746144668.591687:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 654 00000100:00100000:2.0:1746144668.591693:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1963:x1830964746915200:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.591700:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.591715:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bc7e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc84 expref: 299 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.591727:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.591730:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.591890:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:29448:x1830964746914560:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 524us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.591896:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12421 00000100:00100000:2.0:1746144668.592426:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1963:x1830964746915200:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 732us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.592432:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 654 00000100:00100000:1.0:1746144668.592733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.593050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.593425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.593584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.593832:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914688 00000100:00100000:0.0:1746144668.593839:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914688 00000100:00100000:0.0:1746144668.593866:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914944 00000100:00100000:0.0:1746144668.593868:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914944 00000100:00100000:0.0:1746144668.593878:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915328 00000100:00100000:0.0:1746144668.593880:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915328 00000100:00100000:0.0:1746144668.593892:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12422 00000100:00100000:0.0:1746144668.593897:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+39:1960:x1830964746914688:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144668.593909:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.593921:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c19d000/0xa7c849b16e01bc9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fca0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.593970:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747588864:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144668.594020:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.595065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.595091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.595117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.595286:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746914816 00000100:00100000:3.0:1746144668.595291:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746914816 00000100:00100000:3.0:1746144668.595321:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915072 00000100:00100000:3.0:1746144668.595323:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915072 00000100:00100000:3.0:1746144668.595334:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915456 00000100:00100000:3.0:1746144668.595335:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915456 00000100:00100000:3.0:1746144668.595345:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12423 00000100:00100000:3.0:1746144668.595350:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746914944:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.595360:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.595371:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec93a00/0xa7c849b16e01bca1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcae expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.595400:0:8453:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747588992:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.595435:0:8453:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.595447:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12424 00000100:00100000:3.0:1746144668.595452:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b76a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1960:x1830964746915328:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.595459:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.595466:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f176c00/0xa7c849b16e01bca8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcbc expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.595487:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747589120:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.595504:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.595517:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12425 00000100:00100000:3.0:1746144668.595522:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746914816:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.595527:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.595533:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f177a00/0xa7c849b16e01bcaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fca7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.595554:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747589248:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.595571:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.595583:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12426 00000100:00100000:3.0:1746144668.595588:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746915072:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.595593:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.595599:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01bcb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcb5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.595615:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747589376:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.595628:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.595640:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12427 00000100:00100000:3.0:1746144668.595644:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746915456:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.595649:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.595655:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01bcbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcc3 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.595676:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747589504:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.595692:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.595734:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747588608:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.595752:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.595761:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5bb200, rc 0) 00000100:00100000:3.0:1746144668.595777:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29449:x1830964746914304:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6164us (6761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.595783:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12419 00000100:00100000:2.0:1746144668.596314:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915584 00000100:00100000:2.0:1746144668.596319:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915584 00010000:00010000:2.0:1746144668.596343:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.596361:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6211 00000100:00100000:2.0:1746144668.596368:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746915584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.596376:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.596394:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.596404:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.596420:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.596422:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.596427:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.596435:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.596443:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.596444:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.596448:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 16 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.596455:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 16 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.596473:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 16 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.596481:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747589632:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.596514:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.596521:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747589760:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.596537:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.597235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.597372:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915712 00000100:00100000:0.0:1746144668.597376:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915712 00010000:00010000:0.0:1746144668.597389:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.597405:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6212 00000100:00100000:0.0:1746144668.597409:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746915712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144668.597415:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.597428:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.597435:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.597446:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.597448:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.597452:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.597458:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.597473:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.597480:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747589888:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144668.597627:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747588736:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.597644:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 24 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.597651:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96fc00, rc 0) 00000100:00100000:0.0:1746144668.598230:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746144668.598251:0:30345:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff8800920ac700 x1830964747588864) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.598267:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f29b000/0xa7c849b16e01bb90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc1b expref: 11 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.598544:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+24:29451:x1830964746914432:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7353us (7813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.598550:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12420 00000100:00100000:0.0:1746144668.599059:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747588864:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144668.599081:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c19d000/0xa7c849b16e01bc9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fca0 expref: 43 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.599089:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c19d000/0xa7c849b16e01bc9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fca0 expref: 43 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.599095:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19d000, rc 0) 00000100:00100000:1.0:1746144668.599163:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746914688:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5265us (6430us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144668.599168:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12422 00010000:00010000:3.0:1746144668.599326:0:8453:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 11 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.599341:0:8453:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8453:1830964747588992:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.599354:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec93a00/0xa7c849b16e01bca1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcae expref: 27 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599362:0:8453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec93a00/0xa7c849b16e01bca1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcae expref: 27 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599368:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec93a00, rc 0) 00000100:00100000:3.0:1746144668.599383:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746914944:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4034us (6334us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144668.599387:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12423 00000100:00100000:2.0:1746144668.599632:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747589632:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.599639:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747589760:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144668.599655:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.599668:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746915584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3302us (4551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.599675:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6211 00010000:00010000:3.0:1746144668.599774:0:8450:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 10 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.599787:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747589376:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.599802:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01bcb6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcb5 expref: 41 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599809:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782c00/0xa7c849b16e01bcb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcb5 expref: 41 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599815:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782c00, rc 0) 00000100:00100000:3.0:1746144668.599841:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1960:x1830964746915072:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4253us (4778us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144668.599845:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12426 00010000:00010000:3.0:1746144668.599865:0:29370:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from glimpse AST (req@ffff88009fb47100 x1830964747589504) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.599886:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01bbb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc3e expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.599893:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747589504:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.599902:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01bcbd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcc3 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599909:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135783000/0xa7c849b16e01bcbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcc3 expref: 25 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599913:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783000, rc 0) 00000100:00100000:3.0:1746144668.599924:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746915456:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4280us (4833us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144668.599928:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12427 00010000:00010000:3.0:1746144668.599956:0:8388:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 10 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.599967:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747589120:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.599977:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f176c00/0xa7c849b16e01bca8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcbc expref: 39 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599983:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f176c00/0xa7c849b16e01bca8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcbc expref: 39 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.599993:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f176c00, rc 0) 00000100:00100000:3.0:1746144668.600006:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b76a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:1960:x1830964746915328:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4555us (6582us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144668.600011:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12424 00010000:00010000:0.0:1746144668.600446:0:4758:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.600465:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747589248:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144668.600478:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f177a00/0xa7c849b16e01bcaf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fca7 expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.600486:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f177a00/0xa7c849b16e01bcaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fca7 expref: 23 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.600493:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177a00, rc 0) 00000100:00100000:0.0:1746144668.600524:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746914816:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5001us (6939us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144668.600529:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12425 00000100:00100000:1.0:1746144668.600593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.600687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.600951:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800920ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747589888:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144668.600961:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144668.600979:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746915712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3569us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.600985:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6212 00000100:00100000:3.0:1746144668.601121:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746915968 00000100:00100000:3.0:1746144668.601126:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746915968 00002000:00100000:3.0:1746144668.601180:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (4136960->4141055) req@ffff88012b5f4380 x1830964746915968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.601188:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4380 with x1830964746915968 ext(4136960->4141055) 00002000:00010000:3.0:1746144668.601192:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f4380 00000100:00100000:3.0:1746144668.601415:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746916224 00000100:00100000:3.0:1746144668.601418:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746916224 00002000:00100000:3.0:1746144668.601429:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2379776->2383871) req@ffff88012b570000 x1830964746916224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.601436:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570000 with x1830964746916224 ext(2379776->2383871) 00002000:00010000:3.0:1746144668.601439:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b570000 00000100:00100000:3.0:1746144668.601618:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4824 00000100:00100000:3.0:1746144668.601624:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746915968:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144668.601728:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746915968:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 104us (1135us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.601733:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4824 00002000:00100000:3.0:1746144668.601738:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (4136960->4141055) req@ffff88012b5f4380 x1830964746915968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.601749:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b5f4380 with x1830964746915968 ext(4136960->4141055) 00002000:00010000:3.0:1746144668.601752:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b5f4380 00000100:00100000:3.0:1746144668.601761:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4825 00000100:00100000:3.0:1746144668.601765:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746916224:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.601808:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746916224:12345-192.168.204.23@tcp:3:cat.0 Request processed in 42us (1121us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.601813:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4825 00002000:00100000:3.0:1746144668.601817:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2379776->2383871) req@ffff88012b570000 x1830964746916224/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.601823:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570000 with x1830964746916224 ext(2379776->2383871) 00002000:00010000:3.0:1746144668.601826:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b570000 00000100:00100000:0.0:1746144668.606245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.607216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.607431:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746916608 00000100:00100000:1.0:1746144668.607441:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746916608 00002000:00100000:1.0:1746144668.607489:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920ac700 x1830964746916608/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.607500:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac700 with x1830964746916608 ext(0->1048575) 00002000:00010000:1.0:1746144668.607507:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ac700 00000100:00100000:1.0:1746144668.607539:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4826 00000100:00100000:1.0:1746144668.607547:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746916608:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144668.607977:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746916352 00000100:00100000:2.0:1746144668.607982:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746916352 00000100:00100000:2.0:1746144668.608031:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12428 00000100:00100000:2.0:1746144668.608037:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+38:29449:x1830964746916352:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144668.608047:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.608071:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcca expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.608097:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.608105:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.608107:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.608110:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4206591] (req 4194304->4206591) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 39 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.608158:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.608169:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.608181:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747590016:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.608265:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.608617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.608866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.608913:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746916992 00000100:00100000:3.0:1746144668.608922:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746916992 00002000:00100000:3.0:1746144668.608970:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2662400->2666495) req@ffff8800920ae300 x1830964746916992/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.608979:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ae300 with x1830964746916992 ext(2662400->2666495) 00002000:00010000:3.0:1746144668.608984:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ae300 00000100:00100000:3.0:1746144668.609003:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4827 00000100:00100000:3.0:1746144668.609010:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746916992:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.609166:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+17:1963:x1830964746916992:12345-192.168.204.23@tcp:3:cat.0 Request processed in 156us (300us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.609172:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4827 00002000:00100000:3.0:1746144668.609178:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2662400->2666495) req@ffff8800920ae300 x1830964746916992/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.609184:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ae300 with x1830964746916992 ext(2662400->2666495) 00002000:00010000:3.0:1746144668.609187:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920ae300 00000100:00100000:2.0:1746144668.609500:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746916736 00000100:00100000:2.0:1746144668.609505:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746916736 00000100:00100000:2.0:1746144668.609535:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12429 00000100:00100000:2.0:1746144668.609541:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29450:x1830964746916736:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.609550:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.609561:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcd1 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.609575:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.609577:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.609583:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 41 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.609600:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 41 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.609610:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921c7800, rc 0) 00000100:00100000:2.0:1746144668.609637:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29450:x1830964746916736:12345-192.168.204.23@tcp:101:cat.0 Request processed in 97us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.609643:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12429 00000100:00100000:2.0:1746144668.614478:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747590016:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.614521:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4194304->4206591] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.614539:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c222c00, rc 0) 00000100:00100000:2.0:1746144668.614593:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29449:x1830964746916352:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6556us (8358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.614601:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12428 00000100:00100000:0.0:1746144668.616669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.616712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.616752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.616798:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746917504 00000100:00100000:1.0:1746144668.616809:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746917632 00000100:00100000:3.0:1746144668.616810:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746917504 00000100:00100000:1.0:1746144668.616816:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746917632 00010000:00010000:1.0:1746144668.616848:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00002000:00100000:3.0:1746144668.616856:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920adf80 x1830964746917504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746144668.616862:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746917376 00002000:00100000:3.0:1746144668.616867:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920adf80 with x1830964746917504 ext(0->1048575) 00000100:00100000:2.0:1746144668.616867:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746917376 00002000:00010000:3.0:1746144668.616872:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920adf80 00000100:00100000:1.0:1746144668.616879:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6213 00000100:00100000:1.0:1746144668.616886:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746917632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.616901:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144668.616902:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4828 00000100:00100000:2.0:1746144668.616908:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4165 00000100:00100000:3.0:1746144668.616910:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746917504:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144668.616914:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+7:29448:x1830964746917376:12345-192.168.204.23@tcp:35:multiop.0 00010000:00010000:1.0:1746144668.616926:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.616946:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.616968:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacca00/0xa7c849b16e01bbac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc37 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.617203:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:29448:x1830964746917376:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 288us (542us total) trans 8589944136 rc 0/0 00000100:00100000:2.0:1746144668.617210:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4165 00010000:00010000:1.0:1746144668.617532:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.617535:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.617543:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.617553:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.617626:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.617640:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747590144:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.617703:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ff240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.618831:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746916608:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11283us (11615us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144668.618840:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4826 00002000:00100000:1.0:1746144668.618849:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920ac700 x1830964746916608/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.618864:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ac700 with x1830964746916608 ext(0->1048575) 00002000:00010000:1.0:1746144668.618869:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ac700 00000100:00100000:1.0:1746144668.623904:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747590144:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.623934:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.624124:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746917632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7235us (7369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.624157:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6213 00000100:00100000:0.0:1746144668.624202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.624518:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746917888 00000100:00100000:3.0:1746144668.624526:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746917888 00002000:00100000:3.0:1746144668.624561:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4202496->4206591) req@ffff8800920ad500 x1830964746917888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.625185:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad500 with x1830964746917888 ext(4202496->4206591) 00002000:00010000:3.0:1746144668.625190:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ad500 00000100:00100000:3.0:1746144668.625216:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4829 00000100:00100000:3.0:1746144668.625224:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746917888:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.625360:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746917888:12345-192.168.204.23@tcp:3:cat.0 Request processed in 138us (1225us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.625366:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4829 00002000:00100000:3.0:1746144668.625371:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (4202496->4206591) req@ffff8800920ad500 x1830964746917888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.625379:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920ad500 with x1830964746917888 ext(4202496->4206591) 00002000:00010000:3.0:1746144668.625382:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920ad500 00000100:00100000:3.0:1746144668.629016:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:1961:x1830964746917504:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12098us (12295us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.629027:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4828 00002000:00100000:3.0:1746144668.629036:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800920adf80 x1830964746917504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.629044:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920adf80 with x1830964746917504 ext(0->1048575) 00002000:00010000:3.0:1746144668.629053:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800920adf80 00000100:00100000:2.0:1746144668.630620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.630683:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746918144 00000100:00100000:3.0:1746144668.630692:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746918144 00000100:00100000:3.0:1746144668.630732:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4166 00000100:00100000:3.0:1746144668.630738:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29449:x1830964746918144:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144668.631544:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29449:x1830964746918144:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 803us (931us total) trans 8589944137 rc 0/0 00000100:00100000:3.0:1746144668.631551:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4166 00000100:00100000:0.0:1746144668.635037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.635225:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746918272 00000100:00100000:2.0:1746144668.635236:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746918272 00000100:00100000:2.0:1746144668.635301:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12430 00000100:00100000:2.0:1746144668.635310:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+17:29451:x1830964746918272:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.635330:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.635350:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcd8 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.635381:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.635388:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.635390:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.635394:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.635424:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 9 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.635435:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.635448:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747590272:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.635537:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.639056:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.640103:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746918400 00000100:00100000:3.0:1746144668.640112:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746918400 00000100:00100000:3.0:1746144668.640536:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12431 00000100:00100000:3.0:1746144668.640545:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:29450:x1830964746918400:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.640569:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.640591:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcdf expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.640633:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.640639:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.640651:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 23 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.640662:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f400, rc 0) 00000100:00100000:3.0:1746144668.641130:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29450:x1830964746918400:12345-192.168.204.23@tcp:101:cat.0 Request processed in 585us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.641386:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12431 00000100:00100000:1.0:1746144668.641650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.641653:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747590272:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144668.641678:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746918528 00000100:00100000:1.0:1746144668.641685:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746918528 00010000:00010000:2.0:1746144668.641690:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 18 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.641705:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1ba000, rc 0) 00010000:00010000:1.0:1746144668.641714:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.641727:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+18:29451:x1830964746918272:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6419us (6701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.641732:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12430 00000100:00100000:1.0:1746144668.641747:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6214 00000100:00100000:1.0:1746144668.641754:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746918528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.641766:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.641785:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.641796:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.641816:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f29b200/0xa7c849b16e01bb97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc22 expref: 10 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.641843:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.641845:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.641851:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.641858:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.641866:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.641867:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.641870:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.641877:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.641901:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 22 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.641911:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590400:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.641985:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 17 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.641992:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590528:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.642013:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.648646:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590400:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.648657:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590528:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.648678:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.650694:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746918528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 8931us (9042us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.650706:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6214 00000100:00100000:0.0:1746144668.651611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.651668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.651692:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746918912 00000100:00100000:3.0:1746144668.651702:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746918912 00002000:00100000:3.0:1746144668.651749:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920aca80 x1830964746918912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144668.651757:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746919040 00002000:00100000:3.0:1746144668.651759:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aca80 with x1830964746918912 ext(1048576->2097151) 00000100:00100000:1.0:1746144668.651762:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746919040 00002000:00010000:3.0:1746144668.651764:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920aca80 00002000:00100000:1.0:1746144668.651781:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ce86300 x1830964746919040/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.651789:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86300 with x1830964746919040 ext(1048576->2097151) 00002000:00010000:1.0:1746144668.651793:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce86300 00000100:00100000:3.0:1746144668.652114:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4830 00000100:00100000:3.0:1746144668.652120:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746918912:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144668.652341:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4831 00000100:00100000:1.0:1746144668.652348:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746919040:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.662812:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746918912:12345-192.168.204.23@tcp:3:cat.0 Request processed in 10679us (11196us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.662825:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4830 00002000:00100000:3.0:1746144668.662837:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800920aca80 x1830964746918912/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.662852:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800920aca80 with x1830964746918912 ext(1048576->2097151) 00002000:00010000:3.0:1746144668.662858:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800920aca80 00000100:00100000:1.0:1746144668.666349:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+18:1962:x1830964746919040:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13989us (14668us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144668.666362:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4831 00002000:00100000:1.0:1746144668.666374:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88012ce86300 x1830964746919040/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.666383:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce86300 with x1830964746919040 ext(1048576->2097151) 00002000:00010000:1.0:1746144668.666388:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce86300 00000100:00100000:0.0:1746144668.666826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.667035:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746919168 00000100:00100000:2.0:1746144668.667044:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746919168 00000100:00100000:2.0:1746144668.667110:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12432 00000100:00100000:2.0:1746144668.667119:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:29450:x1830964746919168:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.667299:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.667320:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fce6 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.667352:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.667360:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.667361:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.667365:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.667394:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.667405:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 8 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.667423:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747590656:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.667651:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.671827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.671946:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746919296 00000100:00100000:3.0:1746144668.671956:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746919296 00000100:00100000:3.0:1746144668.672014:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12433 00000100:00100000:3.0:1746144668.672023:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+18:29451:x1830964746919296:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.672046:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.672067:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fced expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.672096:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.672102:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.672114:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 19 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.672124:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f000, rc 0) 00000100:00100000:3.0:1746144668.672200:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+19:29451:x1830964746919296:12345-192.168.204.23@tcp:101:cat.0 Request processed in 178us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.672206:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12433 00000100:00100000:0.0:1746144668.673553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.673645:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747590656:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.673683:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.673701:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1bb600, rc 0) 00000100:00100000:3.0:1746144668.673729:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29450:x1830964746919168:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6612us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.673735:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12432 00000100:00100000:1.0:1746144668.673792:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746919424 00000100:00100000:1.0:1746144668.673797:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746919424 00010000:00010000:1.0:1746144668.673820:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.673844:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6215 00000100:00100000:1.0:1746144668.673850:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746919424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.673861:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.673883:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.673893:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.673914:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dacc400/0xa7c849b16e01bb9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc29 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.673928:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.673930:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.673946:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.673955:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.673963:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.673964:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.673968:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.673974:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.674005:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 18 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.674018:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590784:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.674067:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 23 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.674074:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590912:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.674087:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.676389:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590912:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.678933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.679204:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746919680 00000100:00100000:0.0:1746144668.679214:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746919680 00002000:00100000:0.0:1746144668.679266:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb0ea00 x1830964746919680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.679281:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0ea00 with x1830964746919680 ext(1048576->2097151) 00002000:00010000:0.0:1746144668.679287:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0ea00 00000100:00100000:0.0:1746144668.679321:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4832 00000100:00100000:0.0:1746144668.679329:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746919680:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144668.679341:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747590784:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.679372:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.679419:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746919424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5569us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.679427:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6215 00000100:00100000:2.0:1746144668.680351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.681445:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746919936 00000100:00100000:3.0:1746144668.681454:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746919936 00002000:00100000:3.0:1746144668.681492:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb0d880 x1830964746919936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.681501:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0d880 with x1830964746919936 ext(1048576->2097151) 00002000:00010000:3.0:1746144668.681505:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0d880 00000100:00100000:3.0:1746144668.682056:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4833 00000100:00100000:3.0:1746144668.682066:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746919936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144668.691739:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746919680:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12397us (12803us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144668.691753:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4832 00002000:00100000:2.0:1746144668.691767:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb0ea00 x1830964746919680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.691777:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0ea00 with x1830964746919680 ext(1048576->2097151) 00002000:00010000:2.0:1746144668.691782:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0ea00 00000100:00100000:3.0:1746144668.696117:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+19:1960:x1830964746919936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 14040us (15755us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.696130:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4833 00002000:00100000:3.0:1746144668.696170:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009fb0d880 x1830964746919936/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.696179:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0d880 with x1830964746919936 ext(1048576->2097151) 00002000:00010000:3.0:1746144668.696184:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb0d880 00000100:00100000:0.0:1746144668.697684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.697759:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746920064 00000100:00100000:3.0:1746144668.697768:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746920064 00000100:00100000:3.0:1746144668.697826:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12434 00000100:00100000:3.0:1746144668.697833:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+40:29450:x1830964746920064:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.697850:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.697867:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcf4 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.697896:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.697904:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.697906:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144668.697909:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 41 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.697952:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 8 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.698094:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 8 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.698105:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747591040:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.698216:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.701712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.701756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.702071:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747591040:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.702100:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 41 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.702118:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96e800, rc 0) 00000100:00100000:3.0:1746144668.702192:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:29450:x1830964746920064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4358us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.702201:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12434 00000100:00100000:3.0:1746144668.702229:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746920320 00000100:00100000:3.0:1746144668.702235:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746920320 00000100:00100000:3.0:1746144668.702268:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12435 00000100:00100000:3.0:1746144668.702275:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+24:29451:x1830964746920320:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.702290:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.702305:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fcfb expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.702321:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746920192 00010000:00010000:3.0:1746144668.702324:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746144668.702326:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746920192 00010000:00010000:3.0:1746144668.702328:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.702337:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.702344:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ec00, rc 0) 00010000:00010000:1.0:1746144668.702345:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:3.0:1746144668.702357:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+25:29451:x1830964746920320:12345-192.168.204.23@tcp:101:cat.0 Request processed in 83us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.702363:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12435 00000100:00100000:1.0:1746144668.702372:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6216 00000100:00100000:1.0:1746144668.703201:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746920192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.703213:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.703237:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.703248:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.703266:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dacc000/0xa7c849b16e01bba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc30 expref: 9 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.703289:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.703290:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.703296:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.703304:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.703311:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.703311:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.703314:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.703320:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.703344:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.703353:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747591168:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.703431:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 40 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.703438:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747591296:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.703458:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.706709:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747591168:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.706719:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747591296:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.706742:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.706786:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1963:x1830964746920192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4406us (5083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.706794:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6216 00000100:00100000:2.0:1746144668.711533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.711586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.711887:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746920576 00000100:00100000:3.0:1746144668.711898:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746920576 00002000:00100000:3.0:1746144668.711957:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fb0d500 x1830964746920576/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.711968:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0d500 with x1830964746920576 ext(1048576->2097151) 00002000:00010000:3.0:1746144668.711974:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0d500 00000100:00100000:3.0:1746144668.712348:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746920832 00000100:00100000:3.0:1746144668.712351:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746920832 00002000:00100000:3.0:1746144668.712365:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fb0f480 x1830964746920832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.712373:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0f480 with x1830964746920832 ext(1048576->2097151) 00002000:00010000:3.0:1746144668.712376:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0f480 00000100:00100000:0.0:1746144668.712412:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4834 00000100:00100000:0.0:1746144668.712421:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746920576:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.720108:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4835 00000100:00100000:3.0:1746144668.720126:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1960:x1830964746920832:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:1.0:1746144668.727806:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144668.729168:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746920576:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16739us (17636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144668.729179:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4834 00002000:00100000:2.0:1746144668.729190:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fb0d500 x1830964746920576/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.729200:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0d500 with x1830964746920576 ext(1048576->2097151) 00002000:00010000:2.0:1746144668.729206:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0d500 00000100:00100000:3.0:1746144668.731298:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1960:x1830964746920832:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11170us (19702us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.731310:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4835 00002000:00100000:3.0:1746144668.731318:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009fb0f480 x1830964746920832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.731327:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0f480 with x1830964746920832 ext(1048576->2097151) 00002000:00010000:3.0:1746144668.731331:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0f480 00000100:00100000:0.0:1746144668.739256:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.739310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.739395:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746920960 00000100:00100000:2.0:1746144668.739405:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746920960 00000100:00100000:2.0:1746144668.739462:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746921088 00000100:00100000:2.0:1746144668.739465:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746921088 00000100:00100000:2.0:1746144668.739483:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12436 00000100:00100000:2.0:1746144668.739492:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746920960:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.739512:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.739530:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090efe600/0xa7c849b16e01bcfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd02 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.739585:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747591424:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144668.739688:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12437 00000100:00100000:0.0:1746144668.739699:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746921088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144668.739707:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.739719:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135782200/0xa7c849b16e01bd03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd09 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.739756:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747591552:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144668.740226:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.740896:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00002000:00010000:2.0:1746144668.742179:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144668 -> 1746144669 00002000:00010000:2.0:1746144668.742183:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144668 -> 1746144669 00000100:00100000:2.0:1746144668.742203:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747591424:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144668.742237:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090efe600/0xa7c849b16e01bcfc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd02 expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.742250:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090efe600/0xa7c849b16e01bcfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd02 expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.742264:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090efe600, rc 0) 00000100:00100000:2.0:1746144668.742306:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746920960:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2815us (3061us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144668.742313:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12436 00002000:00010000:3.0:1746144668.742377:0:29370:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime: 1746144668 -> 1746144669 00002000:00010000:3.0:1746144668.742380:0:29370:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime: 1746144668 -> 1746144669 00000100:00100000:3.0:1746144668.742392:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747591552:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.742416:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135782200/0xa7c849b16e01bd03 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd09 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.742424:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135782200/0xa7c849b16e01bd03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd09 expref: 20 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.742439:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782200, rc 0) 00000100:00100000:3.0:1746144668.742454:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+19:1962:x1830964746921088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2760us (3144us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144668.742458:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12437 00000100:00100000:0.0:1746144668.746862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.747263:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746921344 00000100:00100000:3.0:1746144668.747272:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746921344 00002000:00100000:3.0:1746144668.747321:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce84380 x1830964746921344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.747331:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84380 with x1830964746921344 ext(2097152->3145727) 00002000:00010000:3.0:1746144668.747336:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84380 00000100:00100000:3.0:1746144668.747479:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4836 00000100:00100000:3.0:1746144668.747487:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+41:1962:x1830964746921344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144668.748269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.748303:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746921472 00000100:00100000:2.0:1746144668.748308:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746921472 00000100:00100000:2.0:1746144668.748349:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12438 00000100:00100000:2.0:1746144668.748356:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+25:29451:x1830964746921472:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.748371:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.748389:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd10 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.748416:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 41 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.748424:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.748427:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144668.748430:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.748459:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 41 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.748471:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 41 pid: 4758 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.748483:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747591680:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.748569:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.749466:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29370:1830964747591680:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.749498:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.749510:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090eff000, rc 0) 00000100:00100000:2.0:1746144668.749607:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:16261e74-be72-4bb6-b857-d78345d984f7+26:29451:x1830964746921472:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1250us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.749615:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12438 00000100:00100000:0.0:1746144668.749819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.749920:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746921600 00000100:00100000:2.0:1746144668.749924:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746921600 00002000:00100000:2.0:1746144668.749964:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4206591) req@ffff88012ce85500 x1830964746921600/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 12776/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.749974:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85500 with x1830964746921600 ext(4194304->4206591) 00010000:00010000:2.0:1746144668.749980:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 42 pid: 4758 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.750012:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 42 pid: 4758 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746144668.750018:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ce85500 00000100:00100000:2.0:1746144668.750203:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 967 00000100:00100000:2.0:1746144668.750212:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746921600:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144668.751891:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746921600:12345-192.168.204.23@tcp:4:cat.0 Request processed in 1675us (2067us total) trans 17179873395 rc 0/0 00000100:00100000:2.0:1746144668.751901:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 967 00002000:00100000:2.0:1746144668.751909:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4206591) req@ffff88012ce85500 x1830964746921600/t17179873395(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 12776/448 e 0 to 0 dl 1746144679 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.751917:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85500 with x1830964746921600 ext(4194304->4206591) 00010000:00010000:2.0:1746144668.751924:0:1570:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 45 pid: 4758 timeout: 747 lvb_type: 0 00010000:00010000:2.0:1746144668.751952:0:1570:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 45 pid: 4758 timeout: 747 lvb_type: 0 00002000:00010000:2.0:1746144668.751959:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ce85500 00000100:00100000:0.0:1746144668.755745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.755852:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746921856 00000100:00100000:2.0:1746144668.755862:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746921856 00000100:00100000:2.0:1746144668.755916:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10226 00000100:00100000:2.0:1746144668.755924:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:29456:x1830964746921856:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144668.755960:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.755978:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff400/0xa7c849b16e01bd11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd17 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.756100:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756112:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756123:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756161:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756167:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756172:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756284:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756292:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756298:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:2.0:1746144668.756306:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144668.756383:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756389:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756395:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756399:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090efee00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.756402:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756407:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756416:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144668.756424:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144668.756427:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756431:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090efee00/0xa7c849b16e01bd18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756463:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756468:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756472:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756475:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090efe400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.756477:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756481:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756487:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ee48500) 00010000:00010000:2.0:1746144668.756489:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144668.756491:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756495:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe400/0xa7c849b16e01bd1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.756529:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff400/0xa7c849b16e01bd11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.756540:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.756546:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.756548:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144668.756551:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090effa00, rc 0) 00000100:00100000:2.0:1746144668.756596:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+10:29456:x1830964746921856:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 674us (862us total) trans 8589944138 rc 0/0 00000100:00100000:2.0:1746144668.756602:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10226 00000100:00100000:0.0:1746144668.758589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.758797:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746922112 00000100:00100000:2.0:1746144668.758806:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746922112 00000100:00100000:2.0:1746144668.758856:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10227 00000100:00100000:2.0:1746144668.758862:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29458:x1830964746922112:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144668.758883:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.758899:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe200/0xa7c849b16e01bd34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd1e expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.759007:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759020:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759030:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759042:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759046:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759051:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759178:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759188:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.759193:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144668.759201:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144668.759276:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760419:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760426:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760431:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090effe00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.760435:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760441:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760452:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144668.760455:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144668.760458:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760463:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090effe00/0xa7c849b16e01bd3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760476:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760485:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760489:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760493:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090efec00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144668.760495:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760500:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760505:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ee48d00) 00010000:00010000:2.0:1746144668.760507:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144668.760509:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760514:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090efec00/0xa7c849b16e01bd42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144668.760562:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090efe200/0xa7c849b16e01bd34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 302 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.760574:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.760579:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.760581:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144668.760583:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090eff800, rc 0) 00000100:00100000:2.0:1746144668.760644:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29458:x1830964746922112:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1780us (2062us total) trans 8589944139 rc 0/0 00000100:00100000:2.0:1746144668.760652:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10227 00000100:00100000:3.0:1746144668.760989:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746921344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13502us (14140us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.760998:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4836 00002000:00100000:3.0:1746144668.761006:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce84380 x1830964746921344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.761015:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84380 with x1830964746921344 ext(2097152->3145727) 00010000:00010000:3.0:1746144668.761022:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 43 pid: 4758 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.761034:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 43 pid: 4758 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746144668.761045:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ce84380 00000100:00100000:0.0:1746144668.772207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.772297:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746922240 00000100:00100000:1.0:1746144668.772307:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746922240 00010000:00010000:1.0:1746144668.772347:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 43 pid: 4758 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.772378:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6217 00000100:00100000:1.0:1746144668.772385:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746922240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.772400:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.772422:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 43 pid: 4758 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.772436:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 43 pid: 4758 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.772464:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c222c00/0xa7c849b16e01bcc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4206591) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcca expref: 43 pid: 4758 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.773114:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.773117:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.773126:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.773158:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.773448:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.773463:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747591808:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.773603:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ff780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.774352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.774731:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746922368 00000100:00100000:2.0:1746144668.774738:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746922368 00000100:00100000:2.0:1746144668.774799:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12439 00000100:00100000:2.0:1746144668.774806:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:29450:x1830964746922368:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.774823:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.774839:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd25 expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.774861:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.774869:0:29370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.774874:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144668.774876:0:29370:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144668.774878:0:29370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 5/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.774900:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 25 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.774911:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 25 pid: 4760 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.774919:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747591936:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.774998:0:29370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.775006:0:29370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 18 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:2.0:1746144668.775013:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747592064:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.775030:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.777180:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747591808:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.777203:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.777243:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746922240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4858us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.777253:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6217 00000100:00100000:0.0:1746144668.779561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.779644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.779822:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746922624 00000100:00100000:3.0:1746144668.779831:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746922624 00002000:00100000:3.0:1746144668.779876:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce84a80 x1830964746922624/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.779885:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84a80 with x1830964746922624 ext(2097152->3145727) 00002000:00010000:3.0:1746144668.779890:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84a80 00000100:00100000:3.0:1746144668.779905:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746922752 00000100:00100000:3.0:1746144668.779907:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746922752 00002000:00100000:3.0:1746144668.779916:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (4136960->4194303) req@ffff88009ee01880 x1830964746922752/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.779922:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01880 with x1830964746922752 ext(4136960->4194303) 00010000:00010000:3.0:1746144668.779929:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 26 pid: 4760 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.779952:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 26 pid: 4760 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746144668.779965:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee01880 00000100:00100000:3.0:1746144668.779986:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 968 00000100:00100000:3.0:1746144668.779992:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746922752:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144668.780184:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4837 00000100:00100000:3.0:1746144668.780190:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746922624:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144668.780577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.780594:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746922880 00000100:00100000:0.0:1746144668.780597:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746922880 00002000:00100000:0.0:1746144668.780618:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2379776->2666495) req@ffff88009ee01c00 x1830964746922880/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.780626:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01c00 with x1830964746922880 ext(2379776->2666495) 00010000:00010000:0.0:1746144668.780632:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.780640:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 19 pid: 8388 timeout: 747 lvb_type: 0 00002000:00010000:0.0:1746144668.780646:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee01c00 00000100:00100000:0.0:1746144668.780658:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 969 00000100:00100000:0.0:1746144668.780664:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+19:1963:x1830964746922880:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144668.780878:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747591936:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.780888:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747592064:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.780930:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 27 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.780954:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090eff200, rc 0) 00000100:00100000:0.0:1746144668.780961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.780979:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923008 00000100:00100000:2.0:1746144668.780980:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29450:x1830964746922368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6175us (6630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.780988:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12439 00000100:00100000:0.0:1746144668.781484:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923008 00000100:00100000:0.0:1746144668.781515:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12440 00000100:00100000:0.0:1746144668.781520:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29458:x1830964746923008:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144668.781530:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.781552:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd2c expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.781571:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 26 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.781580:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.781586:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.781588:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144668.781591:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [102400->397311] (req 102400->397311) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 43 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.781615:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.781624:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.781639:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747592192:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.781702:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.781710:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 27 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.781717:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ee00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747592320:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.781729:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.784398:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746922752:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4392us (4740us total) trans 21474840615 rc 0/0 00000100:00100000:3.0:1746144668.784410:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 968 00002000:00100000:3.0:1746144668.784422:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (4136960->4194303) req@ffff88009ee01880 x1830964746922752/t21474840615(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/448 e 0 to 0 dl 1746144679 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.784431:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01880 with x1830964746922752 ext(4136960->4194303) 00010000:00010000:3.0:1746144668.784442:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 747 lvb_type: 0 00010000:00010000:3.0:1746144668.784454:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 747 lvb_type: 0 00002000:00010000:3.0:1746144668.784460:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee01880 00000100:00100000:1.0:1746144668.790826:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747592192:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.791983:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746922880:12345-192.168.204.23@tcp:4:cat.0 Request processed in 11313us (11401us total) trans 21474840616 rc 0/0 00000100:00100000:0.0:1746144668.791995:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 969 00002000:00100000:0.0:1746144668.792007:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2379776->2666495) req@ffff88009ee01c00 x1830964746922880/t21474840616(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/448 e 0 to 0 dl 1746144679 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144668.792014:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ee00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747592320:192.168.204.23@tcp:104: 00002000:00100000:0.0:1746144668.792016:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01c00 with x1830964746922880 ext(2379776->2666495) 00010000:00010000:0.0:1746144668.792025:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 21 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.792039:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746144668.792045:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ee01c00 00010000:00010000:1.0:1746144668.792047:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [102400->397311] (req 102400->397311) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 43 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.792065:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783000, rc 0) 00000100:00100000:1.0:1746144668.792516:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29458:x1830964746923008:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10993us (11553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.792523:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12440 00000100:00100000:0.0:1746144668.792530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.792546:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923136 00000100:00100000:1.0:1746144668.792552:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923136 00010000:00010000:1.0:1746144668.792576:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 28 pid: 7257 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.792606:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6218 00000100:00100000:1.0:1746144668.792612:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746923136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.792625:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.792644:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 28 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.792653:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 28 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.792676:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96fc00/0xa7c849b16e01bc8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc92 expref: 28 pid: 7257 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.792691:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.792709:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+27:1961:x1830964746923136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.794587:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746922624:12345-192.168.204.23@tcp:3:cat.0 Request processed in 12909us (13548us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.794598:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4837 00002000:00100000:3.0:1746144668.794609:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012ce84a80 x1830964746922624/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.794619:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84a80 with x1830964746922624 ext(2097152->3145727) 00002000:00010000:3.0:1746144668.794624:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce84a80 00000100:00100000:1.0:1746144668.794806:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6218 00000100:00100000:0.0:1746144668.794890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.795281:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923264 00000100:00100000:1.0:1746144668.795288:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923264 00010000:00010000:1.0:1746144668.795310:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 747 lvb_type: 0 00000100:00100000:0.0:1746144668.795315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.795492:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923392 00000100:00100000:1.0:1746144668.795494:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923392 00010000:00010000:1.0:1746144668.795505:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 747 lvb_type: 0 00000100:00100000:1.0:1746144668.795658:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6219 00000100:00100000:1.0:1746144668.795665:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746923264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144668.795665:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6220 00000100:00100000:0.0:1746144668.795673:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746923392:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.795679:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144668.795682:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.795697:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.795699:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.795710:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.795733:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bc85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc8b expref: 27 pid: 4760 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.795743:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:0.0:1746144668.795750:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144668.795757:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01bccb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd1 expref: 43 pid: 8388 timeout: 747 lvb_type: 0 00010000:00010000:1.0:1746144668.795767:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.795769:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.795776:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 42 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.795784:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 42 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.795785:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746923392:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 113us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144668.795791:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6220 00010000:00010000:1.0:1746144668.795813:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 42 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.795825:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747592448:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.795879:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ff780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.797206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.797961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.797996:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7101:1830964747592448:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.798022:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.798060:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746923264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2395us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.798069:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6219 00000100:00100000:1.0:1746144668.798121:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923520 00000100:00100000:1.0:1746144668.798126:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923520 00010000:00010000:1.0:1746144668.798174:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144668.798194:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6221 00000100:00100000:1.0:1746144668.798200:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746923520:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144668.798211:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144668.798231:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144668.798240:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144668.798260:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec92c00/0xa7c849b16e01bc93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2379776->2670591] (req 2379776->2666495) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc99 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144668.798271:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.798273:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.798278:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.798287:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.798312:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144668.798323:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747592576:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144668.798379:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.798511:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923776 00000100:00100000:3.0:1746144668.798516:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923776 00002000:00100000:3.0:1746144668.798546:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (102400->106495) req@ffff88009ee00380 x1830964746923776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.798560:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00380 with x1830964746923776 ext(102400->106495) 00002000:00010000:3.0:1746144668.798564:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee00380 00000100:00100000:3.0:1746144668.798579:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4838 00000100:00100000:3.0:1746144668.798584:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746923776:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144668.798733:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746923776:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 148us (773us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144668.798738:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4838 00002000:00100000:3.0:1746144668.798743:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e8:0x0] (102400->106495) req@ffff88009ee00380 x1830964746923776/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.798749:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00380 with x1830964746923776 ext(102400->106495) 00002000:00010000:3.0:1746144668.798752:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee00380 00000100:00100000:0.0:1746144668.801569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.801664:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746923904 00000100:00100000:1.0:1746144668.801673:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746923904 00000100:00100000:1.0:1746144668.801725:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12441 00000100:00100000:1.0:1746144668.801732:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:29451:x1830964746923904:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144668.801751:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144668.801774:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd33 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.801797:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.801799:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144668.801806:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.801828:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144668.801839:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e71c000, rc 0) 00000100:00100000:1.0:1746144668.801877:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:29451:x1830964746923904:12345-192.168.204.23@tcp:101:cat.0 Request processed in 145us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.801882:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12441 00000100:00100000:0.0:1746144668.803244:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.803295:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746924160 00000100:00100000:2.0:1746144668.803300:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746924160 00000100:00100000:1.0:1746144668.803334:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747592576:192.168.204.23@tcp:105: 00002000:00100000:2.0:1746144668.803351:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (393216->397311) req@ffff88009ee02d80 x1830964746924160/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746144668.803354:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746144668.803359:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02d80 with x1830964746924160 ext(393216->397311) 00002000:00010000:2.0:1746144668.803364:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee02d80 00000100:00100000:1.0:1746144668.803383:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746923520:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5181us (6182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.803391:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4839 00000100:00100000:1.0:1746144668.803391:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6221 00000100:00100000:2.0:1746144668.803400:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746924160:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144668.803551:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746924160:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 154us (312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144668.803557:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4839 00002000:00100000:2.0:1746144668.803561:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (393216->397311) req@ffff88009ee02d80 x1830964746924160/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/4536 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.803567:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02d80 with x1830964746924160 ext(393216->397311) 00002000:00010000:2.0:1746144668.803570:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee02d80 00000100:00100000:0.0:1746144668.808525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.808622:0:1570:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746924416 00000100:00100000:3.0:1746144668.808632:0:1570:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746924416 00002000:00100000:3.0:1746144668.808679:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee01500 x1830964746924416/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.808689:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01500 with x1830964746924416 ext(2097152->3145727) 00002000:00010000:3.0:1746144668.808696:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee01500 00000100:00100000:3.0:1746144668.809815:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4840 00000100:00100000:3.0:1746144668.809827:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746924416:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144668.812251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.815311:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746924672 00000100:00100000:3.0:1746144668.815326:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746924672 00000100:00100000:3.0:1746144668.815382:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4167 00000100:00100000:3.0:1746144668.815391:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29458:x1830964746924672:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144668.816608:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29458:x1830964746924672:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1213us (4361us total) trans 8589944140 rc 0/0 00000100:00100000:3.0:1746144668.816617:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4167 00000100:00100000:0.0:1746144668.818592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.818621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.818651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.818710:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746925056 00000100:00100000:1.0:1746144668.818719:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746925056 00002000:00100000:1.0:1746144668.818756:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee02680 x1830964746925056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.818765:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02680 with x1830964746925056 ext(3145728->4194303) 00002000:00010000:1.0:1746144668.818771:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee02680 00000100:00100000:1.0:1746144668.818786:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746925184 00000100:00100000:1.0:1746144668.818788:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746925184 00002000:00100000:1.0:1746144668.818799:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee03800 x1830964746925184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.818806:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03800 with x1830964746925184 ext(2097152->3145727) 00002000:00010000:1.0:1746144668.818809:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee03800 00000100:00100000:1.0:1746144668.818817:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746925312 00000100:00100000:1.0:1746144668.818819:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746925312 00002000:00100000:1.0:1746144668.818828:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee03480 x1830964746925312/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.818835:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03480 with x1830964746925312 ext(3145728->4194303) 00002000:00010000:1.0:1746144668.818837:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee03480 00000100:00100000:1.0:1746144668.818847:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4841 00000100:00100000:1.0:1746144668.818853:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746925056:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144668.819218:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4842 00000100:00100000:2.0:1746144668.819236:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1960:x1830964746925184:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.820008:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4843 00000100:00100000:3.0:1746144668.820015:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746925312:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144668.828037:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746924416:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 18202us (19513us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.828048:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4840 00002000:00100000:3.0:1746144668.828060:0:1570:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee01500 x1830964746924416/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.828070:0:1570:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01500 with x1830964746924416 ext(2097152->3145727) 00002000:00010000:3.0:1746144668.828077:0:1570:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee01500 00000100:00100000:3.0:1746144668.836227:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746925312:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16198us (17561us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.836241:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4843 00002000:00100000:3.0:1746144668.836255:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee03480 x1830964746925312/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.836266:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03480 with x1830964746925312 ext(3145728->4194303) 00002000:00010000:3.0:1746144668.836271:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee03480 00000100:00100000:2.0:1746144668.844451:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746925184:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25213us (25815us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144668.844463:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4842 00002000:00100000:2.0:1746144668.844476:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88009ee03800 x1830964746925184/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.844486:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee03800 with x1830964746925184 ext(2097152->3145727) 00002000:00010000:2.0:1746144668.844491:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee03800 00000100:00100000:0.0:1746144668.850595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.850820:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746925568 00000100:00100000:2.0:1746144668.850829:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746925568 00000100:00100000:2.0:1746144668.850900:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12442 00000100:00100000:2.0:1746144668.850910:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29450:x1830964746925568:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.850928:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.850956:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd3a expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.850989:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.850991:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.851000:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 43 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.851014:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 43 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.851025:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090efe200, rc 0) 00000100:00100000:2.0:1746144668.851082:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29450:x1830964746925568:12345-192.168.204.23@tcp:101:cat.0 Request processed in 174us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.851088:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12442 00000100:00100000:1.0:1746144668.851642:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746925056:12345-192.168.204.23@tcp:3:cat.0 Request processed in 32787us (33056us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144668.851651:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4841 00002000:00100000:1.0:1746144668.851660:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee02680 x1830964746925056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.851669:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee02680 with x1830964746925056 ext(3145728->4194303) 00002000:00010000:1.0:1746144668.851673:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee02680 00000100:00100000:0.0:1746144668.855764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.856270:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746925696 00000100:00100000:3.0:1746144668.856280:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746925696 00000100:00100000:3.0:1746144668.856327:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10228 00000100:00100000:3.0:1746144668.856335:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29460:x1830964746925696:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144668.856364:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.856383:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01bd73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd41 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.856449:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856464:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856475:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856488:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856493:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856498:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856610:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856618:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856624:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144668.856656:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:3.0:1746144668.856660:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144668.856677:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856687:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856693:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856699:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856705:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856711:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f96fc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144668.856715:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856721:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856731:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144668.856733:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144668.856737:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856741:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01bd7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856766:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856771:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856775:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856780:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f96ea00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144668.856782:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856787:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856793:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8c00) 00010000:00010000:3.0:1746144668.856795:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144668.856797:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856802:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ea00/0xa7c849b16e01bd81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144668.856828:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e7800/0xa7c849b16e01bd73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.856838:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 7 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.856844:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.856846:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144668.856848:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96ee00, rc 0) 00000100:00100000:3.0:1746144668.856894:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29460:x1830964746925696:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 559us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.856901:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10228 00000100:00100000:0.0:1746144668.857833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.857869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.857900:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926080 00000100:00100000:1.0:1746144668.857912:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926080 00002000:00100000:1.0:1746144668.857967:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee01180 x1830964746926080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.857976:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01180 with x1830964746926080 ext(3145728->4194303) 00002000:00010000:1.0:1746144668.857981:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee01180 00000100:00100000:2.0:1746144668.857992:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926208 00000100:00100000:2.0:1746144668.857997:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926208 00002000:00100000:2.0:1746144668.858037:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee00000 x1830964746926208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144668.858046:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00000 with x1830964746926208 ext(3145728->4194303) 00002000:00010000:2.0:1746144668.858054:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee00000 00000100:00100000:2.0:1746144668.858291:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4844 00000100:00100000:2.0:1746144668.858300:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746926080:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144668.858300:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4845 00000100:00100000:1.0:1746144668.858308:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746926208:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144668.871608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.873314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.874330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.874615:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926336 00000100:00100000:0.0:1746144668.874625:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926336 00000100:00100000:3.0:1746144668.874626:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926464 00000100:00100000:3.0:1746144668.874629:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926464 00000100:00100000:0.0:1746144668.874664:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926592 00000100:00100000:0.0:1746144668.874666:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926592 00000100:00100000:2.0:1746144668.874679:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12443 00000100:00100000:2.0:1746144668.874703:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746926336:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144668.874724:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.874744:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090eff400/0xa7c849b16e01bd8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd48 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.874802:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747592704:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.875268:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12444 00000100:00100000:3.0:1746144668.875275:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746926464:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144668.875283:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.875294:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd4f expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.875307:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.875309:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.875321:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.875336:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.875346:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c449600, rc 0) 00000100:00100000:2.0:1746144668.875818:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.875865:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746926464:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 589us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.875870:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12444 00000100:00100000:3.0:1746144668.875886:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12445 00000100:00100000:3.0:1746144668.875892:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746926592:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144668.875898:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.875905:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd56 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.875920:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.875921:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.875926:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.875944:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.875952:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c449200, rc 0) 00000100:00100000:3.0:1746144668.875968:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746926592:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 77us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.875973:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12445 00000100:00100000:1.0:1746144668.876058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.876209:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926720 00000100:00100000:2.0:1746144668.876213:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926720 00000100:00100000:2.0:1746144668.876241:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12446 00000100:00100000:2.0:1746144668.876246:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746926720:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:2.0:1746144668.876253:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.876261:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd5d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.876272:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.876274:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144668.876307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.876317:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926848 00000100:00100000:3.0:1746144668.876319:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926848 00000100:00100000:3.0:1746144668.876333:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12447 00000100:00100000:3.0:1746144668.876337:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746926848:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144668.876342:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.876348:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd64 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.876356:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.876358:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.876361:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.876370:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 13 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.876377:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b765600, rc 0) 00000100:00100000:3.0:1746144668.876389:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746926848:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 52us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.876393:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12447 00000100:00100000:3.0:1746144668.876415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.876422:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746926976 00000100:00100000:3.0:1746144668.876424:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746926976 00000100:00100000:3.0:1746144668.876433:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12448 00000100:00100000:3.0:1746144668.876436:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746926976:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:3.0:1746144668.876441:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.876446:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd6b expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.876454:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.876455:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144668.876459:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.876467:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.876473:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b764600, rc 0) 00000100:00100000:3.0:1746144668.876486:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746926976:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 48us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.876491:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12448 00000100:00100000:3.0:1746144668.876514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.876522:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746927104 00000100:00100000:3.0:1746144668.876524:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746927104 00000100:00100000:3.0:1746144668.876536:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12449 00000100:00100000:3.0:1746144668.876540:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746927104:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.876545:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.876549:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01bdb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd72 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.876574:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747592832:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144668.876601:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144668.876982:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746926080:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 18683us (19152us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144668.876989:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4844 00002000:00100000:3.0:1746144668.876998:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88009ee01180 x1830964746926080/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144668.877007:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee01180 with x1830964746926080 ext(3145728->4194303) 00002000:00010000:3.0:1746144668.877012:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ee01180 00010000:00010000:2.0:1746144668.877179:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.877190:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.877196:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090efe000, rc 0) 00000100:00100000:2.0:1746144668.877211:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746926720:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 966us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.877216:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12446 00002000:00010000:2.0:1746144668.886419:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144668 -> 1746144669 00002000:00010000:2.0:1746144668.886427:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144668 -> 1746144669 00000100:00100000:2.0:1746144668.886453:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747592704:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144668.886505:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090eff400/0xa7c849b16e01bd8f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd48 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.886520:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090eff400/0xa7c849b16e01bd8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd48 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.886539:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090eff400, rc 0) 00000100:00100000:2.0:1746144668.886587:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1961:x1830964746926336:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 11899us (14989us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144668.886596:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12443 00000100:00100000:3.0:1746144668.887097:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747592832:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.887116:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01bdb9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd72 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.887125:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b765e00/0xa7c849b16e01bdb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd72 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144668.887173:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b765e00, rc 0) 00000100:00100000:3.0:1746144668.887211:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746927104:12345-192.168.204.23@tcp:101:cat.0 Request processed in 10669us (10695us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144668.888226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.888247:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746927360 00000100:00100000:0.0:1746144668.888254:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746927360 00000100:00100000:0.0:1746144668.888291:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10229 00000100:00100000:0.0:1746144668.888299:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29460:x1830964746927360:12345-192.168.204.23@tcp:101:mirror_io.0 00010000:00010000:0.0:1746144668.888317:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.888332:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01bdc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd79 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144668.888400:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12449 00010000:00010000:0.0:1746144668.888423:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144668.888437:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888445:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888452:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888458:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888469:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144668.888498:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888509:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 8 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144668.888521:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747592960:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.888595:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888604:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 301 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144668.888611:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747593088:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.888644:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888651:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144668.888657:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747593216:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144668.888687:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144668.888698:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144668.888705:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747593344:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.888731:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.889081:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746926208:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 30773us (31210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144668.889090:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4845 00002000:00100000:1.0:1746144668.889100:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88009ee00000 x1830964746926208/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.889110:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ee00000 with x1830964746926208 ext(3145728->4194303) 00002000:00010000:1.0:1746144668.889114:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ee00000 00000100:00100000:1.0:1746144668.893659:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747592960:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144668.894565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.894692:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746927616 00000100:00100000:1.0:1746144668.894699:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746927616 00002000:00100000:1.0:1746144668.894744:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800a4b60380 x1830964746927616/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.894754:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60380 with x1830964746927616 ext(4194304->4939775) 00002000:00010000:1.0:1746144668.894759:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b60380 00000100:00100000:1.0:1746144668.894794:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4846 00000100:00100000:1.0:1746144668.894801:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746927616:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144668.899433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.899497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.899521:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746927872 00000100:00100000:2.0:1746144668.899533:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746927872 00010000:00010000:2.0:1746144668.899592:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 10 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.899626:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746928000 00000100:00100000:2.0:1746144668.899629:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746928000 00010000:00010000:2.0:1746144668.899642:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.899657:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6222 00000100:00100000:2.0:1746144668.899665:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:1963:x1830964746927872:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.899681:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144668.899687:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b63480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747593088:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.899688:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 10 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.899698:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 10 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144668.899701:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b60000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747593216:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.899721:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090effa00/0xa7c849b16e01bd26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd17 expref: 10 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.899751:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.899757:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.899766:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.899770:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.899839:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6223 00000100:00100000:3.0:1746144668.899848:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1963:x1830964746928000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.899855:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.899860:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144668.899867:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144668.899879:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090eff800/0xa7c849b16e01bd49 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd1e expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144668.900328:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.900332:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.900338:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.900342:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.900900:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:1963:x1830964746927872:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1231us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.900909:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6222 00000100:00100000:3.0:1746144668.901341:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1963:x1830964746928000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1491us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.901349:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6223 00000100:00100000:0.0:1746144668.902764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.902786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144668.902985:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747593344:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144668.903022:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:0.0:1746144668.903031:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746927616:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8230us (8469us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746144668.903039:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4846 00002000:00100000:0.0:1746144668.903049:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800a4b60380 x1830964746927616/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.903057:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60380 with x1830964746927616 ext(4194304->4939775) 00002000:00010000:0.0:1746144668.903062:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b60380 00000100:00100000:3.0:1746144668.903154:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746928128 00000100:00100000:3.0:1746144668.903160:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746928128 00000100:00100000:2.0:1746144668.903173:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746927744 00000100:00100000:2.0:1746144668.903177:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746927744 00010000:00010000:3.0:1746144668.903183:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.903202:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 9 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144668.903204:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6224 00000100:00100000:3.0:1746144668.903209:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1961:x1830964746928128:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.903220:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144668.903221:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6225 00010000:00010000:3.0:1746144668.903226:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.903227:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1961:x1830964746927744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.903234:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144668.903236:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.903238:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 9 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144668.903257:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01bc70 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc76 expref: 301 pid: 14710 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.903294:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 9 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.903311:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96ee00/0xa7c849b16e01bd88 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd41 expref: 9 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.903323:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.903328:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.903335:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.903341:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.903357:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144668.903366:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144668.903370:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:2.0:1746144668.903388:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144668.904052:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01bdc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd79 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.904065:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd79 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.904071:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144668.904074:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144668.904076:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782200, rc 0) 00000100:00100000:2.0:1746144668.904102:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29460:x1830964746927360:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 15804us (15878us total) trans 8589944141 rc 0/0 00000100:00100000:2.0:1746144668.904108:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10229 00000100:00100000:2.0:1746144668.904167:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746927744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 940us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.904173:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6225 00010000:00010000:3.0:1746144668.904261:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.904265:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.904299:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1961:x1830964746928128:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1087us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.904307:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6224 00000100:00100000:0.0:1746144668.908697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.908741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.908762:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746928640 00000100:00100000:3.0:1746144668.908771:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746928640 00000100:00100000:0.0:1746144668.908772:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746928768 00000100:00100000:0.0:1746144668.908775:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746928768 00000100:00100000:3.0:1746144668.908809:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10230 00000100:00100000:0.0:1746144668.908809:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12450 00000100:00100000:3.0:1746144668.908815:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29460:x1830964746928640:12345-192.168.204.23@tcp:101:mirror_io.0 00000100:00100000:0.0:1746144668.908815:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746928768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144668.908832:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144668.908832:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144668.908835:0:14708:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746144668.908848:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eef0a00/0xa7c849b16e01bdd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd87 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.908857:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782200/0xa7c849b16e01bdc7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd79 expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.908880:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.908884:0:14708:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144668.908890:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01bddc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd80 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144668.908896:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747593472:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144668.908977:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00000100:00100000:0.0:1746144668.908977:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746144668.908988:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.908997:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909007:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909012:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909018:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909024:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144668.909027:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909033:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909038:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144668.909040:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144668.909043:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909048:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01bde3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144668.909066:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01bddc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd80 expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.909072:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01bddc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd80 expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144668.909079:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a200, rc 0) 00000100:00100000:3.0:1746144668.909100:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29460:x1830964746928640:12345-192.168.204.23@tcp:101:mirror_io.0 Request processed in 286us (415us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144668.909105:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10230 00000100:00100000:2.0:1746144668.913461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.913569:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746928384 00000100:00100000:0.0:1746144668.913579:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746928384 00002000:00100000:0.0:1746144668.913621:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88009fb0ce00 x1830964746928384/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/0 e 0 to 0 dl 1746144679 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144668.913631:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0ce00 with x1830964746928384 ext(4194304->4939775) 00002000:00010000:0.0:1746144668.913635:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0ce00 00000100:00100000:0.0:1746144668.913663:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4847 00000100:00100000:0.0:1746144668.913669:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746928384:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144668.918030:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747593472:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144668.918069:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eef0a00/0xa7c849b16e01bdd5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd87 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.918083:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eef0a00/0xa7c849b16e01bdd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd87 expref: 26 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144668.918114:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eef0a00, rc 0) 00000100:00100000:0.0:1746144668.918188:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746928768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9372us (9444us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144668.918195:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12450 00000100:00100000:0.0:1746144668.919049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.919861:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929024 00000100:00100000:3.0:1746144668.919870:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929024 00000100:00100000:1.0:1746144668.919976:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746928384:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6305us (6521us total) trans 0 rc 745472/745472 00000100:00100000:1.0:1746144668.919987:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4847 00002000:00100000:1.0:1746144668.919997:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88009fb0ce00 x1830964746928384/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:309/0 lens 488/440 e 0 to 0 dl 1746144679 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144668.920006:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb0ce00 with x1830964746928384 ext(4194304->4939775) 00002000:00010000:1.0:1746144668.920011:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb0ce00 00000100:00100000:3.0:1746144668.920061:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4168 00000100:00100000:3.0:1746144668.920070:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29460:x1830964746929024:12345-192.168.204.23@tcp:35:mirror_io.0 00000100:00100000:3.0:1746144668.920475:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29460:x1830964746929024:12345-192.168.204.23@tcp:35:mirror_io.0 Request processed in 406us (1428us total) trans 8589944142 rc 0/0 00000100:00100000:3.0:1746144668.920483:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4168 00000100:00100000:1.0:1746144668.920608:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144668.921177:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929152 00000100:00100000:0.0:1746144668.921183:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929152 00000100:00100000:2.0:1746144668.921329:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12451 00000100:00100000:2.0:1746144668.921349:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746929152:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144668.921361:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.921378:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b62e000/0xa7c849b16e01bdea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd8e expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.921429:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747593600:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144668.921835:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144668.925075:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747593600:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144668.925130:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b62e000/0xa7c849b16e01bdea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd8e expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.925187:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b62e000/0xa7c849b16e01bdea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd8e expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.925203:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b62e000, rc 0) 00000100:00100000:2.0:1746144668.925257:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746929152:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3920us (4647us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144668.925266:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12451 00000100:00100000:1.0:1746144668.932629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.932679:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929408 00000100:00100000:3.0:1746144668.932690:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929408 00000100:00100000:3.0:1746144668.933005:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4169 00000100:00100000:3.0:1746144668.933013:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:29451:x1830964746929408:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144668.933288:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:29451:x1830964746929408:12345-192.168.204.23@tcp:35:cat.0 Request processed in 275us (670us total) trans 8589944143 rc 0/0 00000100:00100000:3.0:1746144668.933295:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4169 00000100:00100000:0.0:1746144668.990324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.990402:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929536 00000100:00100000:2.0:1746144668.990413:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929536 00000100:00100000:2.0:1746144668.990490:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12452 00000100:00100000:2.0:1746144668.990500:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:29456:x1830964746929536:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144668.990524:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144668.990544:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd95 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.990579:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.990587:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.990594:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.990600:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.990602:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.990605:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2686976->3145727] (req 2686976->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.990635:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.990647:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.990665:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747593728:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.990772:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144668.990780:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144668.990787:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747593856:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144668.990811:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.990819:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 25 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.990827:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747593984:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.990845:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144668.993236:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144668.993321:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929664 00000100:00100000:3.0:1746144668.993329:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929664 00000100:00100000:2.0:1746144668.993348:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747593728:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144668.993359:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747593856:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144668.993363:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 11 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144668.993367:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747593984:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144668.993391:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6226 00000100:00100000:3.0:1746144668.993398:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746929664:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144668.993410:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.993413:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2686976->3145727] (req 2686976->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 22 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.993433:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7c4000, rc 0) 00010000:00010000:3.0:1746144668.993436:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 11 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144668.993446:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 11 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144668.993468:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b764600/0xa7c849b16e01bdb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd6b expref: 11 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144668.993476:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+22:29456:x1830964746929536:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2978us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.993483:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12452 00010000:00010000:3.0:1746144668.993489:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144668.993508:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746929664:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 111us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144668.993514:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6226 00000100:00100000:0.0:1746144668.994733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.994820:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929792 00000100:00100000:2.0:1746144668.994825:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929792 00010000:00010000:2.0:1746144668.994850:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.994880:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6227 00000100:00100000:2.0:1746144668.994888:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746929792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.994898:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.994913:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.994922:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.994959:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e71c000/0xa7c849b16e01bd65 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd33 expref: 22 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.994985:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144668.995120:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746929792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 231us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144668.995126:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6227 00000100:00100000:0.0:1746144668.995616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144668.995673:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746929920 00000100:00100000:2.0:1746144668.995677:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746929920 00010000:00010000:2.0:1746144668.995694:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144668.995766:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6228 00000100:00100000:2.0:1746144668.995776:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746929920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144668.995784:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144668.995796:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.995806:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.995818:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090eff200/0xa7c849b16e01bd57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd25 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144668.995833:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.995835:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144668.995843:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.995851:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144668.995882:0:7101:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 20 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144668.995899:0:7101:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747594112:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144668.996198:0:7101:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144668.999460:0:7101:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7101:1830964747594112:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144668.999502:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144668.999558:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746929920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3782us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144668.999569:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6228 00000100:00100000:0.0:1746144669.000061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.000379:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746930176 00000100:00100000:2.0:1746144669.000387:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746930176 00002000:00100000:2.0:1746144669.000441:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2686976->2691071) req@ffff8800a4b60e00 x1830964746930176/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.000450:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60e00 with x1830964746930176 ext(2686976->2691071) 00002000:00010000:2.0:1746144669.000455:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4b60e00 00000100:00100000:2.0:1746144669.000482:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4848 00000100:00100000:2.0:1746144669.000490:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746930176:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144669.001945:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746930176:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 1452us (1881us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144669.001951:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4848 00002000:00100000:2.0:1746144669.001958:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e8:0x0] (2686976->2691071) req@ffff8800a4b60e00 x1830964746930176/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.001964:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b60e00 with x1830964746930176 ext(2686976->2691071) 00002000:00010000:2.0:1746144669.001968:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4b60e00 00000100:00100000:0.0:1746144669.008264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.008332:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746930304 00000100:00100000:2.0:1746144669.008374:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746930304 00000100:00100000:2.0:1746144669.008450:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12453 00000100:00100000:2.0:1746144669.008459:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:29456:x1830964746930304:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.008482:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.008501:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fd9c expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.008534:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.008542:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.008550:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 42 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.008557:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.008558:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.008562:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->3678207] (req 3145728->3678207) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 26 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.008599:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 42 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.008611:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 42 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.008623:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594240:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.008733:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.008742:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 9 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.008751:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594368:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.008778:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.008786:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.008793:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594496:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.008811:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.012854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.013267:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594240:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.013280:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594368:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.013286:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746930560 00000100:00100000:2.0:1746144669.013287:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594496:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.013293:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746930560 00010000:00010000:1.0:1746144669.013333:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 43 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.013334:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [3145728->3678207] (req 3145728->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 26 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.013350:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7c5c00, rc 0) 00000100:00100000:1.0:1746144669.013373:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6229 00000100:00100000:1.0:1746144669.013380:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746930560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.013392:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144669.013398:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:29456:x1830964746930304:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 4941us (5145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.013405:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12453 00010000:00010000:1.0:1746144669.013414:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 43 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.013423:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 43 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.013446:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090efe200/0xa7c849b16e01bd6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd3a expref: 43 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.013465:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.014249:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1963:x1830964746930560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 867us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.014255:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6229 00000100:00100000:1.0:1746144669.015385:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.015474:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746930432 00000100:00100000:0.0:1746144669.015480:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746930432 00000100:00100000:1.0:1746144669.015826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.016007:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746930688 00000100:00100000:2.0:1746144669.016011:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746930688 00010000:00010000:2.0:1746144669.016036:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.016073:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6230 00000100:00100000:2.0:1746144669.016082:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1963:x1830964746930688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.016093:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.016111:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.016171:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.016193:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6231 00000100:00100000:0.0:1746144669.016199:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746930432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.016206:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.016215:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.016225:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.016243:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b765600/0xa7c849b16e01bdab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd64 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.016258:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.016280:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746930432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.016289:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6231 00010000:00010000:2.0:1746144669.016547:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00000100:00080000:3.0:1746144669.016587:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746144669.017111:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090eff000/0xa7c849b16e01bd0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd10 expref: 26 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.017256:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.017258:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.017266:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 25 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.017274:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 25 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.017314:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 25 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.017327:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747594624:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.017757:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.021993:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747594624:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.022029:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.022076:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1963:x1830964746930688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5994us (6247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.022087:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6230 00000100:00100000:0.0:1746144669.025026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.025164:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746930944 00000100:00100000:2.0:1746144669.025175:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746930944 00002000:00100000:2.0:1746144669.025237:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3eb:0x0] (3674112->3678207) req@ffff8800a4b62d80 x1830964746930944/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.025247:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62d80 with x1830964746930944 ext(3674112->3678207) 00002000:00010000:2.0:1746144669.025251:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62d80 00000100:00100000:3.0:1746144669.026404:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4849 00000100:00100000:3.0:1746144669.026416:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746930944:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144669.026610:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746930944:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 197us (1595us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144669.026616:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4849 00002000:00100000:3.0:1746144669.026623:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3674112->3678207) req@ffff8800a4b62d80 x1830964746930944/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.026630:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4b62d80 with x1830964746930944 ext(3674112->3678207) 00002000:00010000:3.0:1746144669.026634:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4b62d80 00000100:00100000:0.0:1746144669.028769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.029059:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746931200 00000100:00100000:3.0:1746144669.029068:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746931200 00000100:00100000:3.0:1746144669.029303:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4170 00000100:00100000:3.0:1746144669.029310:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:29456:x1830964746931200:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144669.029535:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:29456:x1830964746931200:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 224us (772us total) trans 8589944144 rc 0/0 00000100:00100000:3.0:1746144669.029541:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4170 00000100:00100000:0.0:1746144669.042055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.044013:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746931328 00000100:00100000:3.0:1746144669.044027:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746931328 00000100:00100000:3.0:1746144669.044102:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10231 00000100:00100000:3.0:1746144669.044111:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29466:x1830964746931328:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144669.044152:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.044173:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bdff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fda3 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.044237:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044251:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044263:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044279:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044285:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044290:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044402:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044409:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044415:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:3.0:1746144669.044447:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:3.0:1746144669.044451:0:14708:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144669.044466:0:14708:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044476:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044483:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044488:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044498:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044503:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29ae00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.044507:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044514:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044525:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144669.044528:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.044531:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044536:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ae00/0xa7c849b16e01be06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044564:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044569:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044574:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044577:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.044579:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044583:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044592:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a4559600) 00010000:00010000:3.0:1746144669.044594:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.044596:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044600:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b200/0xa7c849b16e01be0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.044624:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01bdff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.044633:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 9 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.044639:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.044641:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144669.044643:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29ba00, rc 0) 00000100:00100000:3.0:1746144669.044695:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29466:x1830964746931328:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 586us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.044700:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10231 00000100:00080000:0.0:1746144669.045356:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144669.048981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.049027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.049044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.049067:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746931712 00000100:00100000:1.0:1746144669.049077:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746931712 00000100:00100000:1.0:1746144669.049115:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746931968 00000100:00100000:1.0:1746144669.049123:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746931968 00000100:00100000:2.0:1746144669.049162:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12454 00000100:00100000:2.0:1746144669.049175:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746931712:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:1.0:1746144669.049188:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12455 00000100:00100000:1.0:1746144669.049194:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746931968:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144669.049199:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.049202:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.049218:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7c4200/0xa7c849b16e01be1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdb1 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.049218:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01be22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdbf expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.049267:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594880:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144669.049267:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747594752:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144669.049533:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746931584 00000100:00100000:3.0:1746144669.049537:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746931584 00000100:00100000:3.0:1746144669.049566:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10232 00000100:00100000:3.0:1746144669.049571:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29468:x1830964746931584:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144669.049583:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.049594:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01be29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdaa expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.049831:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00000100:00080000:0.0:1746144669.049893:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746144669.049999:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050101:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050117:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050123:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050129:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144669.050257:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3ffcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.050266:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144480 going to sleep for 11 seconds 00010000:00010000:3.0:1746144669.050596:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050604:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050610:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144669.050618:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144669.050702:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050709:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050718:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050723:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.050727:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050734:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050744:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144669.050747:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.050751:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050756:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050779:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050784:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050789:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050793:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.050795:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050800:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050810:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012b4b2400) 00010000:00010000:3.0:1746144669.050812:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.050814:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050819:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.050855:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01be29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 303 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.050866:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 302 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.050872:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.050874:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144669.050876:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29b000, rc 0) 00000100:00100000:3.0:1746144669.050902:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29468:x1830964746931584:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 1330us (1932us total) trans 8589944145 rc 0/0 00000100:00100000:3.0:1746144669.050909:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10232 00000100:00100000:0.0:1746144669.052051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.052113:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746931840 00000100:00100000:1.0:1746144669.052120:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746931840 00000100:00100000:1.0:1746144669.052185:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12456 00000100:00100000:1.0:1746144669.052192:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746931840:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.052206:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.052218:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782800/0xa7c849b16e01be4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdb8 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.052262:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747595008:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144669.052319:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.052849:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747594880:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.052884:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7c4200/0xa7c849b16e01be1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdb1 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.052895:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7c4200/0xa7c849b16e01be1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdb1 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.052914:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7c4200, rc 0) 00000100:00100000:2.0:1746144669.052950:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746931712:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3779us (3921us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.052956:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12454 00000100:00100000:1.0:1746144669.053076:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747594752:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.053097:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01be22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdbf expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.053107:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01be22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdbf expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.053130:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783400, rc 0) 00000100:00100000:1.0:1746144669.053170:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746931968:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3976us (4124us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.053176:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12455 00000100:00100000:0.0:1746144669.056118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.056186:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747595008:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.056224:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782800/0xa7c849b16e01be4c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdb8 expref: 10 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.056237:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782800/0xa7c849b16e01be4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdb8 expref: 10 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.056252:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782800, rc 0) 00000100:00100000:2.0:1746144669.056359:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746932096 00000100:00100000:2.0:1746144669.057000:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746932096 00000100:00100000:2.0:1746144669.057057:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12457 00000100:00100000:2.0:1746144669.057067:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29468:x1830964746932096:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.057083:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.057098:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdc6 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.057124:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.057165:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.057174:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.057180:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.057182:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.057185:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1613824->1703935] (req 1613824->1703935) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.057219:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 20 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.057231:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 20 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.057242:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747595136:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.057518:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746931840:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5325us (5470us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.057525:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12456 00010000:00010000:2.0:1746144669.059347:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 9 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.059361:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 9 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.059372:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747595264:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.059426:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.059434:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.059442:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747595392:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.059457:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.063829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.063854:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746932352 00000100:00100000:3.0:1746144669.063862:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746932352 00000100:00100000:3.0:1746144669.063903:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10233 00000100:00100000:3.0:1746144669.063911:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+11:29471:x1830964746932352:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.063945:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.063965:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01be5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdcd expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.064080:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.064092:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.064102:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.064113:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.064118:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.064123:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144669.064492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.064725:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747595136:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.064738:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747595264:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.064946:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746932608 00000100:00100000:2.0:1746144669.064950:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746932608 00000100:00100000:2.0:1746144669.065254:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10234 00000100:00100000:2.0:1746144669.065263:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094bdf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29466:x1830964746932608:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144669.065271:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.065280:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01be6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdd4 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.065333:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.065343:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.065350:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.065356:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.065385:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.065395:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 301 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.065406:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747595520:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.065539:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747595392:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.065568:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1613824->1703935] (req 1613824->1703935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.065581:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7c5000, rc 0) 00010000:00010000:3.0:1746144669.065649:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065656:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065664:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144669.065672:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144669.065759:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065765:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065774:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065779:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29b800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.065782:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065789:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065797:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144669.065800:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.065804:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065808:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b800/0xa7c849b16e01be61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065829:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065833:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065837:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065841:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f29a200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.065842:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065847:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065856:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008f03ec00) 00010000:00010000:3.0:1746144669.065857:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.065859:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065863:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a200/0xa7c849b16e01be68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.065898:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29aa00/0xa7c849b16e01be5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 14 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.065907:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.065912:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.065914:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746144669.065916:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f29a600, rc 0) 00010000:00010000:2.0:1746144669.066286:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.066294:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 10 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.066302:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747595648:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.066324:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.066353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.066372:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746932736 00000100:00100000:2.0:1746144669.066376:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746932736 00010000:00010000:2.0:1746144669.066394:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.066419:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6232 00000100:00100000:2.0:1746144669.066426:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746932736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.066435:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.066452:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.066461:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.066474:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c449200/0xa7c849b16e01bd9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd56 expref: 10 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.066486:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.066499:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746932736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.066505:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6232 00000100:00100000:2.0:1746144669.066550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.066559:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746932864 00000100:00100000:2.0:1746144669.066561:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746932864 00010000:00010000:2.0:1746144669.066572:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 21 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.066585:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6233 00000100:00100000:2.0:1746144669.066589:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746932864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.066595:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.066601:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 21 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.066608:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 21 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.066618:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f000/0xa7c849b16e01bce7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fced expref: 21 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.066626:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.066638:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746932864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 49us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.066643:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6233 00000100:00100000:2.0:1746144669.066685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.066696:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746932992 00000100:00100000:2.0:1746144669.066698:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746932992 00010000:00010000:2.0:1746144669.066711:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 27 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.066731:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6234 00000100:00100000:2.0:1746144669.066737:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746932992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.066743:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.066751:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 27 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.066759:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 27 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.066770:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1bb600/0xa7c849b16e01bce0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fce6 expref: 27 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.066778:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.066780:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.066786:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.066792:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.066808:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.066815:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747595776:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.066830:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.068682:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29468:x1830964746932096:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 11608us (12565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.068692:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12457 00000100:00100000:3.0:1746144669.068973:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+13:29471:x1830964746932352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5061us (5151us total) trans 8589944146 rc 0/0 00000100:00100000:3.0:1746144669.068981:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10233 00000100:00100000:2.0:1746144669.072061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.072507:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747595520:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.072517:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747595648:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.072552:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:2.0:1746144669.072649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.072718:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747595776:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.072732:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.072745:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746933120 00000100:00100000:0.0:1746144669.072752:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746933120 00010000:00010000:0.0:1746144669.072783:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 11 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.072813:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746933248 00000100:00100000:0.0:1746144669.072815:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746933248 00010000:00010000:0.0:1746144669.072824:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.072921:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746932992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6183us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.072936:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6234 00000100:00100000:0.0:1746144669.072975:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6235 00000100:00100000:0.0:1746144669.072982:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746933120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144669.072984:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6236 00000100:00100000:3.0:1746144669.072990:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1962:x1830964746933248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.072994:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.072999:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.073000:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 11 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.073004:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.073008:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 11 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.073260:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.073285:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29ba00/0xa7c849b16e01be14 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fda3 expref: 11 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.073328:0:7101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.073329:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29b000/0xa7c849b16e01be3e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdaa expref: 302 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.073332:0:7101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.073340:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.073348:0:7101:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.073359:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.073362:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144669.073389:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.073453:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1962:x1830964746933248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 462us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.073453:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1962:x1830964746933120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 471us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.073458:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6236 00000100:00100000:0.0:1746144669.073462:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6235 00010000:00010000:0.0:1746144669.073478:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.073483:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:0.0:1746144669.073502:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:0.0:1746144669.073644:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01be6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.073657:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.073663:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.073665:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746144669.073667:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19d000, rc 0) 00000100:00100000:0.0:1746144669.073702:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094bdf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29466:x1830964746932608:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 8441us (9210us total) trans 8589944147 rc 0/0 00000100:00100000:0.0:1746144669.073709:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10234 00000100:00100000:1.0:1746144669.077320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.077363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.077389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.077556:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746933632 00000100:00100000:3.0:1746144669.077566:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746933632 00000100:00100000:1.0:1746144669.077569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.077589:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746933888 00000100:00100000:1.0:1746144669.077592:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746933888 00002000:00100000:3.0:1746144669.077610:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1613824->1617919) req@ffff88012ce85880 x1830964746933632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.077620:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85880 with x1830964746933632 ext(1613824->1617919) 00002000:00010000:3.0:1746144669.077625:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85880 00000100:00100000:1.0:1746144669.077634:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10235 00000100:00100000:3.0:1746144669.077639:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4850 00000100:00100000:1.0:1746144669.077641:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29466:x1830964746933888:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:3.0:1746144669.077644:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746933632:12345-192.168.204.23@tcp:3:multiop.0 00010000:00010000:1.0:1746144669.077657:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.077673:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01be92 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fde9 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.077752:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144669.077764:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.077769:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144669.077796:0:14708:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.077810:0:14708:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 11 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.077820:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747595904:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.077889:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.077953:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746933376 00000100:00100000:0.0:1746144669.077956:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746933376 00000100:00100000:0.0:1746144669.077976:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746933760 00000100:00100000:0.0:1746144669.077978:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746933760 00000100:00100000:0.0:1746144669.077998:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12458 00000100:00100000:0.0:1746144669.078003:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746933376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.078012:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.078022:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c19ce00/0xa7c849b16e01bea0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fddb expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.078052:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747596032:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.078070:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12459 00000100:00100000:2.0:1746144669.078080:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746933760:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144669.078081:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746144669.078087:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.078096:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6000/0xa7c849b16e01bea7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fde2 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.078184:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746933632:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 538us (877us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144669.078191:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4850 00002000:00100000:3.0:1746144669.078197:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e7:0x0] (1613824->1617919) req@ffff88012ce85880 x1830964746933632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.078204:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce85880 with x1830964746933632 ext(1613824->1617919) 00002000:00010000:3.0:1746144669.078206:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce85880 00000100:00100000:2.0:1746144669.078354:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136959500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747596160:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.078389:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.081082:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747595904:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.081108:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:0.0:1746144669.081907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.082496:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934016 00000100:00100000:2.0:1746144669.082505:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934016 00010000:00010000:2.0:1746144669.082554:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 12 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.082848:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747596032:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144669.082874:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c19ce00/0xa7c849b16e01bea0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fddb expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.082886:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c19ce00/0xa7c849b16e01bea0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fddb expref: 26 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.082901:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19ce00, rc 0) 00000100:00100000:0.0:1746144669.082956:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746933376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4952us (5592us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144669.082964:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12458 00002000:00010000:2.0:1746144669.083214:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144668 -> 1746144669 00002000:00010000:2.0:1746144669.083218:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144668 -> 1746144669 00000100:00100000:2.0:1746144669.083231:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136959500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747596160:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.083252:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6000/0xa7c849b16e01bea7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fde2 expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.083262:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a6000/0xa7c849b16e01bea7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fde2 expref: 21 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.083273:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a6000, rc 0) 00000100:00100000:3.0:1746144669.083293:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6237 00000100:00100000:2.0:1746144669.083297:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1961:x1830964746933760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5220us (5907us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.083303:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746934016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144669.083303:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12459 00010000:00010000:3.0:1746144669.083317:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.083324:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 12 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.083334:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 12 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.083352:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01be76 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdd4 expref: 12 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.083367:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.083372:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.083382:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.083388:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.083405:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.083441:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746934016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 140us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.083449:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6237 00000100:00100000:2.0:1746144669.083840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144669.083987:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144669.083995:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:1.0:1746144669.084035:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:1.0:1746144669.084039:0:14708:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144669.084054:0:14708:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144669.084084:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0xa7c849b16e01be92 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fde9 expref: 11 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.084104:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fde9 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.084111:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.084113:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144669.084116:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f000, rc 0) 00000100:00100000:1.0:1746144669.084155:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29466:x1830964746933888:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6514us (6585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.084161:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10235 00000100:00100000:3.0:1746144669.084391:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934272 00000100:00100000:3.0:1746144669.084396:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934272 00002000:00100000:3.0:1746144669.084424:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1699840->1703935) req@ffff880136959500 x1830964746934272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.084433:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959500 with x1830964746934272 ext(1699840->1703935) 00002000:00010000:3.0:1746144669.084438:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136959500 00000100:00100000:3.0:1746144669.084463:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4851 00000100:00100000:3.0:1746144669.084468:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746934272:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144669.084610:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746934272:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 141us (770us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144669.084616:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4851 00002000:00100000:3.0:1746144669.084620:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1699840->1703935) req@ffff880136959500 x1830964746934272/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.084627:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959500 with x1830964746934272 ext(1699840->1703935) 00002000:00010000:3.0:1746144669.084630:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136959500 00000100:00100000:0.0:1746144669.086290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.086376:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934400 00000100:00100000:2.0:1746144669.086383:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934400 00000100:00100000:2.0:1746144669.086695:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12460 00000100:00100000:2.0:1746144669.086705:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:29471:x1830964746934400:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.086720:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.086736:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdf0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.086760:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 41 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.086768:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144669.086770:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144669.086774:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.086800:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 41 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.086812:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 41 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.086824:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013695b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747596288:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.086903:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.088108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.088125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.088163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.088179:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934656 00000100:00100000:0.0:1746144669.088183:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934656 00000100:00100000:0.0:1746144669.088217:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934912 00000100:00100000:0.0:1746144669.088219:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934912 00000100:00100000:0.0:1746144669.088237:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934528 00000100:00100000:0.0:1746144669.088239:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934528 00000100:00100000:0.0:1746144669.088254:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12461 00000100:00100000:0.0:1746144669.088260:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746934656:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.088272:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.088285:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01beb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdfe expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.088325:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747596416:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.088373:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.088390:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12462 00000100:00100000:0.0:1746144669.088396:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746934912:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.088402:0:29370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.088408:0:29370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01bebc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe0c expref: -99 pid: 29370 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.088431:0:29370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747596544:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.088452:0:29370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.088464:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12463 00000100:00100000:0.0:1746144669.088469:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746934528:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.088475:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.088483:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01bec3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fdf7 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.088505:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4b61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747596672:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.088524:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.088559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.088577:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746934784 00000100:00100000:0.0:1746144669.088579:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746934784 00000100:00100000:0.0:1746144669.088597:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12464 00000100:00100000:0.0:1746144669.088601:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746934784:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.088607:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.088614:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01beca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe05 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.088638:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f398a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747596800:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.088656:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.092426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.092489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.092589:0:29370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29370:1830964747596544:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.092607:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013695b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747596288:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.092620:0:29370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01bebc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe0c expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.092634:0:29370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4865c00/0xa7c849b16e01bebc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe0c expref: 12 pid: 29370 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.092638:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.092648:0:29370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4865c00, rc 0) 00010000:00010000:2.0:1746144669.092657:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a7e00, rc 0) 00000100:00100000:2.0:1746144669.092692:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:29471:x1830964746934400:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5990us (6407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.092700:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12460 00000100:00100000:1.0:1746144669.092712:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746935296 00000100:00100000:1.0:1746144669.092718:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746935296 00002000:00100000:1.0:1746144669.092757:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (102400->397311) req@ffff88009fb47b80 x1830964746935296/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.092767:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb47b80 with x1830964746935296 ext(102400->397311) 00010000:00010000:1.0:1746144669.092774:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 42 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.092786:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 42 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746144669.092792:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb47b80 00000100:00100000:1.0:1746144669.092808:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 970 00000100:00100000:1.0:1746144669.092814:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746935296:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144669.092885:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746935168 00000100:00100000:0.0:1746144669.092888:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746935168 00000100:00100000:0.0:1746144669.092912:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4171 00000100:00100000:0.0:1746144669.092916:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29468:x1830964746935168:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144669.093260:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746934912:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4863us (5132us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.093266:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12462 00000100:00100000:0.0:1746144669.093646:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29468:x1830964746935168:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 727us (1228us total) trans 8589944148 rc 0/0 00000100:00100000:0.0:1746144669.093653:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4171 00000100:00100000:0.0:1746144669.093692:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f398a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747596800:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144669.093707:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01beca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe05 expref: 12 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.093715:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01beca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe05 expref: 12 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.093724:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783600, rc 0) 00000100:00100000:0.0:1746144669.093746:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746934784:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5143us (5186us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144669.093751:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12464 00000100:00100000:0.0:1746144669.093787:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747596416:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144669.093801:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01beb5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdfe expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.093808:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5344000/0xa7c849b16e01beb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdfe expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.093815:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5344000, rc 0) 00000100:00100000:0.0:1746144669.093830:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746934656:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5571us (5727us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144669.093835:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12461 00000100:00100000:3.0:1746144669.093912:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4b61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747596672:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144669.093926:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01bec3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf7 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.093946:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783200/0xa7c849b16e01bec3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf7 expref: 10 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.093954:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783200, rc 0) 00000100:00100000:3.0:1746144669.093982:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746934528:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5513us (5819us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.093988:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12463 00000100:00100000:1.0:1746144669.098694:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746935296:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 5868us (6192us total) trans 17179873396 rc 0/0 00000100:00100000:1.0:1746144669.098707:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 970 00002000:00100000:1.0:1746144669.098720:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (102400->397311) req@ffff88009fb47b80 x1830964746935296/t17179873396(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.098729:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb47b80 with x1830964746935296 ext(102400->397311) 00010000:00010000:1.0:1746144669.098738:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 44 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.098755:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 44 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746144669.098763:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb47b80 00000100:00100000:0.0:1746144669.101509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.101651:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746935552 00000100:00100000:1.0:1746144669.101660:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746935552 00000100:00100000:1.0:1746144669.101716:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10236 00000100:00100000:1.0:1746144669.101724:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29466:x1830964746935552:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.101744:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.101763:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1400/0xa7c849b16e01bed1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe13 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.101858:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144669.101872:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:1.0:1746144669.101884:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:1.0:1746144669.101896:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:1.0:1746144669.102014:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1400/0xa7c849b16e01bed1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 13 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.102044:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 12 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.102057:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.102059:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144669.102063:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942f1c00, rc 0) 00000100:00100000:1.0:1746144669.102099:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746935552:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 376us (601us total) trans 8589944149 rc 0/0 00000100:00100000:1.0:1746144669.102105:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10236 00000100:00100000:0.0:1746144669.104127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.104230:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746935680 00000100:00100000:3.0:1746144669.104237:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746935680 00010000:00010000:3.0:1746144669.104270:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 44 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.104515:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6238 00000100:00100000:3.0:1746144669.104523:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746935680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.104537:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.104567:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 44 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.104579:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 44 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.104600:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bd5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->397311) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd2c expref: 44 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.104967:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.104969:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.104978:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.104987:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.105023:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.105036:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747596928:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144669.105835:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.105903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.105943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.105963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.105977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.105989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.106005:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746935936 00000100:00100000:2.0:1746144669.106009:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746935936 00000100:00100000:2.0:1746144669.106035:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936192 00000100:00100000:2.0:1746144669.106037:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936192 00000100:00100000:2.0:1746144669.106048:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936448 00000100:00100000:2.0:1746144669.106049:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936448 00000100:00100000:2.0:1746144669.106059:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746935808 00000100:00100000:2.0:1746144669.106060:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746935808 00000100:00100000:2.0:1746144669.106070:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936064 00000100:00100000:2.0:1746144669.106071:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936064 00000100:00100000:2.0:1746144669.106083:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12465 00000100:00100000:2.0:1746144669.106089:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746935936:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144669.106124:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106155:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106167:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.106174:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106179:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.106181:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.106183:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106201:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 24 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106212:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 24 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.106221:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747597056:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.106269:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 11 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.106277:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 11 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.106285:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747597184:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.106312:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 19 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106332:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 19 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.106339:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747597312:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.106357:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.106374:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12466 00000100:00100000:2.0:1746144669.106382:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746936192:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144669.106402:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106416:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 43 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106423:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.106428:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106433:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.106434:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.106436:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106456:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 25 pid: 29370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106463:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 25 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.106471:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747597440:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.106498:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.106504:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 10 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.106511:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747597568:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.106532:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 43 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106539:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 43 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.106546:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747597696:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.106558:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.106574:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12467 00000100:00100000:2.0:1746144669.106581:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746936448:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746144669.106599:0:8389:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106609:0:8389:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106614:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144669.106616:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144669.106618:0:8389:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106630:0:8389:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 19 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.106637:0:8389:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 19 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.106645:0:8389:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747597824:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.106661:0:8389:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.106696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.106837:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936320 00000100:00100000:0.0:1746144669.106841:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936320 00000100:00100000:0.0:1746144669.106862:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12468 00000100:00100000:0.0:1746144669.106867:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746935808:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144669.106883:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.106893:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.106897:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.106899:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.106901:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.106916:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.106924:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 25 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.106940:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747597952:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.106964:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.106980:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12469 00000100:00100000:0.0:1746144669.106986:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746936064:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144669.107001:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107013:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107018:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144669.107019:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144669.107021:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107033:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 24 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107044:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 24 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.107051:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f399c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747598080:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.107068:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.107083:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12470 00000100:00100000:0.0:1746144669.107088:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746936320:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1746144669.107102:0:22208:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107111:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 25 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107116:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144669.107117:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144669.107119:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107131:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 25 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.107157:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 25 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.107164:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f39ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747598208:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.107194:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800944c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.110457:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747596928:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.110480:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.111260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.111530:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746935680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7006us (7409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.111542:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6238 00000100:00100000:1.0:1746144669.112530:0:31505:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936704 00000100:00100000:1.0:1746144669.112540:0:31505:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936704 00002000:00100000:1.0:1746144669.112582:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0df80 x1830964746936704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.112591:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0df80 with x1830964746936704 ext(0->1048575) 00010000:00010000:1.0:1746144669.112599:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.112612:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746144669.112618:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0df80 00000100:00100000:1.0:1746144669.112648:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 971 00000100:00100000:1.0:1746144669.112654:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746936704:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144669.117186:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747597056:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.117463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.117489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.117505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.117536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.117550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.117562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.117582:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936960 00000100:00100000:0.0:1746144669.117588:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936960 00010000:00010000:0.0:1746144669.117623:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 25 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.117645:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937216 00000100:00100000:0.0:1746144669.117648:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937216 00010000:00010000:0.0:1746144669.117659:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 20 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.117667:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746936832 00000100:00100000:0.0:1746144669.117669:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746936832 00010000:00010000:0.0:1746144669.117677:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 12 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.117685:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937088 00000100:00100000:0.0:1746144669.117687:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937088 00010000:00010000:0.0:1746144669.117696:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 12 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.117704:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937344 00000100:00100000:0.0:1746144669.117706:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937344 00010000:00010000:0.0:1746144669.117714:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 28 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.117722:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937472 00000100:00100000:0.0:1746144669.117723:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937472 00010000:00010000:0.0:1746144669.117731:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 43 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.117741:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6239 00000100:00100000:0.0:1746144669.117747:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746936960:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.117760:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.117784:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 25 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.117795:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 25 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.117817:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f400/0xa7c849b16e01bcd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcdf expref: 25 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.117838:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.117872:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1963:x1830964746936960:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.117879:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6239 00000100:00100000:0.0:1746144669.117895:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6240 00000100:00100000:0.0:1746144669.117900:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746937216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.117909:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.117915:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 20 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.117923:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 20 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.117945:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.117959:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746937216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 60us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.117964:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6240 00000100:00100000:0.0:1746144669.117974:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6241 00000100:00100000:0.0:1746144669.117978:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746936832:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.117984:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.117990:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 12 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.117997:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 12 pid: 4758 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.118008:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.118010:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.118015:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.118023:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.118044:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.118058:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746936832:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 79us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.118062:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6241 00000100:00100000:0.0:1746144669.118121:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6242 00000100:00100000:0.0:1746144669.118126:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746937088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.118147:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.118161:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 12 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.118169:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 12 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.118180:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.118193:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746937088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 67us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.118198:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6242 00000100:00100000:0.0:1746144669.118207:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6243 00000100:00100000:0.0:1746144669.118211:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746937344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.118217:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.118222:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 28 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.118230:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 28 pid: 29370 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.118240:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.118251:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16261e74-be72-4bb6-b857-d78345d984f7+28:1962:x1830964746937344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 40us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.118256:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6243 00000100:00100000:0.0:1746144669.118266:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6244 00000100:00100000:0.0:1746144669.118270:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746937472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.118276:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.118282:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 43 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.118291:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 43 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.118301:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.118302:0:7309:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.118305:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.118311:0:7309:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.118322:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.118335:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746937472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 64us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.118340:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6244 00000100:00100000:0.0:1746144669.118428:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830964747597952:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.118453:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.118501:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f399c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747598080:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.118512:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.118544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.118566:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937600 00000100:00100000:0.0:1746144669.118569:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937600 00002000:00100000:0.0:1746144669.118594:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1613824->1703935) req@ffff880136959180 x1830964746937600/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.118602:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959180 with x1830964746937600 ext(1613824->1703935) 00010000:00010000:0.0:1746144669.118607:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 24 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.118615:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 24 pid: 4758 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746144669.118620:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136959180 00000100:00100000:0.0:1746144669.118633:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 972 00000100:00100000:0.0:1746144669.118637:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1962:x1830964746937600:12345-192.168.204.23@tcp:4:multiop.0 00000100:00100000:0.0:1746144669.118813:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f39ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747598208:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.118824:0:22208:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.118861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.118904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.118919:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937728 00000100:00100000:0.0:1746144669.118922:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937728 00002000:00100000:0.0:1746144669.118949:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2686976->3145727) req@ffff88013695a300 x1830964746937728/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.118956:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a300 with x1830964746937728 ext(2686976->3145727) 00010000:00010000:0.0:1746144669.118962:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 20 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.118969:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 20 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746144669.118974:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013695a300 00000100:00100000:0.0:1746144669.118986:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937856 00000100:00100000:0.0:1746144669.118988:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937856 00002000:00100000:0.0:1746144669.118998:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3678207) req@ffff88009f39ad80 x1830964746937856/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.119004:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39ad80 with x1830964746937856 ext(3145728->3678207) 00010000:00010000:0.0:1746144669.119008:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 28 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.119015:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 28 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746144669.119026:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f39ad80 00000100:00100000:0.0:1746144669.119037:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 973 00000100:00100000:0.0:1746144669.119041:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+20:1960:x1830964746937728:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144669.119398:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 974 00000100:00100000:0.0:1746144669.119403:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746937856:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144669.119971:0:8389:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:8389:1830964747597824:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.119998:0:8389:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120032:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96ec00/0xa7c849b16e01bcf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcfb expref: 29 pid: 29370 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.120044:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747597440:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.120054:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090efe000/0xa7c849b16e01bda4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd5d expref: 11 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.120061:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747597568:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.120070:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96e800/0xa7c849b16e01bcee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcf4 expref: 42 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.120077:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747597696:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.120096:0:30345:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120103:0:30345:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120109:0:30345:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120128:0:30345:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120151:0:30345:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120158:0:30345:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120164:0:30345:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921c7800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.120167:0:30345:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120175:0:30345:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120191:0:30345:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.120197:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921c7800/0xa7c849b16e01beed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120371:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c449600/0xa7c849b16e01bd96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd4f expref: 11 pid: 4758 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.120389:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747597184:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.120400:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1ba000/0xa7c849b16e01bcd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fcd8 expref: 21 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.120408:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747597312:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.120426:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120432:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120437:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120453:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120459:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120464:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120470:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19ce00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144669.120472:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120478:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120488:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.120494:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01bee6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.120534:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746935936:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 14444us (14631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.120542:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12465 00000100:00100000:0.0:1746144669.120986:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1960:x1830964746936192:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 14602us (15039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.121002:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12466 00000100:00100000:1.0:1746144669.134078:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746937600:12345-192.168.204.23@tcp:4:multiop.0 Request processed in 15428us (15520us total) trans 21474840617 rc 0/0 00000100:00100000:1.0:1746144669.134092:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 972 00002000:00100000:1.0:1746144669.134105:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1613824->1703935) req@ffff880136959180 x1830964746937600/t21474840617(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.134116:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136959180 with x1830964746937600 ext(1613824->1703935) 00010000:00010000:1.0:1746144669.134127:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.134157:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746144669.134164:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136959180 00000100:00100000:2.0:1746144669.134841:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746936704:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22184us (23581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144669.134848:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 971 00002000:00100000:2.0:1746144669.134854:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009ea0df80 x1830964746936704/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.134870:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ea0df80 with x1830964746936704 ext(0->1048575) 00010000:00010000:2.0:1746144669.134877:0:31505:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 27 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.134886:0:31505:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 27 pid: 8450 timeout: 748 lvb_type: 0 00002000:00010000:2.0:1746144669.134892:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ea0df80 00000100:00100000:0.0:1746144669.139473:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746937728:12345-192.168.204.23@tcp:4:cat.0 Request processed in 20418us (20599us total) trans 21474840618 rc 0/0 00000100:00100000:0.0:1746144669.139487:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 973 00002000:00100000:0.0:1746144669.139499:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e8:0x0] (2686976->3145727) req@ffff88013695a300 x1830964746937728/t21474840618(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.139510:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013695a300 with x1830964746937728 ext(2686976->3145727) 00010000:00010000:0.0:1746144669.139521:0:31506:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.139536:0:31506:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746144669.139545:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013695a300 00000100:00100000:1.0:1746144669.142437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.142501:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746937984 00000100:00100000:2.0:1746144669.142512:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746937984 00010000:00010000:2.0:1746144669.142565:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.142604:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6245 00000100:00100000:2.0:1746144669.142613:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746937984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.142628:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.142650:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.142661:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.142685:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c5000/0xa7c849b16e01be53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->1703935) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdc6 expref: 26 pid: 4758 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.142717:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.142720:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.142725:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.142734:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.142758:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144669.142767:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142774:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142793:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.142795:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746937984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 184us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.142801:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6245 00010000:00010000:1.0:1746144669.142801:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142807:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142814:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135783400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144669.142818:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142826:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142835:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.142840:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135783400/0xa7c849b16e01bf02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.142890:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746936064:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 35903us (36899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.142897:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12469 00000100:00100000:0.0:1746144669.143508:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746937856:12345-192.168.204.23@tcp:4:cat.0 Request processed in 24103us (24602us total) trans 17179873397 rc 0/0 00000100:00100000:0.0:1746144669.143517:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 974 00002000:00100000:0.0:1746144669.143526:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->3678207) req@ffff88009f39ad80 x1830964746937856/t17179873397(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.143535:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f39ad80 with x1830964746937856 ext(3145728->3678207) 00010000:00010000:0.0:1746144669.143542:0:31508:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.143554:0:31508:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00002000:00010000:0.0:1746144669.143559:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f39ad80 00000100:00100000:0.0:1746144669.147284:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.147344:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746938112 00000100:00100000:3.0:1746144669.147354:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746938112 00010000:00010000:3.0:1746144669.147391:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.147428:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6246 00000100:00100000:3.0:1746144669.147435:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746938112:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.147447:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.147470:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.147481:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.147514:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7c4000/0xa7c849b16e01bdf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2686976->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd95 expref: 21 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.147539:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.147541:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.147546:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.147554:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.147583:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144669.147599:0:8389:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.147606:0:8389:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.147621:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+20:1962:x1830964746938112:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 186us (347us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144669.147626:0:8389:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.147627:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6246 00010000:00010000:0.0:1746144669.147633:0:8389:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.147639:0:8389:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.147646:0:8389:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5bb200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.147650:0:8389:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.147658:0:8389:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.147673:0:8389:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.147678:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bb200/0xa7c849b16e01bef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.147737:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746936448:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 41157us (41773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.147745:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12467 00000100:00100000:0.0:1746144669.149283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.149323:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746938240 00000100:00100000:2.0:1746144669.149329:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746938240 00010000:00010000:2.0:1746144669.149359:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.149392:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6247 00000100:00100000:2.0:1746144669.149398:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746938240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.149410:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.149426:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.149436:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.149453:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7c5c00/0xa7c849b16e01bdf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fd9c expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.149481:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.149483:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.149486:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.149493:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.149515:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.149538:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1962:x1830964746938240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.149543:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6247 00010000:00010000:0.0:1746144669.150643:0:22208:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150654:0:22208:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150675:0:22208:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150680:0:22208:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150687:0:22208:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150693:0:22208:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135783600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.150697:0:22208:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150704:0:22208:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150715:0:22208:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.150719:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01bf09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.150765:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746936320:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 43675us (44067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.150773:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12470 00000100:00100000:0.0:1746144669.155472:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.155597:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746938368 00000100:00100000:2.0:1746144669.155606:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746938368 00000100:00100000:2.0:1746144669.155673:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12471 00000100:00100000:2.0:1746144669.155681:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+20:29471:x1830964746938368:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.155700:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.155724:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe1a expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144669.155750:0:22208:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d9c, atime: 0x68140d9c, ctime: 0x68140d9d, blocks: 0x81f 00010000:00010000:2.0:1746144669.155774:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.155776:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.155783:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 21 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.155797:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 21 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.155807:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5ea00, rc 0) 00000100:00100000:2.0:1746144669.155858:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:29471:x1830964746938368:12345-192.168.204.23@tcp:101:cat.0 Request processed in 178us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.155864:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12471 00000100:00100000:0.0:1746144669.156319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.156395:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746938496 00000100:00100000:3.0:1746144669.156399:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746938496 00010000:00010000:3.0:1746144669.156418:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.156445:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6248 00000100:00100000:3.0:1746144669.156450:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746938496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.156460:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.156475:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.156490:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.156505:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a7e00/0xa7c849b16e01beae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdf0 expref: 26 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.156516:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.156517:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.156521:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.156527:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.156543:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.156572:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746938496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.156576:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6248 00010000:00010000:0.0:1746144669.156716:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156724:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156742:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156748:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156760:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156766:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135783800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.156770:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156776:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156785:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.156789:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783800/0xa7c849b16e01befb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.156832:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746935808:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 49965us (50854us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.156838:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12468 00000100:00100000:0.0:1746144669.159426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.159562:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746938752 00000100:00100000:2.0:1746144669.159571:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746938752 00000100:00100000:2.0:1746144669.159634:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10237 00000100:00100000:2.0:1746144669.159643:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746938752:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746144669.159693:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.159715:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0xa7c849b16e01be99 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fde9 expref: 12 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.159742:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.159746:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144669.159775:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.159787:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 301 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.159793:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 12 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.159799:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.159804:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.159835:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.159845:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 12 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.159858:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747598336:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.159954:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 12 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.159961:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 12 pid: 22257 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.159968:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747598464:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.159993:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 301 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.160000:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 301 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.160006:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747598592:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.160021:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.161759:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747598336:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.162942:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747598464:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.162975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.163036:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939008 00000100:00100000:2.0:1746144669.163042:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939008 00002000:00100000:2.0:1746144669.163102:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f399880 x1830964746939008/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.163111:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399880 with x1830964746939008 ext(1048576->2097151) 00002000:00010000:2.0:1746144669.163115:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f399880 00000100:00100000:2.0:1746144669.163160:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4852 00000100:00100000:2.0:1746144669.163167:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746939008:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.164112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.164183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.164209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.164280:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747598592:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.164318:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144669.165115:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939264 00000100:00100000:1.0:1746144669.165121:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939264 00010000:00010000:1.0:1746144669.165168:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 13 pid: 22257 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.165186:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939136 00000100:00100000:1.0:1746144669.165189:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939136 00010000:00010000:1.0:1746144669.165197:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 14 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.165213:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939392 00000100:00100000:1.0:1746144669.165215:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939392 00010000:00010000:1.0:1746144669.165224:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 302 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.165238:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6249 00000100:00100000:1.0:1746144669.165244:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+14:1960:x1830964746939264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.165257:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.165262:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 14 pid: 22257 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165272:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 14 pid: 22257 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165294:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9e6600/0xa7c849b16e01bc62 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc68 expref: 14 pid: 22257 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165312:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.165316:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.165328:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.165355:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+13:1960:x1830964746939264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 110us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.165361:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6249 00000100:00100000:1.0:1746144669.165376:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6250 00000100:00100000:1.0:1746144669.165380:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+12:1960:x1830964746939136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.165386:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.165390:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 12 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165398:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 12 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165412:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f29a600/0xa7c849b16e01be7d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fdcd expref: 12 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165420:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.165423:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.165427:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.165442:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16261e74-be72-4bb6-b857-d78345d984f7+11:1960:x1830964746939136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 61us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.165447:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6250 00000100:00100000:1.0:1746144669.165456:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6251 00000100:00100000:1.0:1746144669.165461:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1963:x1830964746939392:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.165467:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.165471:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 302 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165479:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 302 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165488:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dacd600/0xa7c849b16e01bc2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fc5a expref: 302 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.165496:0:7102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.165499:0:7102:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.165508:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.165514:0:7102:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.165530:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.165544:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136958700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1963:x1830964746939392:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 83us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.165549:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6251 00010000:00010000:2.0:1746144669.166198:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.166207:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144669.166676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000040:00080000:2.0:1746144669.167024:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3012, 88 off252008 00000004:00080000:2.0:1746144669.167032:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648375896621ns, next at 593496143484ns, rc = 0 00000100:00100000:1.0:1746144669.167045:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939648 00000100:00100000:1.0:1746144669.167052:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939648 00000100:00100000:1.0:1746144669.167086:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10238 00000040:00080000:2.0:1746144669.167090:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2921, 88 off243992 00000100:00100000:1.0:1746144669.167092:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29476:x1830964746939648:12345-192.168.204.23@tcp:101:cat.0 00000004:00080000:2.0:1746144669.167096:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648375961076ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.167109:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2922, 88 off244080 00000004:00080000:2.0:1746144669.167111:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648375976764ns, next at 593480289301ns, rc = 0 00010000:00010000:1.0:1746144669.167111:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:2.0:1746144669.167118:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3013, 88 off252096 00000004:00080000:2.0:1746144669.167121:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648375986724ns, next at 593496143484ns, rc = 0 00010000:00010000:1.0:1746144669.167126:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01bf1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe21 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746144669.167128:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3014, 88 off252184 00000004:00080000:2.0:1746144669.167130:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648375995896ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167154:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2923, 88 off244168 00000004:00080000:2.0:1746144669.167157:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648376022336ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.167162:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2924, 88 off244256 00000004:00080000:2.0:1746144669.167165:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648376030107ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.167170:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2925, 88 off244344 00000004:00080000:2.0:1746144669.167172:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648376037724ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.167177:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3015, 88 off252272 00000004:00080000:2.0:1746144669.167179:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648376044354ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167195:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2926, 88 off244432 00000004:00080000:2.0:1746144669.167197:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648376062626ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.167202:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3016, 88 off252360 00000004:00080000:2.0:1746144669.167205:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648376070304ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167210:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2927, 88 off244520 00000004:00080000:2.0:1746144669.167212:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648376077774ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.167217:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3017, 88 off252448 00000004:00080000:2.0:1746144669.167219:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648376084674ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167224:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3018, 88 off252536 00000004:00080000:2.0:1746144669.167226:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648376091507ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167231:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3019, 88 off252624 00000004:00080000:2.0:1746144669.167233:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648376098094ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167237:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3020, 88 off252712 00010000:00010000:1.0:1746144669.167238:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00000004:00080000:2.0:1746144669.167239:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648376104506ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.167244:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2928, 88 off244608 00000004:00080000:2.0:1746144669.167245:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648376110899ns, next at 593480289301ns, rc = 0 00010000:00010000:1.0:1746144669.167248:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.167257:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.167268:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.167273:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.167280:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:1.0:1746144669.175166:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746939008:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11990us (12183us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.175178:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4852 00002000:00100000:1.0:1746144669.175192:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009f399880 x1830964746939008/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.175201:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f399880 with x1830964746939008 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.175207:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f399880 00000100:00100000:0.0:1746144669.180566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.180594:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939776 00000100:00100000:0.0:1746144669.180603:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939776 00000100:00100000:0.0:1746144669.180646:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12472 00000100:00100000:0.0:1746144669.180654:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:29471:x1830964746939776:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.180672:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.180691:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe28 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144669.180716:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d9d, atime: 0x68140d9c, ctime: 0x68140d9d, blocks: 0x821 00010000:00010000:0.0:1746144669.180735:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.180737:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.180744:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.180758:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.180766:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fe000, rc 0) 00000100:00100000:0.0:1746144669.180805:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+22:29471:x1830964746939776:12345-192.168.204.23@tcp:101:cat.0 Request processed in 152us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.180810:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12472 00000100:00100000:0.0:1746144669.184108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.184384:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746939904 00000100:00100000:1.0:1746144669.184393:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746939904 00000100:00100000:1.0:1746144669.184438:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10239 00000100:00100000:1.0:1746144669.184446:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+11:29471:x1830964746939904:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.184467:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.184484:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe2f expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.184538:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.184547:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 12 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.184562:0:14708:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.184576:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 12 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.184587:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.184590:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144669.184593:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 12 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.184599:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f600, rc 0) 00000100:00100000:1.0:1746144669.184636:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+12:29471:x1830964746939904:12345-192.168.204.23@tcp:101:cat.0 Request processed in 192us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.184642:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10239 00000004:00010000:2.0:1746144669.198339:0:20319:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f399c00 reply state ffff880092088000 transno 8589944150 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144669.198357:0:20319:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144669.198493:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:29466:x1830964746938752:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 38846us (39069us total) trans 8589944150 rc 0/0 00000100:00100000:2.0:1746144669.198502:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10237 00000001:00080000:1.0:1746144669.198578:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944148 is committed 00000001:00080000:1.0:1746144669.198589:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944147 is committed 00000001:00080000:1.0:1746144669.198596:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944149 is committed 00000001:00080000:1.0:1746144669.198608:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944150 is committed 00000004:00080000:1.0:1746144669.198612:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2113 committed 00000004:00080000:1.0:1746144669.198617:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2201 committed 00000004:00080000:1.0:1746144669.198623:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2200 committed 00000004:00080000:1.0:1746144669.198624:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2199 committed 00000004:00080000:1.0:1746144669.198625:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2198 committed 00000004:00080000:1.0:1746144669.198626:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2112 committed 00000004:00080000:1.0:1746144669.198628:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2197 committed 00000004:00080000:1.0:1746144669.198629:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2111 committed 00000004:00080000:1.0:1746144669.198631:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2196 committed 00000004:00080000:1.0:1746144669.198632:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2110 committed 00000004:00080000:1.0:1746144669.198633:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2109 committed 00000004:00080000:1.0:1746144669.198634:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2108 committed 00000004:00080000:1.0:1746144669.198636:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2195 committed 00000004:00080000:1.0:1746144669.198638:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2194 committed 00000004:00080000:1.0:1746144669.198639:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2107 committed 00000004:00080000:1.0:1746144669.198641:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2106 committed 00000004:00080000:1.0:1746144669.198642:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2193 committed 00000001:00080000:1.0:1746144669.198653:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944138 is committed 00000001:00080000:1.0:1746144669.198666:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944146 is committed 00010000:00010000:1.0:1746144669.198703:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.198716:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.198727:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:1.0:1746144669.198739:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000100:00100000:2.0:1746144669.199281:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747598720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.199330:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.199368:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747599232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.199385:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.199401:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746144669.199405:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747598848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.199420:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.199430:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747599360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.199442:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.199461:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747598720 00000100:00100000:2.0:1746144669.199467:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747598720 00000100:00100000:2.0:1746144669.199492:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747599232 00000100:00100000:2.0:1746144669.199494:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747599232 00000100:00100000:2.0:1746144669.199502:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747598848 00000100:00100000:2.0:1746144669.199504:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747598848 00000100:00100000:2.0:1746144669.199511:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747599360 00000100:00100000:2.0:1746144669.199513:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747599360 00000100:00100000:2.0:1746144669.199523:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12473 00000100:00100000:2.0:1746144669.199528:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3295:x1830964747598720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144669.199677:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144669.199680:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:2.0:1746144669.199682:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:2.0:1746144669.199684:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.199685:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746144669.199705:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3295:x1830964747598720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (376us total) trans 21474840619 rc 0/0 00000100:00100000:2.0:1746144669.199710:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12473 00000100:00100000:2.0:1746144669.199719:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12474 00000100:00100000:2.0:1746144669.199724:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3295:x1830964747599232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.199784:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3295:x1830964747599232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (398us total) trans 21474840620 rc 0/0 00000100:00100000:2.0:1746144669.199789:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12474 00000100:00100000:2.0:1746144669.199796:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12475 00000100:00100000:2.0:1746144669.199800:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3295:x1830964747598848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746144669.199851:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144669.199853:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.199855:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:2.0:1746144669.199856:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.199858:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144669.199870:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3295:x1830964747598848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (449us total) trans 21474840621 rc 0/0 00000100:00100000:2.0:1746144669.199879:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12475 00000100:00100000:2.0:1746144669.199886:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12476 00000100:00100000:2.0:1746144669.199890:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3295:x1830964747599360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.199965:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3295:x1830964747599360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (521us total) trans 21474840622 rc 0/0 00000100:00100000:2.0:1746144669.199970:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12476 00000004:00080000:2.0:1746144669.200010:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a1180/2, rc 0, transno 21474840621 00000100:00100000:2.0:1746144669.200014:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747598848:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.200022:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0380/2, rc 0, transno 21474840622 00000100:00100000:2.0:1746144669.200025:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747599360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.200030:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0000/2, rc 0, transno 21474840619 00000100:00100000:2.0:1746144669.200033:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747598720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.200038:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a3100/2, rc 0, transno 21474840620 00000100:00100000:2.0:1746144669.200040:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747599232:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746144669.200116:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.200124:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.200131:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00000100:00100000:3.0:1746144669.200324:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747598976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.200365:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747599488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200379:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.200390:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746144669.200394:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747599104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200408:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.200416:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800937a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747599616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200430:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.200451:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747598976 00000100:00100000:3.0:1746144669.200454:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747598976 00000100:00100000:3.0:1746144669.200471:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747599488 00000100:00100000:3.0:1746144669.200473:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747599488 00000100:00100000:3.0:1746144669.200483:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747599104 00000100:00100000:3.0:1746144669.200484:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747599104 00000100:00100000:3.0:1746144669.200492:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747599616 00000100:00100000:3.0:1746144669.200494:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747599616 00000100:00100000:3.0:1746144669.200504:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12477 00000100:00100000:3.0:1746144669.200508:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747598976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200597:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830964747598976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (249us total) trans 21474840623 rc 0/0 00000100:00100000:3.0:1746144669.200602:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12477 00000100:00100000:3.0:1746144669.200611:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12478 00000100:00100000:3.0:1746144669.200615:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747599488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200680:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830964747599488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (299us total) trans 21474840624 rc 0/0 00000100:00100000:3.0:1746144669.200684:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12478 00000100:00100000:3.0:1746144669.200691:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12479 00000100:00100000:3.0:1746144669.200695:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747599104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144669.200744:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144669.200747:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.200748:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.200750:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.200752:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144669.200766:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830964747599104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (358us total) trans 21474840625 rc 0/0 00000100:00100000:3.0:1746144669.200772:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12479 00000100:00100000:3.0:1746144669.200780:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12480 00000100:00100000:3.0:1746144669.200784:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3293:x1830964747599616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.200846:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830964747599616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (414us total) trans 21474840626 rc 0/0 00000100:00100000:3.0:1746144669.200851:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12480 00000004:00080000:3.0:1746144669.200872:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a1c00/2, rc 0, transno 21474840625 00000100:00100000:3.0:1746144669.200875:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747599104:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144669.200880:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a0a80/2, rc 0, transno 21474840626 00000100:00100000:3.0:1746144669.200882:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747599616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144669.200887:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a3480/2, rc 0, transno 21474840623 00000100:00100000:3.0:1746144669.200889:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747598976:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144669.200894:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800937a2680/2, rc 0, transno 21474840624 00000100:00100000:3.0:1746144669.200896:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800937a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747599488:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746144669.201025:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5f800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144669.201030:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201037:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201051:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.201055:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746144669.201059:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201064:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f800/0xa7c849b16e01bf41 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201081:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201086:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201090:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201094:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5fe00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144669.201096:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201100:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201107:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:1.0:1746144669.201109:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144669.201111:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201116:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01bf25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201125:0:14710:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201129:0:14710:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201148:0:14710:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201152:0:14710:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5fa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144669.201154:0:14710:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201158:0:14710:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201163:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f35d900) 00010000:00010000:1.0:1746144669.201165:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144669.201167:0:14710:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201170:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01bf2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:1.0:1746144669.201218:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01bf1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe21 expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.201224:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01bf1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe21 expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.201234:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5e000, rc 0) 00000100:00100000:1.0:1746144669.201269:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29476:x1830964746939648:12345-192.168.204.23@tcp:101:cat.0 Request processed in 34177us (34594us total) trans 8589944151 rc 301/301 00000100:00100000:1.0:1746144669.201275:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10238 00010000:00010000:1.0:1746144669.201298:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.201307:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.201311:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.201315:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5e800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144669.201316:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.201321:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.201326:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.201328:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144669.201332:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 6 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.201339:0:3279:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 6 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.201346:0:3279:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 6 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.201369:0:3279:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 6 pid: 14708 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.201376:0:3279:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830964747599744:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.201407:0:3279:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.201521:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.201544:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.201557:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.201568:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.201578:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746144669.201581:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747599872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.201594:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.201601:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.201613:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.201626:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600000 00000100:00100000:1.0:1746144669.201629:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600000 00000100:00100000:1.0:1746144669.201644:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600512 00000100:00100000:1.0:1746144669.201645:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600512 00000100:00100000:1.0:1746144669.201656:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747599872 00000100:00100000:1.0:1746144669.201657:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747599872 00000100:00100000:1.0:1746144669.201667:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12481 00000100:00100000:1.0:1746144669.201672:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3296:x1830964747600000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.201793:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3296:x1830964747600000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (248us total) trans 17179873398 rc 0/0 00000100:00100000:1.0:1746144669.201799:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12481 00000100:00100000:1.0:1746144669.201806:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600384 00000100:00100000:1.0:1746144669.201809:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600384 00000100:00100000:1.0:1746144669.201820:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12482 00000100:00100000:1.0:1746144669.201824:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3296:x1830964747600512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.201899:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747600512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (329us total) trans 17179873399 rc 0/0 00000100:00100000:1.0:1746144669.201904:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12482 00000100:00100000:1.0:1746144669.201912:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12483 00000100:00100000:1.0:1746144669.201916:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3296:x1830964747599872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.202003:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747599872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (408us total) trans 17179873400 rc 0/0 00000100:00100000:1.0:1746144669.202009:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12483 00000100:00100000:1.0:1746144669.202017:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12484 00000100:00100000:1.0:1746144669.202021:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3296:x1830964747600384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.202090:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747600384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (476us total) trans 17179873401 rc 0/0 00000100:00100000:1.0:1746144669.202095:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12484 00000004:00080000:1.0:1746144669.202120:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce86a00/2, rc 0, transno 17179873400 00000100:00100000:1.0:1746144669.202127:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747599872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144669.202150:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce87480/2, rc 0, transno 17179873401 00000100:00100000:1.0:1746144669.202153:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144669.202158:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce87100/2, rc 0, transno 17179873398 00000100:00100000:1.0:1746144669.202161:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144669.202166:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce84700/2, rc 0, transno 17179873399 00000100:00100000:1.0:1746144669.202169:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.202191:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746144669.202195:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.202213:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.202227:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600896 00000100:00100000:1.0:1746144669.202229:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600896 00000100:00100000:1.0:1746144669.202242:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12485 00000100:00100000:1.0:1746144669.202246:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3296:x1830964747600896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.202322:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1830964747600896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (108us total) trans 17179873402 rc 0/0 00000100:00100000:1.0:1746144669.202328:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12485 00000004:00080000:1.0:1746144669.202370:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b572d80/2, rc 0, transno 17179873402 00000100:00100000:1.0:1746144669.202373:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747600896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.202740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.202812:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.202832:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.202844:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.202856:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.202866:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746144669.202869:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.202882:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.202892:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.202904:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.202934:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600128 00000100:00100000:3.0:1746144669.202938:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600128 00000100:00100000:3.0:1746144669.202952:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600640 00000100:00100000:3.0:1746144669.202954:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600640 00000100:00100000:3.0:1746144669.202961:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600256 00000100:00100000:3.0:1746144669.202963:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600256 00000100:00100000:3.0:1746144669.202970:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747600768 00000100:00100000:3.0:1746144669.202972:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747600768 00000100:00100000:3.0:1746144669.202980:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12486 00000100:00100000:3.0:1746144669.202984:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3293:x1830964747600128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.203076:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747600128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (243us total) trans 17179873403 rc 0/0 00000100:00100000:3.0:1746144669.203082:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12486 00000100:00100000:3.0:1746144669.203091:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12487 00000100:00100000:3.0:1746144669.203095:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3293:x1830964747600640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.203190:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747600640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (333us total) trans 17179873404 rc 0/0 00000100:00100000:3.0:1746144669.203196:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12487 00000100:00100000:3.0:1746144669.203205:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12488 00000100:00100000:3.0:1746144669.203209:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3293:x1830964747600256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.203280:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747600256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (396us total) trans 17179873405 rc 0/0 00000100:00100000:3.0:1746144669.203285:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12488 00000100:00100000:3.0:1746144669.203293:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12489 00000100:00100000:3.0:1746144669.203297:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3293:x1830964747600768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.203364:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3293:x1830964747600768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (459us total) trans 17179873406 rc 0/0 00000100:00100000:3.0:1746144669.203372:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12489 00000004:00080000:3.0:1746144669.203404:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce87800/2, rc 0, transno 17179873405 00000100:00100000:3.0:1746144669.203408:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144669.203414:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce85f80/2, rc 0, transno 17179873406 00000100:00100000:3.0:1746144669.203415:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144669.203421:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce86d80/2, rc 0, transno 17179873403 00000100:00100000:3.0:1746144669.203423:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144669.203428:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce85180/2, rc 0, transno 17179873404 00000100:00100000:3.0:1746144669.203430:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747600640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.203659:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940032 00000100:00100000:1.0:1746144669.203662:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940032 00000100:00100000:1.0:1746144669.203721:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10240 00000100:00100000:1.0:1746144669.203727:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29466:x1830964746940032:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.203743:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.203757:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe36 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.203802:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.203813:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 9 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.203829:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.203831:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144669.203834:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62de00, rc 0) 00000100:00100000:1.0:1746144669.203859:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29466:x1830964746940032:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 133us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.203865:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10240 00000100:00100000:0.0:1746144669.204667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.204754:0:3279:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3279:1830964747599744:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144669.204773:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.204780:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e800/0xa7c849b16e01bf17 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144669.204829:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940288 00000100:00100000:2.0:1746144669.204833:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940288 00000100:00100000:2.0:1746144669.204871:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4172 00000100:00100000:1.0:1746144669.205078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.205106:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29476:x1830964746940288:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144669.205273:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29476:x1830964746940288:12345-192.168.204.23@tcp:35:cat.0 Request processed in 396us (607us total) trans 8589944152 rc 0/0 00000100:00100000:2.0:1746144669.205279:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4172 00000100:00100000:2.0:1746144669.205289:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940416 00000100:00100000:2.0:1746144669.205291:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940416 00000100:00100000:2.0:1746144669.205305:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4173 00000100:00100000:2.0:1746144669.205309:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+7:29471:x1830964746940416:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144669.206401:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+7:29471:x1830964746940416:12345-192.168.204.23@tcp:49:cat.0 Request processed in 1088us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.206409:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4173 00000100:00100000:0.0:1746144669.212284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.212326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.213348:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940544 00000100:00100000:2.0:1746144669.213359:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940544 00000100:00100000:2.0:1746144669.213410:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940672 00000100:00100000:2.0:1746144669.213413:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940672 00000100:00100000:2.0:1746144669.213660:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10241 00000100:00100000:2.0:1746144669.213672:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29476:x1830964746940544:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.213697:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144669.213712:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10242 00010000:00010000:2.0:1746144669.213718:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0xa7c849b16e01bf56 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe3d expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.213722:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29466:x1830964746940672:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.213730:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.213738:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01bf5d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe44 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.213801:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.213816:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.213826:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144669.213856:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:2.0:1746144669.213860:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144669.213876:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.213897:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0xa7c849b16e01bf56 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.213911:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 299 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.213918:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.213920:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144669.213923:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ff000, rc 0) 00000100:00100000:2.0:1746144669.214005:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29476:x1830964746940544:12345-192.168.204.23@tcp:101:cat.0 Request processed in 336us (1732us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144669.214194:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff200/0xa7c849b16e01bf64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.214205:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff200/0xa7c849b16e01bf64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.214212:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff200/0xa7c849b16e01bf64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144669.214228:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:0.0:1746144669.214230:0:14709:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144669.214238:0:14709:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff200/0xa7c849b16e01bf64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.214254:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01bf5d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe44 expref: 10 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.214266:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff200/0xa7c849b16e01bf64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe44 expref: 9 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.214272:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.214274:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144669.214276:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0ff200, rc 0) 00000100:00100000:0.0:1746144669.214304:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29466:x1830964746940672:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 584us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.214311:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10242 00000100:00100000:2.0:1746144669.214452:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10241 00000100:00100000:0.0:1746144669.216119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.216167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.216187:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940928 00000100:00100000:0.0:1746144669.216191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.216195:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940928 00000100:00100000:0.0:1746144669.216204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.216228:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941184 00000100:00100000:1.0:1746144669.216230:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941184 00000100:00100000:0.0:1746144669.216250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.216255:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941056 00000100:00100000:1.0:1746144669.216258:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941056 00000100:00100000:1.0:1746144669.216268:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941312 00000100:00100000:1.0:1746144669.216270:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941312 00000100:00100000:1.0:1746144669.216280:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941440 00000100:00100000:1.0:1746144669.216281:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941440 00000100:00100000:1.0:1746144669.216295:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12490 00000100:00100000:1.0:1746144669.216301:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746940928:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.216315:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144669.216325:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12491 00010000:00010000:1.0:1746144669.216330:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe52 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.216332:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1963:x1830964746941184:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.216341:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.216352:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe60 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144669.216353:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d9d, atime: 0x68140d9c, ctime: 0x68140d9d, blocks: 0x809 00010000:00010000:1.0:1746144669.216369:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216371:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216379:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216392:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216403:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5113200, rc 0) 00000100:00100000:1.0:1746144669.216432:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746940928:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.216438:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12490 00000100:00100000:1.0:1746144669.216450:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12492 00000100:00100000:1.0:1746144669.216455:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746941056:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.216461:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.216468:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe59 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.216477:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216478:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216482:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216491:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216499:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62cc00, rc 0) 00000100:00100000:1.0:1746144669.216512:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746941056:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 57us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.216517:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12492 00000100:00100000:1.0:1746144669.216526:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12493 00000100:00100000:1.0:1746144669.216530:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746941312:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.216538:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.216545:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe67 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144669.216556:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d9c, atime: 0x68140d9c, ctime: 0x68140d9d, blocks: 0x821 00010000:00010000:1.0:1746144669.216562:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216563:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216567:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216575:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216581:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c222a00, rc 0) 00000100:00100000:1.0:1746144669.216595:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746941312:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 64us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.216600:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12493 00000100:00100000:1.0:1746144669.216609:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12494 00000100:00100000:1.0:1746144669.216612:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+10:1963:x1830964746941440:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144669.216617:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.216624:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe6e expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144669.216633:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4938848, mtime: 0x68140d9d, atime: 0x68140d9d, ctime: 0x68140d9d, blocks: 0x15f1 00010000:00010000:1.0:1746144669.216640:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216641:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.216645:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216653:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 11 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.216659:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437c000, rc 0) 00000100:00100000:1.0:1746144669.216673:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746941440:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 60us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.216678:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12494 00000100:00100000:1.0:1746144669.216709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.216745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144669.216828:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.216832:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.216838:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.216849:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.216856:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0ff000, rc 0) 00000100:00100000:2.0:1746144669.216903:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941568 00000100:00100000:2.0:1746144669.216907:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941568 00000100:00100000:2.0:1746144669.216942:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746940800 00000100:00100000:2.0:1746144669.216944:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746940800 00000100:00100000:2.0:1746144669.216963:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12495 00000100:00100000:2.0:1746144669.216968:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746941568:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144669.216973:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.216980:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe75 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144669.216995:0:8453:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d9d, atime: 0x68140d9d, ctime: 0x68140d9d, blocks: 0x1029 00010000:00010000:2.0:1746144669.217006:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.217007:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.217012:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.217020:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.217026:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ff800, rc 0) 00000100:00100000:3.0:1746144669.217105:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12496 00000100:00100000:3.0:1746144669.217112:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1960:x1830964746940800:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.217118:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.217125:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe4b expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.217149:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.217150:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.217154:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 43 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.217162:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 43 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.217168:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19c800, rc 0) 00000100:00100000:1.0:1746144669.217992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.218700:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1963:x1830964746941184:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2365us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.218708:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12491 00000100:00100000:0.0:1746144669.218731:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941696 00000100:00100000:0.0:1746144669.218736:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941696 00000100:00100000:1.0:1746144669.218747:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.218754:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941824 00000100:00100000:0.0:1746144669.218756:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941824 00000100:00100000:0.0:1746144669.218765:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12497 00000100:00100000:0.0:1746144669.218772:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746941696:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:1.0:1746144669.218774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144669.218785:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.218797:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe7c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.218815:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.218817:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.218823:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.218836:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.218845:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fea00, rc 0) 00000100:00100000:1.0:1746144669.218849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.218869:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746941696:12345-192.168.204.23@tcp:101:cat.0 Request processed in 97us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.218872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.218874:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12497 00000100:00100000:0.0:1746144669.218886:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746941952 00000100:00100000:0.0:1746144669.218889:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746941952 00000100:00100000:0.0:1746144669.218897:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746942336 00000100:00100000:0.0:1746144669.218898:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746942336 00000100:00100000:0.0:1746144669.218905:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12498 00000100:00100000:0.0:1746144669.218910:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746941824:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.218916:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.218922:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe83 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.218937:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746942208 00000100:00100000:1.0:1746144669.218941:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746942208 00010000:00010000:0.0:1746144669.218945:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.218947:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.218951:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.218960:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746144669.218968:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b573800 x1830964746942208/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746144669.218971:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fe600, rc 0) 00002000:00100000:1.0:1746144669.218977:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573800 with x1830964746942208 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.218981:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b573800 00000100:00100000:0.0:1746144669.218991:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746941824:12345-192.168.204.23@tcp:101:cat.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.218996:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4853 00000100:00100000:0.0:1746144669.218997:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12498 00000100:00100000:1.0:1746144669.219001:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746942208:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.219006:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12499 00000100:00100000:0.0:1746144669.219011:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1960:x1830964746941952:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.219017:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.219024:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe8a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.219036:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.219037:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.219040:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 46 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.219049:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 46 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.219055:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fec00, rc 0) 00000100:00100000:0.0:1746144669.219068:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1960:x1830964746941952:12345-192.168.204.23@tcp:101:cat.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.219076:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12499 00000100:00100000:0.0:1746144669.219084:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12500 00000100:00100000:0.0:1746144669.219087:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746942336:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.219092:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.219097:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe91 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.219104:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.219105:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.219108:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 46 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.219116:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 46 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.219122:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fee00, rc 0) 00000100:00100000:0.0:1746144669.219131:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1963:x1830964746942336:12345-192.168.204.23@tcp:101:cat.0 Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.219150:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12500 00000100:00100000:3.0:1746144669.219271:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1960:x1830964746940800:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2156us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.219281:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12496 00000100:00100000:2.0:1746144669.219398:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746941568:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2428us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.219404:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12495 00000100:00100000:0.0:1746144669.223256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.223462:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746942464 00000100:00100000:1.0:1746144669.223473:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746942464 00000100:00100000:1.0:1746144669.223898:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12501 00000100:00100000:1.0:1746144669.223911:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746942464:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.223941:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.223962:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe98 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.223985:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.223987:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.223997:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.224013:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.224025:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e87c600, rc 0) 00000100:00100000:1.0:1746144669.224341:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746942464:12345-192.168.204.23@tcp:101:cat.0 Request processed in 430us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.224348:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12501 00000100:00100000:1.0:1746144669.228084:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1961:x1830964746942208:12345-192.168.204.23@tcp:3:cat.0 Request processed in 9070us (9297us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.228096:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4853 00002000:00100000:1.0:1746144669.228108:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012b573800 x1830964746942208/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.228117:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b573800 with x1830964746942208 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.228123:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b573800 00000100:00100000:0.0:1746144669.235074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.235118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.235172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.235185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.235273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.235301:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746942848 00000100:00100000:0.0:1746144669.235311:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746942848 00000100:00100000:0.0:1746144669.235366:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746943104 00000100:00100000:0.0:1746144669.235368:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746943104 00000100:00100000:0.0:1746144669.235384:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746943488 00000100:00100000:0.0:1746144669.235385:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746943488 00002000:00100000:0.0:1746144669.235400:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012e12ed80 x1830964746943488/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.235409:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ed80 with x1830964746943488 ext(0->1048575) 00002000:00010000:0.0:1746144669.235415:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12ed80 00000100:00100000:0.0:1746144669.235423:0:31506:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746943616 00000100:00100000:0.0:1746144669.235425:0:31506:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746943616 00002000:00100000:0.0:1746144669.235434:0:31506:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012e12ea00 x1830964746943616/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.235440:0:31506:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ea00 with x1830964746943616 ext(1048576->2097151) 00002000:00010000:0.0:1746144669.235443:0:31506:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12ea00 00000100:00100000:0.0:1746144669.235454:0:31506:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4854 00000100:00100000:0.0:1746144669.235462:0:31506:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746942848:12345-192.168.204.23@tcp:3:lfs.0 00000100:00100000:2.0:1746144669.235491:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4855 00000100:00100000:3.0:1746144669.235498:0:31505:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4856 00010000:00010000:0.0:1746144669.235498:0:31506:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.235505:0:31505:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746943488:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:0.0:1746144669.235512:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144669.235513:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746943104:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144669.235514:0:31506:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.235519:0:31506:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.235532:0:31506:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.235541:0:31508:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.235554:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.235556:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.235559:0:31508:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.235568:0:31508:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.235652:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4857 00000100:00100000:1.0:1746144669.235660:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746943616:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.236131:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746942720 00000100:00100000:1.0:1746144669.236153:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746942720 00000100:00100000:1.0:1746144669.236181:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12502 00000100:00100000:1.0:1746144669.236186:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+25:29471:x1830964746942720:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.236195:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.236207:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fe9f expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.236223:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.236224:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.236230:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 26 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.236241:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 26 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.236250:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e87c400, rc 0) 00000100:00100000:1.0:1746144669.236300:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:29471:x1830964746942720:12345-192.168.204.23@tcp:101:cat.0 Request processed in 114us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.236306:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12502 00000100:00100000:2.0:1746144669.241462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.241486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.241521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.242064:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746943872 00000100:00100000:0.0:1746144669.242076:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746943872 00002000:00100000:0.0:1746144669.242121:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009b730700 x1830964746943872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.242131:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730700 with x1830964746943872 ext(1048576->2097151) 00002000:00010000:0.0:1746144669.242155:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b730700 00000100:00100000:0.0:1746144669.242171:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746944256 00000100:00100000:0.0:1746144669.242174:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746944256 00002000:00100000:0.0:1746144669.242185:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b730e00 x1830964746944256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.242192:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730e00 with x1830964746944256 ext(1048576->2097151) 00002000:00010000:0.0:1746144669.242196:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b730e00 00000100:00100000:0.0:1746144669.242218:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746944128 00000100:00100000:0.0:1746144669.242221:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746944128 00000100:00100000:0.0:1746144669.242240:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4858 00000100:00100000:3.0:1746144669.242248:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4859 00000100:00100000:0.0:1746144669.242248:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746943872:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144669.242253:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746944256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.243512:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4860 00000100:00100000:0.0:1746144669.243519:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746944128:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144669.243547:0:1570:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.243560:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.243562:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.243566:0:1570:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.243578:0:1570:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.246666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.246701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.246735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.246922:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746944768 00000100:00100000:1.0:1746144669.246939:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746944768 00000100:00100000:1.0:1746144669.247247:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746944896 00000100:00100000:1.0:1746144669.247251:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746944896 00000100:00100000:2.0:1746144669.247267:0:21334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746945024 00000100:00100000:2.0:1746144669.247271:0:21334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746945024 00000100:00100000:2.0:1746144669.247314:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4861 00000100:00100000:2.0:1746144669.247321:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1962:x1830964746944768:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:2.0:1746144669.247359:0:21334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.247374:0:21334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.247376:0:21334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.247380:0:21334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.247393:0:21334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.247647:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4862 00000100:00100000:1.0:1746144669.247653:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1962:x1830964746945024:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144669.247674:0:31509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.247683:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.247685:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.247688:0:31509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.247696:0:31509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.248316:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4863 00000100:00100000:3.0:1746144669.248324:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1962:x1830964746944896:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144669.248342:0:21597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.248349:0:21597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.248351:0:21597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.248353:0:21597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.248361:0:21597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.252820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.253000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.253322:0:31507:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:3.0:1746144669.253333:0:31507:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_012' 00000100:00100000:2.0:1746144669.253804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.256384:0:8457:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:1.0:1746144669.256403:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746945408 00000100:00100000:1.0:1746144669.256418:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746945408 00000100:00100000:1.0:1746144669.256466:0:8457:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:1.0:1746144669.256470:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746945664 00000100:00100000:1.0:1746144669.256472:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746945664 00000100:00100000:1.0:1746144669.256483:0:8457:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:1.0:1746144669.256486:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746945920 00000100:00100000:1.0:1746144669.256488:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746945920 00002000:00100000:1.0:1746144669.256508:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b733480 x1830964746945920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.256518:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b733480 with x1830964746945920 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.256523:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b733480 00010000:00010000:3.0:1746144669.257171:0:31508:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257183:0:31508:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257578:0:31508:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257585:0:31508:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6fe600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144669.257589:0:31508:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257596:0:31508:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257614:0:31508:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257618:0:31508:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0xa7c849b16e01bfcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.257706:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1963:x1830964746943104:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 22206us (22532us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.257714:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4855 00000100:00100000:3.0:1746144669.257744:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4864 00000100:00100000:3.0:1746144669.257752:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1963:x1830964746945408:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144669.257789:0:31508:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257800:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.257802:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.257808:0:31508:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.257820:0:31508:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.260871:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1961:x1830964746943616:12345-192.168.204.23@tcp:3:cat.0 Request processed in 25202us (25587us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.260882:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4857 00002000:00100000:1.0:1746144669.260892:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88012e12ea00 x1830964746943616/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.260909:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ea00 with x1830964746943616 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.260913:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12ea00 00000100:00100000:1.0:1746144669.260954:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4865 00000100:00100000:1.0:1746144669.260963:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1963:x1830964746945664:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144669.260995:0:21596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.261007:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.261008:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.261014:0:21596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.261026:0:21596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.267572:0:3147:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4866 00000100:00100000:2.0:1746144669.267602:0:3147:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746945920:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.269705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144669.270068:0:31506:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.270082:0:31506:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.270090:0:31506:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.270097:0:31506:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0ffe00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144669.270101:0:31506:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.270110:0:31506:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.270129:0:31506:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.270176:0:31506:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffe00/0xa7c849b16e01bfc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31506 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.270258:0:31506:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1963:x1830964746942848:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 34794us (35136us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.270272:0:31506:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4854 00000100:00100000:2.0:1746144669.271287:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746946176 00000100:00100000:2.0:1746144669.271299:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746946176 00000100:00100000:2.0:1746144669.271356:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10243 00000100:00100000:2.0:1746144669.271365:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+7:29478:x1830964746946176:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.271385:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.271404:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fea6 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.271515:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271527:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271537:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271552:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271557:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271561:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271667:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271676:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.271683:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.271713:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.271724:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 8 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.271735:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747601024:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.271823:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.272767:0:31505:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746943488:12345-192.168.204.23@tcp:3:cat.0 Request processed in 37258us (37576us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.272778:0:31505:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4856 00002000:00100000:3.0:1746144669.272787:0:31505:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88012e12ed80 x1830964746943488/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.272797:0:31505:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e12ed80 with x1830964746943488 ext(0->1048575) 00002000:00010000:3.0:1746144669.272801:0:31505:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e12ed80 00000100:00100000:1.0:1746144669.281346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.281446:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747601024:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.281486:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144669.284126:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746946304 00000100:00100000:1.0:1746144669.284153:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746946304 00010000:00010000:1.0:1746144669.284196:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.284231:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6252 00000100:00100000:1.0:1746144669.284238:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+9:1960:x1830964746946304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.284252:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.284260:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.284272:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.284292:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1c00/0xa7c849b16e01bed8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe13 expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.284315:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.284320:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.284329:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.284335:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.284361:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.284409:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1960:x1830964746946304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 171us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.284415:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6252 00000100:00100000:1.0:1746144669.284762:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746943872:12345-192.168.204.23@tcp:3:cat.0 Request processed in 42514us (43313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.284770:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4858 00002000:00100000:1.0:1746144669.284784:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88009b730700 x1830964746943872/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.284793:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730700 with x1830964746943872 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.284796:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b730700 00010000:00010000:3.0:1746144669.285879:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.285888:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144669.285905:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144669.286022:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286028:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286034:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286039:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c02f600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.286042:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286048:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286060:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.286062:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746144669.286065:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286069:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c01a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286083:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286087:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286091:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286095:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c02fa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.286096:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286101:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286106:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144669.286108:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.286110:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286114:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fa00/0xa7c849b16e01c00c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286121:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286127:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286130:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286168:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c02f800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.286171:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286175:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286180:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ced8a00) 00010000:00010000:3.0:1746144669.286182:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.286184:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286189:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02f800/0xa7c849b16e01c013 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.286236:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c005 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fea6 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.286242:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fea6 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.286249:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c02fc00, rc 0) 00000100:00100000:3.0:1746144669.286282:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+8:29478:x1830964746946176:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 14917us (16585us total) trans 8589944153 rc 301/301 00000100:00100000:3.0:1746144669.286293:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10243 00010000:00010000:2.0:1746144669.291191:0:21334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.291210:0:21334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.291218:0:21334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.291227:0:21334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f69e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144669.291231:0:21334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.291239:0:21334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.291258:0:21334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.291264:0:21334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01bfe2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.291366:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1962:x1830964746944768:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 44040us (44704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144669.291377:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4861 00000100:00100000:3.0:1746144669.291720:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746944256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 49465us (50232us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.291727:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4859 00002000:00100000:3.0:1746144669.291738:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88009b730e00 x1830964746944256/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.291747:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b730e00 with x1830964746944256 ext(1048576->2097151) 00002000:00010000:3.0:1746144669.291752:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b730e00 00010000:00010000:0.0:1746144669.299716:0:31509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.299734:0:31509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.299742:0:31509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.299749:0:31509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e87ca00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.299753:0:31509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.299761:0:31509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.299781:0:31509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.299787:0:31509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e87ca00/0xa7c849b16e01bfe9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.302593:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1962:x1830964746945024:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 54926us (55842us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.302607:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4862 00010000:00010000:0.0:1746144669.304607:0:1570:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.304625:0:1570:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.304639:0:1570:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.304647:0:1570:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130ea0600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.304651:0:1570:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.304660:0:1570:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.304681:0:1570:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.304686:0:1570:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130ea0600/0xa7c849b16e01bfdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.311505:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746944128:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 67968us (69965us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144669.311521:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4860 00010000:00010000:3.0:1746144669.311937:0:21597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.311951:0:21597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.311958:0:21597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.311965:0:21597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135783000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144669.311969:0:21597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.311977:0:21597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.311996:0:21597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312007:0:21597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783000/0xa7c849b16e01bff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.312071:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746944896:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 63747us (65367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.312078:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4863 00010000:00010000:3.0:1746144669.312794:0:31508:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312802:0:31508:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312809:0:31508:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312814:0:31508:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135783a00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144669.312816:0:31508:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312821:0:31508:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312832:0:31508:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.312838:0:31508:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783a00/0xa7c849b16e01bff7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.312873:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746945408:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 55122us (60063us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.312880:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4864 00000100:00100000:0.0:1746144669.322515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.322556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.322587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.322615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.322622:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746946560 00000100:00100000:2.0:1746144669.322633:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746946560 00002000:00100000:2.0:1746144669.322693:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093988a80 x1830964746946560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.322704:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988a80 with x1830964746946560 ext(2097152->3145727) 00002000:00010000:2.0:1746144669.322709:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093988a80 00000100:00100000:2.0:1746144669.322726:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746946816 00000100:00100000:2.0:1746144669.322728:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746946816 00002000:00100000:2.0:1746144669.322739:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093988700 x1830964746946816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.322750:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988700 with x1830964746946816 ext(3145728->4194303) 00002000:00010000:2.0:1746144669.322752:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093988700 00000100:00100000:2.0:1746144669.322761:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746947072 00000100:00100000:2.0:1746144669.322763:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746947072 00002000:00100000:2.0:1746144669.322775:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093988000 x1830964746947072/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.322780:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988000 with x1830964746947072 ext(2097152->3145727) 00002000:00010000:2.0:1746144669.322783:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988000 00000100:00100000:2.0:1746144669.322791:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746947328 00000100:00100000:2.0:1746144669.322793:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746947328 00002000:00100000:2.0:1746144669.322802:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093989f80 x1830964746947328/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.322807:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989f80 with x1830964746947328 ext(3145728->4194303) 00002000:00010000:2.0:1746144669.322810:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093989f80 00000100:00100000:2.0:1746144669.322823:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4867 00000100:00100000:2.0:1746144669.322831:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746946560:12345-192.168.204.23@tcp:3:cat.0 00010000:00010000:0.0:1746144669.322981:0:21596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.322992:0:21596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.323001:0:21596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.323008:0:21596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e87d200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144669.323016:0:21596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.323024:0:21596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.323040:0:21596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.323046:0:21596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e87d200/0xa7c849b16e01bffe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.323506:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1963:x1830964746945664:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 62543us (70503us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144669.323513:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4865 00000100:00100000:0.0:1746144669.323533:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4868 00000100:00100000:0.0:1746144669.323539:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1962:x1830964746946816:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144669.324036:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4869 00000100:00100000:2.0:1746144669.324045:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746947072:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.324777:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4870 00000100:00100000:0.0:1746144669.324784:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746947328:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.332368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.332420:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746947584 00000100:00100000:0.0:1746144669.332431:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746947584 00000100:00100000:0.0:1746144669.332472:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10244 00000100:00100000:0.0:1746144669.332479:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29466:x1830964746947584:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:0.0:1746144669.332531:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.332557:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff200/0xa7c849b16e01bf64 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe44 expref: 8 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.332578:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.332583:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144669.332616:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.332628:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.332634:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.332663:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.332672:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.332684:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747601152:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.332746:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.333384:0:3147:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746945920:12345-192.168.204.23@tcp:3:cat.0 Request processed in 65797us (79578us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.333393:0:3147:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4866 00002000:00100000:3.0:1746144669.333400:0:3147:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88009b733480 x1830964746945920/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.333409:0:3147:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b733480 with x1830964746945920 ext(1048576->2097151) 00002000:00010000:3.0:1746144669.333412:0:3147:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b733480 00000100:00100000:0.0:1746144669.334263:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.334282:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746947840 00000100:00100000:0.0:1746144669.334286:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746947840 00000100:00100000:0.0:1746144669.334311:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10245 00000100:00100000:0.0:1746144669.334315:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29480:x1830964746947840:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144669.334328:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.334340:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628000/0xa7c849b16e01c02f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fead expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.334423:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334434:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334442:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334453:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334458:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334463:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334554:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334560:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334565:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144669.334572:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:0.0:1746144669.334651:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334657:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334663:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334668:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f628200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144669.334671:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334677:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334684:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.334686:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746144669.334689:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334693:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628200/0xa7c849b16e01c044 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334705:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334710:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334714:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334718:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f629e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144669.334720:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334726:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334731:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144669.334733:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144669.334735:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334738:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334744:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334749:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334755:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334759:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f628c00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144669.334761:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334765:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334769:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041300) 00010000:00010000:0.0:1746144669.334770:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144669.334772:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334775:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628c00/0xa7c849b16e01c03d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144669.334805:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628000/0xa7c849b16e01c02f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fead expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.334811:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628000/0xa7c849b16e01c02f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fead expref: 301 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.334818:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f628000, rc 0) 00000100:00100000:0.0:1746144669.334838:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29480:x1830964746947840:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 523us (577us total) trans 8589944154 rc 301/301 00000100:00100000:0.0:1746144669.334844:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10245 00000100:00100000:0.0:1746144669.362100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.362494:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746946560:12345-192.168.204.23@tcp:3:cat.0 Request processed in 39661us (39988us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144669.362495:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746946816:12345-192.168.204.23@tcp:3:cat.0 Request processed in 38955us (39936us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.362504:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4867 00002000:00100000:3.0:1746144669.362521:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff880093988a80 x1830964746946560/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.362530:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988a80 with x1830964746946560 ext(2097152->3145727) 00002000:00010000:3.0:1746144669.362536:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093988a80 00000100:00100000:1.0:1746144669.362576:0:7309:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746947968 00000100:00100000:1.0:1746144669.362587:0:7309:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746947968 00010000:00010000:1.0:1746144669.362629:0:7309:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 300 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.362713:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747601152:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.362739:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144669.362800:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6253 00000100:00100000:1.0:1746144669.362808:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1962:x1830964746947968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.362821:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.362827:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 300 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.362838:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 300 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.362861:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0xa7c849b16e01bf6b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe3d expref: 300 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.362890:0:7309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.362894:0:7309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.362901:0:7309:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.362907:0:7309:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.362938:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144669.362949:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.362955:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144669.362978:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1962:x1830964746947968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 171us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.362983:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6253 00000004:00010000:3.0:1746144669.363102:0:20319:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009398ad80 reply state ffff8800941a9000 transno 8589944155 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144669.363109:0:20319:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746144669.363254:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29466:x1830964746947584:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 30774us (30896us total) trans 8589944155 rc 0/0 00000100:00100000:3.0:1746144669.363261:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10244 00000100:00100000:0.0:1746144669.363631:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4868 00002000:00100000:0.0:1746144669.363640:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff880093988700 x1830964746946816/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.363648:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988700 with x1830964746946816 ext(3145728->4194303) 00002000:00010000:0.0:1746144669.363651:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093988700 00000100:00100000:0.0:1746144669.371459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.372383:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948224 00000100:00100000:0.0:1746144669.372387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.372391:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948224 00000100:00100000:0.0:1746144669.372418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.372443:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948096 00000100:00100000:2.0:1746144669.372444:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948096 00000100:00100000:0.0:1746144669.372525:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948352 00000100:00100000:0.0:1746144669.372529:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948352 00000100:00100000:0.0:1746144669.372550:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12503 00000100:00100000:3.0:1746144669.372565:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12504 00000100:00100000:3.0:1746144669.372572:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746948096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.372587:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.372600:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152feb4 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.372610:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746948224:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.372619:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.372619:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.372620:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.372626:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152febb expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.372627:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 28 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.372642:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 29 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.372650:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4400, rc 0) 00010000:00010000:0.0:1746144669.372654:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.372656:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.372661:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.372670:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.372676:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f628c00, rc 0) 00000100:00100000:3.0:1746144669.372687:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746948096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 115us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.372691:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746948224:12345-192.168.204.23@tcp:101:cat.0 Request processed in 136us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.372693:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12504 00000100:00100000:0.0:1746144669.372696:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12503 00000100:00100000:0.0:1746144669.372706:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12505 00000100:00100000:0.0:1746144669.372710:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746948352:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.372716:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.372723:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fec2 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.372732:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.372733:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.372736:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.372744:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.372751:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f629e00, rc 0) 00000100:00100000:3.0:1746144669.373146:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746948352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 420us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.373153:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12505 00000100:00100000:0.0:1746144669.375860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.375950:0:14707:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948480 00000100:00100000:2.0:1746144669.375958:0:14707:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948480 00000100:00100000:2.0:1746144669.376009:0:14707:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:2.0:1746144669.376016:0:14707:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:087a468c-8f92-434b-ae24-50378d554a48+15:1960:x1830964746948480:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1746144669.376060:0:14707:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:087a468c-8f92-434b-ae24-50378d554a48+15:1960:x1830964746948480:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.376065:0:14707:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:3.0:1746144669.376205:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746947072:12345-192.168.204.23@tcp:3:cat.0 Request processed in 52162us (53616us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.376213:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4869 00002000:00100000:3.0:1746144669.376220:0:21334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff880093988000 x1830964746947072/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.376228:0:21334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093988000 with x1830964746947072 ext(2097152->3145727) 00002000:00010000:3.0:1746144669.376232:0:21334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093988000 00000100:00100000:1.0:1746144669.376260:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746947328:12345-192.168.204.23@tcp:3:cat.0 Request processed in 51476us (53642us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.376267:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4870 00002000:00100000:1.0:1746144669.376273:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093989f80 x1830964746947328/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.376281:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093989f80 with x1830964746947328 ext(3145728->4194303) 00002000:00010000:1.0:1746144669.376284:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093989f80 00000100:00100000:0.0:1746144669.377438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.377478:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948608 00000100:00100000:3.0:1746144669.377486:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948608 00000100:00100000:3.0:1746144669.377518:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12506 00000100:00100000:0.0:1746144669.377519:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.377524:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746948608:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144669.377535:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.377548:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fec9 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.377553:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948736 00000100:00100000:0.0:1746144669.377559:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948736 00010000:00010000:3.0:1746144669.377569:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.377576:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 27 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.377582:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 44 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.377588:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.377590:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.377593:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.377597:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10246 00000100:00100000:0.0:1746144669.377603:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29476:x1830964746948736:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.377619:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.377621:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 44 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.377631:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 44 pid: 4760 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.377633:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628400/0xa7c849b16e01c06e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fed0 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.377640:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747601280:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.377686:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628400/0xa7c849b16e01c06e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fed0 expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.377699:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628400/0xa7c849b16e01c06e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fed0 expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.377710:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 27 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.377717:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.377719:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 27 pid: 7257 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.377720:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144669.377723:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f628400, rc 0) 00000100:00100000:3.0:1746144669.377727:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747601408:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.377743:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.377751:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.377757:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144669.377759:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29476:x1830964746948736:12345-192.168.204.23@tcp:101:cat.0 Request processed in 156us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144669.377762:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f628e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144669.377765:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.377766:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144669.377766:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10246 00010000:00010000:2.0:1746144669.377771:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.377774:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.377781:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747601536:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.377783:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.377786:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144669.377789:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.377793:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628e00/0xa7c849b16e01c028 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144669.377797:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.388727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.388762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.388780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.388800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.388832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.388856:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746949376 00000100:00100000:0.0:1746144669.388864:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746949376 00000100:00100000:3.0:1746144669.388868:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948992 00000100:00100000:3.0:1746144669.388879:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948992 00000100:00100000:0.0:1746144669.388906:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12507 00000100:00100000:0.0:1746144669.388913:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746949376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.388916:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 28 pid: 7257 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.388939:0:8389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.388955:0:8389:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f628000/0xa7c849b16e01c075 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fede expref: -99 pid: 8389 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.388961:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746949248 00000100:00100000:3.0:1746144669.388963:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746949248 00010000:00010000:3.0:1746144669.388978:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 47 pid: 4760 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.388978:0:8389:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.388987:0:8389:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f628000/0xa7c849b16e01c075 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fede expref: 47 pid: 8389 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144669.388991:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746949120 00000100:00100000:3.0:1746144669.388993:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746949120 00010000:00010000:0.0:1746144669.388998:0:8389:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f628000/0xa7c849b16e01c075 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fede expref: 47 pid: 8389 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.389001:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.389013:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6254 00010000:00010000:0.0:1746144669.389016:0:8389:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f628000, rc 0) 00000100:00100000:3.0:1746144669.389020:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746948992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.389032:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.389052:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 28 pid: 7257 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.389054:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746949376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 142us (221us total) trans 0 rc 301/301 00010000:00010000:3.0:1746144669.389060:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 28 pid: 7257 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.389060:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12507 00010000:00010000:3.0:1746144669.389081:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.389122:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746948992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 102us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.389128:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6254 00000100:00100000:2.0:1746144669.389160:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6255 00000100:00100000:3.0:1746144669.389168:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6256 00000100:00100000:3.0:1746144669.389173:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1963:x1830964746949120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746144669.389179:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746949248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.389180:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.389187:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.389191:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.389194:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:1.0:1746144669.389239:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746948864 00000100:00100000:1.0:1746144669.389243:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746948864 00000100:00100000:1.0:1746144669.389264:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10247 00000100:00100000:1.0:1746144669.389269:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29480:x1830964746948864:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144669.389284:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.389295:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c07c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fed7 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.389334:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c07c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fed7 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.389344:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c07c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fed7 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.389357:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.389360:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144669.389362:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e87dc00, rc 0) 00000100:00100000:1.0:1746144669.389383:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29480:x1830964746948864:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 115us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.389388:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10247 00010000:00010000:3.0:1746144669.389391:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144669.389394:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 45 pid: 4760 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.389405:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 45 pid: 4760 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.389408:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1963:x1830964746949120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 234us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.389413:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6256 00010000:00010000:2.0:1746144669.389417:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.389419:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.389425:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.389431:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.389452:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c19c800/0xa7c849b16e01bf9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe4b expref: 45 pid: 4760 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.389456:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.389466:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747601280:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.389466:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747601664:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.389476:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c052 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feb4 expref: 27 pid: 7257 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.389484:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747601408:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.389493:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01bf72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe52 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.389499:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747601536:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.389508:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6180 going to sleep for 11 seconds 00010000:00010000:3.0:1746144669.389521:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.389533:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4a00, rc 0) 00000100:00100000:3.0:1746144669.389551:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746948608:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 12028us (12118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.389557:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12506 00000100:00100000:0.0:1746144669.398688:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.398718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.398742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.398754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.398818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.398851:0:3147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746949888 00000100:00100000:0.0:1746144669.398860:0:3147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746949888 00002000:00100000:0.0:1746144669.398904:0:3147:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d0c4700 x1830964746949888/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.398915:0:3147:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4700 with x1830964746949888 ext(3145728->4194303) 00002000:00010000:0.0:1746144669.398930:0:3147:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c4700 00000100:00100000:0.0:1746144669.398944:0:3147:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746949760 00000100:00100000:0.0:1746144669.398946:0:3147:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746949760 00002000:00100000:0.0:1746144669.398956:0:3147:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d0c6300 x1830964746949760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.398962:0:3147:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6300 with x1830964746949760 ext(2097152->3145727) 00002000:00010000:0.0:1746144669.398965:0:3147:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c6300 00000100:00100000:0.0:1746144669.398979:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746950272 00000100:00100000:0.0:1746144669.398980:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746950272 00002000:00100000:0.0:1746144669.398992:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c4e00 x1830964746950272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.398998:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4e00 with x1830964746950272 ext(3145728->4194303) 00002000:00010000:0.0:1746144669.399000:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4e00 00000100:00100000:0.0:1746144669.399007:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746950144 00000100:00100000:0.0:1746144669.399008:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746950144 00002000:00100000:0.0:1746144669.399015:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012d0c7b80 x1830964746950144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.399020:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7b80 with x1830964746950144 ext(2097152->3145727) 00002000:00010000:0.0:1746144669.399022:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c7b80 00000100:00100000:0.0:1746144669.399028:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746950656 00000100:00100000:0.0:1746144669.399029:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746950656 00002000:00100000:0.0:1746144669.399037:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88012d0c5f80 x1830964746950656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.399049:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5f80 with x1830964746950656 ext(4194304->4939775) 00002000:00010000:0.0:1746144669.399053:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c5f80 00000100:00100000:0.0:1746144669.399062:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4871 00000100:00100000:0.0:1746144669.399068:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746949888:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144669.399887:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4872 00000100:00100000:2.0:1746144669.399916:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746949760:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.400130:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4873 00000100:00100000:1.0:1746144669.400159:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746950272:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144669.402110:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4874 00000100:00100000:2.0:1746144669.402119:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746950144:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144669.402697:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4875 00000100:00100000:3.0:1746144669.402712:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746950656:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.411252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.411324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.411445:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746950912 00000100:00100000:3.0:1746144669.411455:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746950912 00000100:00100000:3.0:1746144669.411512:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 655 00000100:00100000:3.0:1746144669.411518:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:1961:x1830964746950912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.411533:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.411554:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c07c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fed7 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.411571:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.411603:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.411652:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:1961:x1830964746950912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 134us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.411658:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 655 00000100:00100000:3.0:1746144669.411694:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746950784 00000100:00100000:3.0:1746144669.411697:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746950784 00000100:00100000:3.0:1746144669.411986:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12508 00000100:00100000:3.0:1746144669.411995:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746950784:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144669.412007:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.412019:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fee5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.412038:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.412046:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.412058:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.412063:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.412065:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.412068:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.412073:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747601664:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.412091:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.412101:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.412103:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.412111:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747601792:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.412157:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1963:x1830964746949248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 22967us (23352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.412166:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6255 00010000:00010000:3.0:1746144669.412194:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.412202:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 27 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.412210:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747601920:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.412235:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.412241:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 26 pid: 22208 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.412248:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602048:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144669.412481:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.413678:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746949760:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13777us (14954us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144669.413688:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4872 00002000:00100000:0.0:1746144669.413698:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012d0c6300 x1830964746949760/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.413707:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c6300 with x1830964746949760 ext(2097152->3145727) 00002000:00010000:0.0:1746144669.413712:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c6300 00000100:00100000:0.0:1746144669.424202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.424226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.424354:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747601792:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.424575:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746950656:12345-192.168.204.23@tcp:3:cat.0 Request processed in 21868us (25755us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746144669.424585:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4875 00002000:00100000:0.0:1746144669.424596:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88012d0c5f80 x1830964746950656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.424605:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c5f80 with x1830964746950656 ext(4194304->4939775) 00002000:00010000:0.0:1746144669.424610:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c5f80 00000100:00100000:2.0:1746144669.424730:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746951168 00000100:00100000:2.0:1746144669.424736:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746951168 00000100:00100000:2.0:1746144669.424779:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746951424 00000100:00100000:2.0:1746144669.424781:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746951424 00000100:00100000:2.0:1746144669.424796:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10248 00000100:00100000:2.0:1746144669.424804:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29480:x1830964746951168:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.424821:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.424824:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144669.424849:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628400/0xa7c849b16e01c06e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fed0 expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.424870:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.424875:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144669.424886:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135783800/0xa7c849b16e01c08a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152feec expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.424945:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.424958:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.424970:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.424975:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.425003:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 7 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.425013:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 7 pid: 14710 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.425023:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747602176:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.425085:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.425093:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 8 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.425101:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747602304:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.425117:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800940d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.425218:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10249 00000100:00100000:2.0:1746144669.425226:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:29478:x1830964746951424:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.425236:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.425238:0:14708:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144669.425243:0:14708:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 8 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.425530:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:1962:x1830964746950144:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23412us (26773us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.425536:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4874 00002000:00100000:3.0:1746144669.425542:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012d0c7b80 x1830964746950144/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.425548:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c7b80 with x1830964746950144 ext(2097152->3145727) 00002000:00010000:3.0:1746144669.425551:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c7b80 00010000:00010000:2.0:1746144669.426048:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.426054:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.426060:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.426065:0:14708:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144669.426072:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135782c00/0xa7c849b16e01c098 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fef3 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.426099:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.426106:0:14708:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.426111:0:14708:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.426121:0:14708:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.426151:0:14708:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000100:00100000:2.0:1746144669.429203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.429947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.430360:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747601920:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.430371:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602048:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.430405:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.430425:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4800, rc 0) 00000100:00100000:0.0:1746144669.430471:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746950784:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 18477us (19231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.430479:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12508 00000100:00100000:3.0:1746144669.432356:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746951552 00000100:00100000:3.0:1746144669.432370:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746951552 00010000:00010000:3.0:1746144669.432410:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.432436:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746951680 00000100:00100000:3.0:1746144669.432438:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746951680 00010000:00010000:3.0:1746144669.432447:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 25 pid: 22208 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.432474:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6257 00000100:00100000:3.0:1746144669.432480:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1962:x1830964746951552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.432494:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.432516:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.432527:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.432546:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01bf80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe59 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.432563:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.432595:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b5f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746951552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 115us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.432601:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6257 00000100:00100000:3.0:1746144669.432613:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6258 00000100:00100000:3.0:1746144669.432618:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746951680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.432624:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.432631:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 25 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.432638:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 25 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.432654:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01bf10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe1a expref: 25 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.432665:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.432676:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:1960:x1830964746951680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 58us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.432681:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6258 00000100:00100000:3.0:1746144669.433840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.433944:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746951808 00000100:00100000:2.0:1746144669.433949:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746951808 00010000:00010000:2.0:1746144669.433981:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 28 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.435032:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746949888:12345-192.168.204.23@tcp:3:cat.0 Request processed in 35960us (36352us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.435039:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4871 00002000:00100000:3.0:1746144669.435050:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012d0c4700 x1830964746949888/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.435059:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4700 with x1830964746949888 ext(3145728->4194303) 00002000:00010000:3.0:1746144669.435063:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d0c4700 00000100:00100000:3.0:1746144669.435102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.435479:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746950272:12345-192.168.204.23@tcp:3:cat.0 Request processed in 35323us (36734us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144669.435485:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4873 00002000:00100000:0.0:1746144669.435491:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012d0c4e00 x1830964746950272/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.435498:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d0c4e00 with x1830964746950272 ext(3145728->4194303) 00002000:00010000:0.0:1746144669.435502:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d0c4e00 00000100:00100000:0.0:1746144669.436621:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747602176:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.436639:0:20319:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from blocking AST (req@ffff88009b733b80 x1830964747602304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.436655:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01bf3a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe2f expref: 9 pid: 14708 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.436679:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747602304:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.436715:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.436721:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.436728:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.436736:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144669.436933:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746951936 00000100:00100000:2.0:1746144669.436939:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746951936 00010000:00010000:2.0:1746144669.436965:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 8 pid: 14710 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.436986:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6259 00000100:00100000:2.0:1746144669.436994:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746951808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.437008:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.437031:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 28 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.437043:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 28 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.437060:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fea00/0xa7c849b16e01bfa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe7c expref: 28 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.437076:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.437079:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.437085:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.437093:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.437123:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.437148:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747602432:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.437204:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801369723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.437223:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6260 00000100:00100000:2.0:1746144669.437229:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+8:1961:x1830964746951936:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.437238:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.437242:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 8 pid: 14710 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.437249:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 8 pid: 14710 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.437259:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f62de00/0xa7c849b16e01bf4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe36 expref: 8 pid: 14710 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.437265:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.437268:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.437273:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.437278:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.437283:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.437288:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.437298:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.437312:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1961:x1830964746951936:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 84us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.437316:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6260 00010000:00010000:2.0:1746144669.437331:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.437335:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20319 initiator: MDT0 00000040:00080000:2.0:1746144669.437913:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3021, 88 off252800 00000004:00080000:2.0:1746144669.437919:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646784131ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.437973:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2929, 88 off244696 00000004:00080000:2.0:1746144669.437977:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646842119ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.437988:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2930, 88 off244784 00000004:00080000:2.0:1746144669.437993:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646858794ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.438000:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3022, 88 off252888 00000004:00080000:2.0:1746144669.438003:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646868244ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438009:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3023, 88 off252976 00000004:00080000:2.0:1746144669.438012:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646877276ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438018:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2931, 88 off244872 00000004:00080000:2.0:1746144669.438021:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646886229ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.438027:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2932, 88 off244960 00000004:00080000:2.0:1746144669.438029:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646894871ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.438035:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2933, 88 off245048 00000004:00080000:2.0:1746144669.438038:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646903274ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.438044:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3024, 88 off253064 00000004:00080000:2.0:1746144669.438047:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646912406ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438053:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2934, 88 off245136 00000004:00080000:2.0:1746144669.438055:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646920936ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.438062:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3025, 88 off253152 00000004:00080000:2.0:1746144669.438064:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646929489ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438070:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2935, 88 off245224 00000004:00080000:2.0:1746144669.438072:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646937717ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144669.438078:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3026, 88 off253240 00000004:00080000:2.0:1746144669.438081:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646946286ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438087:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3027, 88 off253328 00000004:00080000:2.0:1746144669.438090:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646955087ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438096:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3028, 88 off253416 00000004:00080000:2.0:1746144669.438098:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646963611ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438104:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3029, 88 off253504 00000004:00080000:2.0:1746144669.438106:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648646972046ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144669.438112:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2936, 88 off245312 00000004:00080000:2.0:1746144669.438115:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648646980171ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144669.439531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.439603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.439695:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952064 00000100:00100000:0.0:1746144669.439702:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952064 00000100:00100000:0.0:1746144669.439736:0:22257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952192 00000100:00100000:0.0:1746144669.439738:0:22257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952192 00000100:00100000:0.0:1746144669.439755:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10250 00000100:00100000:0.0:1746144669.439761:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29476:x1830964746952064:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.439781:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.439798:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fefa expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.439845:0:22257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.439853:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 303 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.439871:0:22257:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.439881:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 303 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.439892:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.439895:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144669.439897:0:22257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.439903:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c02e600, rc 0) 00000100:00100000:0.0:1746144669.439952:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29476:x1830964746952064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 190us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.439957:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10250 00000100:00100000:0.0:1746144669.439972:0:22257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10251 00000100:00100000:0.0:1746144669.439977:0:22257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+9:29471:x1830964746952192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.439984:0:22257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.439990:0:22257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff01 expref: -99 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.440009:0:22257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.440017:0:22257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.440028:0:22257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.440030:0:22257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144669.440032:0:22257:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:0.0:1746144669.440036:0:22257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c02fe00, rc 0) 00000100:00100000:0.0:1746144669.440051:0:22257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:16261e74-be72-4bb6-b857-d78345d984f7+10:29471:x1830964746952192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 74us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.440056:0:22257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10251 00000100:00100000:0.0:1746144669.444878:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747602432:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.444896:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746144669.444903:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.444937:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952320 00000100:00100000:0.0:1746144669.444943:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952320 00000100:00100000:0.0:1746144669.444982:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12509 00000100:00100000:0.0:1746144669.444990:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746952320:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.445006:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.446722:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff08 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.446759:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.446768:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.446774:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.446781:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.446783:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.446786:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.446818:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.446831:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.446844:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602560:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.446919:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.446939:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.446947:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602688:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.446970:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.446978:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 21 pid: 8451 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.446990:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602816:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.447007:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.447119:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746951808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 10123us (13280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.447129:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6259 00000100:00100000:2.0:1746144669.451825:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602560:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.451825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.451836:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602688:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.451845:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747602816:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.451875:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.451892:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c02fc00, rc 0) 00000100:00100000:1.0:1746144669.451905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.451955:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746952320:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6965us (7059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.451966:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12509 00000100:00100000:0.0:1746144669.452195:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952576 00000100:00100000:0.0:1746144669.452203:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952576 00010000:00010000:0.0:1746144669.452229:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.452254:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952448 00000100:00100000:0.0:1746144669.452256:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952448 00010000:00010000:0.0:1746144669.452266:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.452280:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6261 00000100:00100000:0.0:1746144669.452286:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746952576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.452301:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.452322:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.452330:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.452353:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe600/0xa7c849b16e01bfaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe83 expref: 27 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.452365:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.452533:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6262 00000100:00100000:1.0:1746144669.452540:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1961:x1830964746952448:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.452548:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.452558:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746144669.452566:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746144669.452578:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff000/0xa7c849b16e01bf79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe60 expref: 12 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:1.0:1746144669.452588:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.452604:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1961:x1830964746952448:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 65us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.452609:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6262 00000100:00100000:0.0:1746144669.453004:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1962:x1830964746952576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 716us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.453010:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6261 00000100:00100000:0.0:1746144669.453075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.453110:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952704 00000100:00100000:0.0:1746144669.453113:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952704 00010000:00010000:0.0:1746144669.453125:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 22 pid: 8451 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.453400:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6263 00000100:00100000:0.0:1746144669.453991:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746952704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.454001:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.454017:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 22 pid: 8451 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.454027:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 22 pid: 8451 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.454042:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01bf33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe28 expref: 22 pid: 8451 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.454052:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.454054:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.454236:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.454249:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.454297:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.454311:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747602944:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144669.454367:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23b2600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.460812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.460842:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952832 00000100:00100000:2.0:1746144669.460851:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952832 00000100:00100000:2.0:1746144669.460905:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12510 00000100:00100000:2.0:1746144669.460913:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746952832:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:0.0:1746144669.460939:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747602944:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.460941:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.460956:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144669.460959:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff0f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.460987:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.460995:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 26 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.460998:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746952704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7592us (7922us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144669.461002:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 43 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144669.461006:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6263 00010000:00010000:2.0:1746144669.461008:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.461010:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.461012:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.461038:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 43 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.461054:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 43 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.461065:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603072:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.461122:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 26 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.461130:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 26 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.461166:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603200:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.461200:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 12 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.461207:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.461215:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603328:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.461232:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800904010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.466630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.466646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.466664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.466689:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953088 00000100:00100000:3.0:1746144669.466697:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953088 00010000:00010000:3.0:1746144669.466732:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.466757:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746952960 00000100:00100000:3.0:1746144669.466760:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746952960 00010000:00010000:3.0:1746144669.466770:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 44 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.466783:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953216 00000100:00100000:3.0:1746144669.466785:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953216 00010000:00010000:3.0:1746144669.466792:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.466805:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6264 00000100:00100000:3.0:1746144669.466811:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746953088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.466827:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.466852:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.466862:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 27 pid: 8388 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.466887:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.466941:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746953088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 129us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.466948:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6264 00000100:00100000:3.0:1746144669.466963:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6265 00000100:00100000:3.0:1746144669.466967:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746952960:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.466976:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.466982:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 44 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.466994:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 44 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.467004:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.467016:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746952960:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.467021:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6265 00000100:00100000:3.0:1746144669.467028:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6266 00000100:00100000:3.0:1746144669.467033:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1963:x1830964746953216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.467038:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.467044:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.467052:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.467062:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.467065:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.467072:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.467081:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.467112:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.467126:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747603456:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144669.467206:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ee40 going to sleep for 11 seconds 00010000:00010000:2.0:1746144669.467300:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0fec00/0xa7c849b16e01bfb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe8a expref: 43 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.467313:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603072:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.467325:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e87c400/0xa7c849b16e01bfd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe9f expref: 26 pid: 8388 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.467332:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603200:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.467340:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c222a00/0xa7c849b16e01bf87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe67 expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.467348:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603328:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.467389:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.467397:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7faa00, rc 0) 00000100:00100000:2.0:1746144669.467419:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746952832:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6508us (6615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.467425:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12510 00000100:00100000:0.0:1746144669.470882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.470913:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953344 00000100:00100000:0.0:1746144669.470931:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953344 00000100:00100000:0.0:1746144669.470980:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12511 00000100:00100000:0.0:1746144669.470987:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746953344:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144669.471007:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.471026:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff16 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.471055:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 13 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.471069:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.471076:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 42 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.471081:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.471083:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.471085:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.471113:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 42 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.471123:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 42 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.471155:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603584:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.471237:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.471245:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 25 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.471254:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603712:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.471279:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 13 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.471286:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 13 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.471293:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603840:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.471306:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.471511:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747603456:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.471524:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.471544:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1963:x1830964746953216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4510us (4879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.471552:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6266 00000100:00100000:2.0:1746144669.479323:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603584:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.479336:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603712:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.479364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.479994:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747603840:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144669.480049:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.480071:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782200, rc 0) 00000100:00100000:3.0:1746144669.480278:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953472 00000100:00100000:3.0:1746144669.480288:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953472 00010000:00010000:3.0:1746144669.480318:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 26 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.480354:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6267 00000100:00100000:3.0:1746144669.480364:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746953472:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.480378:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.480402:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 26 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.480413:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 26 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.480438:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f628c00/0xa7c849b16e01c059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152febb expref: 26 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:3.0:1746144669.480460:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.480561:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29466:x1830964746953344:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9573us (9689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.480572:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12511 00000100:00100000:3.0:1746144669.480846:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+25:1960:x1830964746953472:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 481us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.480852:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6267 00010000:00010000:3.0:1746144669.481459:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 303 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.481470:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.481472:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746144669.481475:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.481483:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 303 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.481489:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.481515:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 303 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.481524:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 303 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.481536:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747603968:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144669.481587:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ee40 going to sleep for 11 seconds 00000001:00080000:1.0:1746144669.481674:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944154 is committed 00000001:00080000:1.0:1746144669.481693:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944156 is committed 00000004:00080000:1.0:1746144669.481696:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2121 committed 00000004:00080000:1.0:1746144669.481702:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2210 committed 00000004:00080000:1.0:1746144669.481707:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2209 committed 00000004:00080000:1.0:1746144669.481709:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2208 committed 00000004:00080000:1.0:1746144669.481710:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2207 committed 00000004:00080000:1.0:1746144669.481711:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2120 committed 00000004:00080000:1.0:1746144669.481713:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2206 committed 00000004:00080000:1.0:1746144669.481714:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2119 committed 00000004:00080000:1.0:1746144669.481715:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2205 committed 00000004:00080000:1.0:1746144669.481716:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2118 committed 00000004:00080000:1.0:1746144669.481718:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2117 committed 00000004:00080000:1.0:1746144669.481719:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2116 committed 00000004:00080000:1.0:1746144669.481720:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2204 committed 00000004:00080000:1.0:1746144669.481722:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2203 committed 00000004:00080000:1.0:1746144669.481724:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2115 committed 00000004:00080000:1.0:1746144669.481725:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2114 committed 00000004:00080000:1.0:1746144669.481727:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2202 committed 00000001:00080000:1.0:1746144669.481733:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944155 is committed 00000001:00080000:1.0:1746144669.481738:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944153 is committed 00000100:00100000:0.0:1746144669.482007:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482048:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482064:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482088:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746144669.482092:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482102:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482109:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482132:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482165:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482176:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482190:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482200:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746144669.482203:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482215:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482225:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482237:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144669.482259:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604480 00000100:00100000:0.0:1746144669.482263:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604480 00000100:00100000:0.0:1746144669.482291:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604992 00000100:00100000:0.0:1746144669.482293:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604992 00000100:00100000:0.0:1746144669.482304:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604096 00000100:00100000:0.0:1746144669.482305:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604096 00000100:00100000:0.0:1746144669.482315:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604608 00000100:00100000:0.0:1746144669.482316:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604608 00000100:00100000:0.0:1746144669.482325:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604224 00000100:00100000:0.0:1746144669.482326:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604224 00000100:00100000:0.0:1746144669.482339:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604736 00000100:00100000:0.0:1746144669.482340:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604736 00000100:00100000:0.0:1746144669.482346:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604352 00000100:00100000:0.0:1746144669.482348:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604352 00000100:00100000:0.0:1746144669.482352:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747604864 00000100:00100000:0.0:1746144669.482354:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747604864 00000100:00100000:0.0:1746144669.482362:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12512 00000100:00100000:0.0:1746144669.482366:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747604480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.482542:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747604480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (493us total) trans 17179873407 rc 0/0 00000100:00100000:0.0:1746144669.482547:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12512 00000100:00100000:1.0:1746144669.482648:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747605120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.482677:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.482690:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605120 00000100:00100000:1.0:1746144669.482694:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747605632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.482698:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605120 00000100:00100000:1.0:1746144669.482712:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.482720:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746144669.482723:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747605504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.482743:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.482750:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747606016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.482768:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.482784:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605632 00000100:00100000:1.0:1746144669.482786:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605632 00000100:00100000:0.0:1746144669.483058:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605504 00000100:00100000:0.0:1746144669.483060:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605504 00000100:00100000:2.0:1746144669.483225:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747606016 00000100:00100000:2.0:1746144669.483229:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747606016 00000100:00100000:1.0:1746144669.483236:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12513 00000100:00100000:1.0:1746144669.483241:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747604992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.483248:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12514 00000100:00100000:2.0:1746144669.483256:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747604096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.483326:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747604992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1247us total) trans 17179873408 rc 0/0 00000100:00100000:1.0:1746144669.483331:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12513 00000100:00100000:1.0:1746144669.483341:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12515 00000100:00100000:1.0:1746144669.483344:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3295:x1830964747604608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.483408:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3295:x1830964747604608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1287us total) trans 17179873409 rc 0/0 00000100:00100000:1.0:1746144669.483413:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12515 00002000:00010000:2.0:1746144669.483423:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746144669.483423:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12516 00002000:00010000:2.0:1746144669.483426:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00000100:00100000:1.0:1746144669.483427:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747604224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746144669.483428:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:2.0:1746144669.483429:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.483431:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:2.0:1746144669.483475:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3295:x1830964747604096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (1370us total) trans 17179873410 rc 0/0 00000100:00100000:2.0:1746144669.483481:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12514 00000100:00100000:2.0:1746144669.483496:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12517 00002000:00010000:1.0:1746144669.483499:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144669.483501:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00000100:00100000:2.0:1746144669.483503:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747604736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746144669.483503:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144669.483505:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.483507:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144669.483527:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747604224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (1361us total) trans 17179873411 rc 0/0 00000100:00100000:1.0:1746144669.483532:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12516 00000100:00100000:1.0:1746144669.483546:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12518 00000100:00100000:1.0:1746144669.483550:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747604352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.483587:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747604736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1395us total) trans 17179873412 rc 0/0 00002000:00010000:1.0:1746144669.483623:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:1.0:1746144669.483626:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.483628:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.483630:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.483632:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:1.0:1746144669.483651:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3293:x1830964747604352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1435us total) trans 17179873413 rc 0/0 00000100:00100000:2.0:1746144669.485008:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12517 00000100:00100000:1.0:1746144669.485017:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12518 00000100:00100000:2.0:1746144669.485031:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12519 00000100:00100000:1.0:1746144669.485038:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12520 00000100:00100000:2.0:1746144669.485042:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3293:x1830964747604864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.485044:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747605120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.485172:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3293:x1830964747604864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (2933us total) trans 17179873414 rc 0/0 00000100:00100000:2.0:1746144669.485178:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12519 00000100:00100000:2.0:1746144669.485188:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12521 00000100:00100000:2.0:1746144669.485194:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747605632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.485662:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3296:x1830964747605632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 469us (2948us total) trans 21474840627 rc 0/0 00000100:00100000:2.0:1746144669.485668:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12521 00000100:00100000:2.0:1746144669.485679:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12522 00000100:00100000:2.0:1746144669.485687:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747606016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.485722:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12523 00000100:00100000:3.0:1746144669.485732:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3296:x1830964747605504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.485754:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747605248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.485772:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3296:x1830964747606016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (3002us total) trans 21474840628 rc 0/0 00000100:00100000:2.0:1746144669.485777:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12522 00000100:00100000:3.0:1746144669.485790:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.485801:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747605376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.485810:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747605760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.485824:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.485831:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.485847:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747605888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144669.485850:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d0c7800/2, rc 0, transno 17179873413 00000100:00100000:3.0:1746144669.485858:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.485861:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746144669.485867:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb6300/2, rc 0, transno 17179873414 00000100:00100000:3.0:1746144669.485869:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144669.485877:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d0c7480/2, rc 0, transno 17179873411 00000100:00100000:3.0:1746144669.485880:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144669.485887:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b733800/2, rc 0, transno 17179873412 00000100:00100000:3.0:1746144669.485889:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747604736:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746144669.486023:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144669.486025:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.486027:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.486028:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.486030:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746144669.486033:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747606144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.486051:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3296:x1830964747605504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (3307us total) trans 21474840629 rc 0/0 00000100:00100000:3.0:1746144669.486056:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12523 00000100:00100000:2.0:1746144669.486056:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144669.486068:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605248 00000100:00100000:3.0:1746144669.486072:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605248 00000100:00100000:3.0:1746144669.486082:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605760 00000100:00100000:3.0:1746144669.486084:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605760 00000100:00100000:3.0:1746144669.486089:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605376 00000100:00100000:3.0:1746144669.486090:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605376 00000100:00100000:3.0:1746144669.486097:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747605888 00000100:00100000:3.0:1746144669.486098:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747605888 00000100:00100000:3.0:1746144669.486103:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747606144 00000100:00100000:3.0:1746144669.486104:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747606144 00000100:00100000:3.0:1746144669.486110:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12524 00000100:00100000:3.0:1746144669.486113:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3293:x1830964747605248:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.486148:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136958700/2, rc 0, transno 21474840629 00000100:00100000:2.0:1746144669.486153:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747605504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.486166:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092937480/2, rc 0, transno 21474840628 00000100:00100000:2.0:1746144669.486169:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747606016:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.486176:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092936d80/2, rc 0, transno 21474840627 00000100:00100000:2.0:1746144669.486179:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747605632:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144669.486186:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144669.486188:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.486190:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:3.0:1746144669.486191:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.486193:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144669.486197:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12525 00000100:00100000:2.0:1746144669.486205:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3293:x1830964747605760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.486212:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3293:x1830964747605248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (422us total) trans 21474840630 rc 0/0 00000100:00100000:3.0:1746144669.486216:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12524 00000100:00100000:3.0:1746144669.486225:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12526 00000100:00100000:3.0:1746144669.486228:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3294:x1830964747605376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144669.486288:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746144669.486290:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.486291:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00000100:00100000:2.0:1746144669.486291:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3293:x1830964747605760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (465us total) trans 21474840631 rc 0/0 00002000:00010000:3.0:1746144669.486293:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.486295:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746144669.486296:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12525 00000100:00100000:2.0:1746144669.486308:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12527 00000004:00080000:2.0:1746144669.486342:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a51ec000/2, rc 0, transno 21474840632 00000100:00100000:2.0:1746144669.486345:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747605376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.486357:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747605888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144669.486485:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144669.486488:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144669.486490:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144668 -> 1746144668 00002000:00010000:1.0:1746144669.486492:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.486494:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746144669.486509:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12528 00000100:00100000:0.0:1746144669.486525:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3296:x1830964747606144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.487025:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3296:x1830964747606144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 506us (967us total) trans 17179873415 rc 0/0 00000100:00100000:0.0:1746144669.487030:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12528 00000004:00080000:0.0:1746144669.487090:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d0c7100/2, rc 0, transno 17179873410 00000100:00100000:0.0:1746144669.487094:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.487096:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3294:x1830964747605376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 867us (1265us total) trans 21474840632 rc 0/0 00000100:00100000:3.0:1746144669.487101:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12526 00000004:00080000:0.0:1746144669.487101:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b733b80/2, rc 0, transno 17179873409 00000100:00100000:0.0:1746144669.487104:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144669.487111:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b5f5500/2, rc 0, transno 17179873407 00000100:00100000:0.0:1746144669.487114:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b5f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144669.487122:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbb5c00/2, rc 0, transno 17179873408 00000100:00100000:0.0:1746144669.487124:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747604992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.487208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.487228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.487233:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3296:x1830964747605120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2191us (4555us total) trans 21474840634 rc 0/0 00000100:00100000:1.0:1746144669.487239:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12520 00000004:00080000:2.0:1746144669.487316:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44380/2, rc 0, transno 17179873415 00000100:00100000:2.0:1746144669.487320:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747606144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144669.487328:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb0fb80/2, rc 0, transno 21474840634 00000100:00100000:0.0:1746144669.487328:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953600 00000100:00100000:0.0:1746144669.487330:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953600 00000100:00100000:2.0:1746144669.487331:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747605120:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746144669.487351:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 43 pid: 8451 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.487352:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830964747605888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1040us (1491us total) trans 21474840633 rc 0/0 00000100:00100000:2.0:1746144669.487357:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12527 00000100:00100000:0.0:1746144669.487369:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953728 00000100:00100000:0.0:1746144669.487371:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953728 00000004:00080000:2.0:1746144669.487373:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092937800/2, rc 0, transno 21474840633 00000100:00100000:2.0:1746144669.487375:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747605888:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746144669.487380:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.487394:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6268 00000100:00100000:0.0:1746144669.487398:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1961:x1830964746953600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.487407:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.487418:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 43 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.487432:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 43 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.487450:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0fee00/0xa7c849b16e01bfb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe91 expref: 43 pid: 8451 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.487464:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.487497:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746953600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.487503:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6268 00000100:00100000:0.0:1746144669.487542:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6269 00000100:00100000:0.0:1746144669.487547:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746953728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.487554:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.487561:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.487569:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.487579:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437c000/0xa7c849b16e01bf8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe6e expref: 12 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.487588:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.487589:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.487596:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.487605:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.487613:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747603968:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144669.487629:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.487637:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747606272:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.487639:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783800/0xa7c849b16e01c08a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 299 pid: 20319 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746144669.487652:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.487659:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.487679:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0840 going to sleep for 11 seconds 00010000:00010000:3.0:1746144669.487686:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783600, rc 0) 00000100:00100000:3.0:1746144669.487706:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29480:x1830964746951168:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 62903us (63515us total) trans 8589944156 rc 0/0 00000100:00100000:3.0:1746144669.487712:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10248 00000004:00080000:3.0:1746144669.487739:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb0d180/2, rc 0, transno 21474840630 00000100:00100000:3.0:1746144669.487743:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747605248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144669.487752:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092935500/2, rc 0, transno 21474840631 00000100:00100000:3.0:1746144669.487755:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747605760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144669.489460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.489519:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747606272:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.489532:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.489765:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746953728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2216us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.489776:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6269 00000100:00100000:3.0:1746144669.489907:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953856 00000100:00100000:3.0:1746144669.489912:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953856 00000100:00100000:3.0:1746144669.489946:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12529 00000100:00100000:3.0:1746144669.489951:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746953856:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144669.489964:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.489977:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff1d expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.490001:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.490009:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 20 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.490017:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 25 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.490021:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.490023:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.490026:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.490047:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 25 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.490057:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 25 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.490066:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747606400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.490757:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 20 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.490767:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 20 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.490777:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747606528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.490995:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.491003:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 12 pid: 8453 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.491012:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747606656:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144669.491033:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a519ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.491175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.491421:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746953984 00000100:00100000:2.0:1746144669.491426:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746953984 00010000:00010000:2.0:1746144669.491457:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.491477:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6270 00000100:00100000:2.0:1746144669.491483:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1962:x1830964746953984:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.491494:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.491499:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.491507:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.491521:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135783600/0xa7c849b16e01c091 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152feec expref: 298 pid: 20319 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.491534:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.491538:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.491547:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.491552:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144669.491560:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 297 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.491803:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.491826:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:1962:x1830964746953984:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 343us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.491835:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6270 00010000:00010000:3.0:1746144669.491884:0:14708:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00010000:00010000:3.0:1746144669.491890:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14708 initiator: MDT0 00000040:00080000:3.0:1746144669.492500:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3030, 88 off253592 00000004:00080000:3.0:1746144669.492505:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701370301ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492552:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2937, 88 off245400 00000004:00080000:3.0:1746144669.492555:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701420499ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492564:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2938, 88 off245488 00000004:00080000:3.0:1746144669.492566:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701431576ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492572:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3031, 88 off253680 00000004:00080000:3.0:1746144669.492574:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701439757ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492579:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3032, 88 off253768 00000004:00080000:3.0:1746144669.492581:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701447037ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492587:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2939, 88 off245576 00000004:00080000:3.0:1746144669.492590:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701455154ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492595:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2940, 88 off245664 00000004:00080000:3.0:1746144669.492597:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701462149ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492620:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2942, 88 off245848 00000004:00080000:3.0:1746144669.492623:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701488079ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492628:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3033, 88 off253856 00000004:00080000:3.0:1746144669.492630:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701495951ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492636:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2943, 88 off245936 00000004:00080000:3.0:1746144669.492637:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701503034ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492660:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3035, 88 off254040 00000004:00080000:3.0:1746144669.492662:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701527994ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492668:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2944, 88 off246024 00000004:00080000:3.0:1746144669.492670:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701535804ns, next at 593480289301ns, rc = 0 00000040:00080000:3.0:1746144669.492675:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3036, 88 off254128 00000004:00080000:3.0:1746144669.492677:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701542939ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492682:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3037, 88 off254216 00000004:00080000:3.0:1746144669.492684:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701549374ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492688:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3038, 88 off254304 00000004:00080000:3.0:1746144669.492690:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701555839ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492695:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3039, 88 off254392 00000004:00080000:3.0:1746144669.492697:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648701562714ns, next at 593496143484ns, rc = 0 00000040:00080000:3.0:1746144669.492702:0:14708:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2945, 88 off246112 00000004:00080000:3.0:1746144669.492703:0:14708:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648701568979ns, next at 593480289301ns, rc = 0 00000100:00100000:0.0:1746144669.495948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.496005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.496028:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954112 00000100:00100000:0.0:1746144669.496036:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954112 00010000:00010000:0.0:1746144669.496073:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 26 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.496105:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954240 00000100:00100000:0.0:1746144669.496108:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954240 00010000:00010000:0.0:1746144669.496121:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 13 pid: 8453 timeout: 748 lvb_type: 1 00000100:00100000:0.0:1746144669.496153:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6271 00000100:00100000:0.0:1746144669.496162:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746954112:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.496175:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.496198:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 26 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.496209:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 26 pid: 8388 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.496233:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.496268:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746954112:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.496275:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6271 00000100:00100000:0.0:1746144669.496291:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6272 00000100:00100000:0.0:1746144669.496296:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746954240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.496302:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.496308:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 13 pid: 8453 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.496316:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 13 pid: 8453 timeout: 748 lvb_type: 1 00010000:00010000:0.0:1746144669.496326:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.496339:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746954240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.496344:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6272 00000100:00100000:2.0:1746144669.497490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.497508:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954368 00000100:00100000:2.0:1746144669.497512:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954368 00010000:00010000:2.0:1746144669.497541:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 21 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:2.0:1746144669.497558:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6273 00000100:00100000:2.0:1746144669.497564:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746954368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.497572:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.497585:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 21 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.497594:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 21 pid: 8450 timeout: 748 lvb_type: 1 00010000:00010000:2.0:1746144669.497608:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.497610:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.497617:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.497626:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.497657:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 12 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.497674:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747606784:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.497722:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401840 going to sleep for 11 seconds 00010000:00010000:3.0:1746144669.498564:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e87c600/0xa7c849b16e01bfbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe98 expref: 25 pid: 8388 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.498576:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747606400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.498588:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f629e00/0xa7c849b16e01c060 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec2 expref: 21 pid: 8450 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.498596:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747606528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.498605:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff800/0xa7c849b16e01bf95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fe75 expref: 12 pid: 8453 timeout: 748 lvb_type: 1 00000100:00100000:3.0:1746144669.498612:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747606656:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.498635:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 11 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.498643:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5200, rc 0) 00000100:00100000:3.0:1746144669.498666:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29466:x1830964746953856:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 8715us (9207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.498672:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12529 00000100:00100000:0.0:1746144669.503603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.503620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.503634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.503647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.505427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.505459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.505512:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7100:1830964747606784:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144669.505540:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.505772:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954624 00000100:00100000:1.0:1746144669.505780:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954624 00000100:00100000:1.0:1746144669.505813:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954496 00000100:00100000:1.0:1746144669.505815:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954496 00000100:00100000:1.0:1746144669.505826:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954752 00000100:00100000:1.0:1746144669.505829:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954752 00000100:00100000:1.0:1746144669.505838:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955008 00000100:00100000:1.0:1746144669.505840:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955008 00000100:00100000:1.0:1746144669.505849:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746954880 00000100:00100000:1.0:1746144669.505851:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746954880 00000100:00100000:1.0:1746144669.505864:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12530 00000100:00100000:1.0:1746144669.505872:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746954624:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144669.506059:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144669.506062:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144668 -> 1746144669 00002000:00010000:1.0:1746144669.506065:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144668 -> 1746144669 00002000:00010000:1.0:1746144669.506067:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144669 -> 1746144670 00002000:00010000:1.0:1746144669.506069:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746144669.506119:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955136 00000100:00100000:3.0:1746144669.506122:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955136 00000100:00100000:3.0:1746144669.506154:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12531 00000100:00100000:3.0:1746144669.506159:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1961:x1830964746954496:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:3.0:1746144669.506256:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746144669.506258:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.506260:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144668 -> 1746144669 00002000:00010000:3.0:1746144669.506263:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144670 00002000:00010000:3.0:1746144669.506264:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746144669.507226:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+20:1963:x1830964746954368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9659us (9736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.507236:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6273 00000100:00100000:0.0:1746144669.507268:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12532 00000100:00100000:0.0:1746144669.507278:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746954752:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144669.507362:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144669.507365:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:0.0:1746144669.507367:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144668 -> 1746144669 00002000:00010000:0.0:1746144669.507369:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144669 -> 1746144670 00002000:00010000:0.0:1746144669.507370:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144669.507555:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1960:x1830964746954624:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 1682us (3958us total) trans 21474840635 rc 0/0 00000100:00100000:1.0:1746144669.507561:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12530 00000100:00100000:1.0:1746144669.507573:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12533 00000100:00100000:1.0:1746144669.507578:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746955008:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144669.507641:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:1.0:1746144669.507643:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.507645:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.507647:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144669 -> 1746144670 00002000:00010000:1.0:1746144669.507648:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:1.0:1746144669.507662:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746955008:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 85us (4015us total) trans 17179873417 rc 0/0 00000100:00100000:1.0:1746144669.507666:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12533 00000100:00100000:1.0:1746144669.507673:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12534 00000100:00100000:1.0:1746144669.507677:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746954880:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144669.507721:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144669.507724:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144668 -> 1746144669 00002000:00010000:1.0:1746144669.507726:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144668 -> 1746144669 00002000:00010000:1.0:1746144669.507727:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144669 -> 1746144670 00002000:00010000:1.0:1746144669.507729:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144669.507741:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1960:x1830964746954880:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 63us (2321us total) trans 17179873418 rc 0/0 00000100:00100000:1.0:1746144669.507744:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12534 00000100:00100000:1.0:1746144669.507751:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12535 00000100:00100000:1.0:1746144669.507754:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1960:x1830964746955136:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144669.507802:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144669.507804:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.507805:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.507807:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144669 -> 1746144670 00002000:00010000:1.0:1746144669.507808:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144669.507819:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1960:x1830964746955136:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 65us (2361us total) trans 21474840637 rc 0/0 00000100:00100000:1.0:1746144669.507823:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12535 00000100:00100000:3.0:1746144669.508000:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ea0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746954496:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 1840us (4378us total) trans 17179873416 rc 0/0 00000100:00100000:3.0:1746144669.508007:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12531 00000100:00100000:0.0:1746144669.508726:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746954752:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 1450us (5088us total) trans 21474840636 rc 0/0 00000100:00100000:0.0:1746144669.508731:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12532 00000100:00100000:1.0:1746144669.514798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.514872:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955264 00000100:00100000:3.0:1746144669.514882:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955264 00000100:00100000:3.0:1746144669.514933:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10252 00000100:00100000:3.0:1746144669.514945:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+6:29466:x1830964746955264:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144669.514970:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.514989:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff24 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.515046:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 7 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.515058:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 7 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.515072:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.515074:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144669.515078:0:20319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 296 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.515084:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f628600, rc 0) 00000100:00100000:3.0:1746144669.515159:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29466:x1830964746955264:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 217us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.515165:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10252 00010000:00010000:2.0:1746144669.520288:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fef3 expref: 10 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.520304:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.520307:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746144669.520311:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 296 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.520321:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 296 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.520327:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 296 pid: 22257 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144669.520330:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944157 is committed 00010000:00010000:2.0:1746144669.520333:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 10 pid: 22257 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746144669.520337:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2129 committed 00010000:00010000:2.0:1746144669.520339:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.520344:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746144669.520344:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2219 committed 00000004:00080000:1.0:1746144669.520352:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2218 committed 00010000:00010000:2.0:1746144669.520353:0:14708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746144669.520353:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2217 committed 00000004:00080000:1.0:1746144669.520355:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2216 committed 00000004:00080000:1.0:1746144669.520357:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2128 committed 00000004:00080000:1.0:1746144669.520358:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2215 committed 00000004:00080000:1.0:1746144669.520361:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2127 committed 00010000:00010000:2.0:1746144669.520363:0:14708:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746144669.520363:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2214 committed 00000004:00080000:1.0:1746144669.520364:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2126 committed 00000004:00080000:1.0:1746144669.520366:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2125 committed 00000004:00080000:1.0:1746144669.520368:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2124 committed 00010000:00010000:2.0:1746144669.520369:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746144669.520369:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2213 committed 00000004:00080000:1.0:1746144669.520371:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2212 committed 00000004:00080000:1.0:1746144669.520372:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2123 committed 00000004:00080000:1.0:1746144669.520373:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2122 committed 00000004:00080000:1.0:1746144669.520374:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2211 committed 00010000:00010000:2.0:1746144669.520407:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 6 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.520417:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747606912:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.520510:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 9 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.520512:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.520516:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747608064:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.520538:0:14708:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 296 pid: 22257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.520544:0:14708:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747608192:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.520553:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.520557:0:14708:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.520572:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.520585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520602:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.520616:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520628:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746144669.520632:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.520644:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520653:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.520656:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747607424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.520666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520677:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.520689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520693:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747607296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.520701:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747607936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.520708:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.520721:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607168 00000100:00100000:1.0:1746144669.520721:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747607808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.520728:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607168 00000100:00100000:1.0:1746144669.520732:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520741:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747608576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.520752:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144669.520761:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747609088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.520763:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607680 00000100:00100000:2.0:1746144669.520765:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607680 00000100:00100000:1.0:1746144669.520772:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.520777:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747608448 00000100:00100000:2.0:1746144669.520779:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747608448 00000100:00100000:2.0:1746144669.520790:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747608960 00000100:00100000:2.0:1746144669.520792:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747608960 00000100:00100000:2.0:1746144669.520798:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607040 00000100:00100000:2.0:1746144669.520799:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607040 00000100:00100000:2.0:1746144669.520804:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607424 00000100:00100000:2.0:1746144669.520806:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607424 00000100:00100000:2.0:1746144669.520812:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607296 00000100:00100000:2.0:1746144669.520814:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607296 00000100:00100000:2.0:1746144669.520821:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607808 00000100:00100000:2.0:1746144669.520822:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607808 00000100:00100000:2.0:1746144669.520829:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747608576 00000100:00100000:2.0:1746144669.520831:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747608576 00000100:00100000:2.0:1746144669.520837:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747609088 00000100:00100000:2.0:1746144669.520838:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747609088 00000100:00100000:2.0:1746144669.520847:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12536 00000100:00100000:2.0:1746144669.520853:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747607168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.520891:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12537 00000100:00100000:1.0:1746144669.520897:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747607680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144669.520947:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12538 00000100:00100000:1.0:1746144669.520952:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3294:x1830964747608448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144669.521111:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144669.521114:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.521116:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.521118:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:1.0:1746144669.521119:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746144669.521322:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12539 00000100:00100000:3.0:1746144669.521329:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3294:x1830964747608960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.521426:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3294:x1830964747608960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (780us total) trans 21474840639 rc 0/0 00000100:00100000:3.0:1746144669.521433:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12539 00000100:00100000:3.0:1746144669.521447:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12540 00000100:00100000:3.0:1746144669.521451:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3294:x1830964747607040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.522271:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12541 00000100:00100000:0.0:1746144669.522283:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3296:x1830964747607424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.523125:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12542 00000100:00100000:2.0:1746144669.523153:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3295:x1830964747607296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.523203:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12543 00000100:00100000:2.0:1746144669.523210:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3295:x1830964747607808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.523252:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.523285:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747608704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.523320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.523329:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747609216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.523343:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.523367:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.523378:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.523392:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.523398:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144669.523410:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746144669.523444:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f169180/2, rc 0, transno 21474840639 00000100:00100000:2.0:1746144669.523449:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144669.523531:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3294:x1830964747608448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2576us (2911us total) trans 21474840638 rc 0/0 00000100:00100000:1.0:1746144669.523538:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12538 00000100:00100000:1.0:1746144669.523555:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607936 00000100:00100000:1.0:1746144669.523562:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607936 00000100:00100000:1.0:1746144669.523581:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747608704 00000100:00100000:1.0:1746144669.523582:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747608704 00000100:00100000:1.0:1746144669.523589:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747609216 00000100:00100000:1.0:1746144669.523591:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747609216 00000100:00100000:1.0:1746144669.523597:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747607552 00000100:00100000:1.0:1746144669.523599:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747607552 00000100:00100000:1.0:1746144669.523605:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747608320 00000100:00100000:1.0:1746144669.523606:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747608320 00000100:00100000:1.0:1746144669.523611:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747608832 00000100:00100000:1.0:1746144669.523612:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747608832 00002000:00010000:3.0:1746144669.523614:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746144669.523618:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.523620:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00000100:00100000:1.0:1746144669.523620:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12544 00002000:00010000:3.0:1746144669.523622:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:3.0:1746144669.523624:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:1.0:1746144669.523624:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3295:x1830964747608576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.523649:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747607040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2197us (2982us total) trans 17179873419 rc 0/0 00000100:00100000:3.0:1746144669.523655:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12540 00000100:00100000:3.0:1746144669.523666:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12545 00000100:00100000:3.0:1746144669.523676:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3295:x1830964747609088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144669.523739:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144669.523741:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.523743:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.523745:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:1.0:1746144669.523747:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746144669.523751:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3295:x1830964747609088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (2977us total) trans 21474840641 rc 0/0 00000100:00100000:3.0:1746144669.523756:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12545 00000100:00100000:1.0:1746144669.523763:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3295:x1830964747608576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (3009us total) trans 21474840640 rc 0/0 00000100:00100000:1.0:1746144669.523767:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12544 00000100:00100000:3.0:1746144669.523769:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12546 00000100:00100000:3.0:1746144669.523773:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3296:x1830964747607936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.523849:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3296:x1830964747607936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (596us total) trans 17179873420 rc 0/0 00000100:00100000:3.0:1746144669.523854:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12546 00000100:00100000:3.0:1746144669.523864:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12547 00000100:00100000:3.0:1746144669.523868:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747608704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144669.523937:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144669.523940:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.523942:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.523944:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144669.523946:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144669.523962:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747608704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (641us total) trans 21474840642 rc 0/0 00000100:00100000:3.0:1746144669.523967:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12547 00000100:00100000:3.0:1746144669.523975:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12548 00000100:00100000:3.0:1746144669.523979:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3296:x1830964747609216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.524042:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830964747609216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (697us total) trans 21474840643 rc 0/0 00000100:00100000:3.0:1746144669.524047:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12548 00000100:00100000:3.0:1746144669.524055:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12549 00000100:00100000:3.0:1746144669.524059:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3294:x1830964747607552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746144669.524126:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747607552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (758us total) trans 17179873421 rc 0/0 00000100:00100000:3.0:1746144669.524131:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12549 00000100:00100000:3.0:1746144669.524155:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12550 00000100:00100000:3.0:1746144669.524159:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3294:x1830964747608320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144669.524220:0:22208:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144669.524222:0:22208:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.524224:0:22208:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.524226:0:22208:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:3.0:1746144669.524228:0:22208:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746144669.524244:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3294:x1830964747608320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (851us total) trans 21474840644 rc 0/0 00000100:00100000:3.0:1746144669.524249:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12550 00000100:00100000:3.0:1746144669.524257:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12551 00000100:00100000:3.0:1746144669.524261:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3294:x1830964747608832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144669.524325:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3294:x1830964747608832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (913us total) trans 21474840645 rc 0/0 00000100:00100000:3.0:1746144669.524330:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12551 00000004:00080000:3.0:1746144669.524361:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16b100/2, rc 0, transno 21474840640 00000100:00100000:3.0:1746144669.524365:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747608576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144669.524373:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16ad80/2, rc 0, transno 21474840641 00000100:00100000:3.0:1746144669.524375:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747609088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144669.525818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.525845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.525911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.525942:0:14709:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955520 00000100:00100000:0.0:1746144669.525948:0:14709:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955520 00000100:00100000:0.0:1746144669.525983:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10253 00000100:00100000:0.0:1746144669.525989:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29480:x1830964746955520:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144669.526008:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.526025:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01c0d7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff2b expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.526078:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01c0d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff2b expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.526091:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01c0d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff2b expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.526106:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.526109:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144669.526112:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fe000, rc 0) 00000100:00100000:0.0:1746144669.526163:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29480:x1830964746955520:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 174us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.526168:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10253 00000100:00100000:2.0:1746144669.526756:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955392 00000100:00100000:2.0:1746144669.526760:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955392 00000100:00100000:2.0:1746144669.526789:0:14711:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955648 00000100:00100000:2.0:1746144669.526791:0:14711:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955648 00000100:00100000:2.0:1746144669.526806:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4174 00000100:00100000:2.0:1746144669.526812:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29476:x1830964746955392:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144669.526874:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29476:x1830964746955392:12345-192.168.204.23@tcp:49:cat.0 Request processed in 63us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.526879:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4174 00000100:00100000:2.0:1746144669.526915:0:14711:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4175 00000100:00100000:2.0:1746144669.526932:0:14711:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+10:29471:x1830964746955648:12345-192.168.204.23@tcp:49:cat.0 00000100:00100000:2.0:1746144669.526961:0:14711:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16261e74-be72-4bb6-b857-d78345d984f7+10:29471:x1830964746955648:12345-192.168.204.23@tcp:49:cat.0 Request processed in 41us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.526966:0:14711:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4175 00000100:00100000:2.0:1746144669.527107:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747607680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6211us (6521us total) trans 17179873422 rc 0/0 00000100:00100000:2.0:1746144669.527113:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12537 00000004:00080000:2.0:1746144669.527169:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008b9a1880/2, rc 0, transno 17179873420 00000100:00100000:2.0:1746144669.527178:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747607936:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144669.527189:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f168380/2, rc 0, transno 21474840642 00000100:00100000:2.0:1746144669.527193:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747608704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.527201:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16b800/2, rc 0, transno 21474840643 00000100:00100000:2.0:1746144669.527204:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747609216:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.527294:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd93800/2, rc 0, transno 17179873419 00000100:00100000:2.0:1746144669.527297:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144669.527305:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c947800/2, rc 0, transno 17179873421 00000100:00100000:2.0:1746144669.527308:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144669.527316:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093e32300/2, rc 0, transno 21474840644 00000100:00100000:2.0:1746144669.527318:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608320:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.527326:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f168700/2, rc 0, transno 21474840645 00000100:00100000:2.0:1746144669.527328:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608832:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.527337:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f169f80/2, rc 0, transno 21474840638 00000100:00100000:2.0:1746144669.527340:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747608448:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144669.527346:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c946680/2, rc 0, transno 17179873422 00000100:00100000:2.0:1746144669.527349:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.527353:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746144669.527362:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747609344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.527384:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144669.527404:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747609344 00000100:00100000:2.0:1746144669.527407:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747609344 00000100:00100000:2.0:1746144669.527422:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12552 00000100:00100000:2.0:1746144669.527426:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3294:x1830964747609344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.527520:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3294:x1830964747609344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (134us total) trans 17179873423 rc 0/0 00000100:00100000:2.0:1746144669.527525:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12552 00000004:00080000:2.0:1746144669.527541:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b810380/2, rc 0, transno 17179873423 00000100:00100000:2.0:1746144669.527543:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b810380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747609344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144669.527560:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747606912:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.527569:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747608064:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.527577:0:14708:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14708:1830964747608192:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.527605:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135782c00/0xa7c849b16e01c098 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fef3 expref: 9 pid: 14708 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746144669.527625:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fef3 expref: 8 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.527640:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0ff400, rc 0) 00000100:00100000:2.0:1746144669.527655:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16261e74-be72-4bb6-b857-d78345d984f7+8:29478:x1830964746951424:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 102432us (103428us total) trans 8589944157 rc 0/0 00000100:00100000:2.0:1746144669.527661:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10249 00000100:00100000:0.0:1746144669.528233:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3296:x1830964747607424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5955us (7543us total) trans 17179873424 rc 0/0 00000100:00100000:0.0:1746144669.528240:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12541 00000100:00100000:0.0:1746144669.528285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.528363:0:16840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955776 00000100:00100000:0.0:1746144669.528367:0:16840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955776 00000100:00100000:0.0:1746144669.528386:0:16840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4176 00000100:00100000:0.0:1746144669.528391:0:16840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29466:x1830964746955776:12345-192.168.204.23@tcp:49:lfs.0 00000100:00100000:0.0:1746144669.528432:0:16840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29466:x1830964746955776:12345-192.168.204.23@tcp:49:lfs.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.528438:0:16840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4176 00002000:00010000:3.0:1746144669.528592:0:8453:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746144669.528595:0:8453:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.528597:0:8453:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.528599:0:8453:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:3.0:1746144669.528601:0:8453:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746144669.528627:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3294:x1830964747607168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7774us (8075us total) trans 17179873425 rc 0/0 00000100:00100000:3.0:1746144669.528632:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12536 00002000:00010000:3.0:1746144669.528702:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:3.0:1746144669.528705:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.528707:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:3.0:1746144669.528708:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:3.0:1746144669.528710:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:3.0:1746144669.528733:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3295:x1830964747607296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5602us (8024us total) trans 17179873426 rc 0/0 00000100:00100000:3.0:1746144669.528739:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12542 00000100:00100000:3.0:1746144669.528809:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3295:x1830964747607808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5600us (8074us total) trans 17179873427 rc 0/0 00000100:00100000:3.0:1746144669.528814:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12543 00000004:00080000:3.0:1746144669.528970:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c947100/2, rc 0, transno 17179873426 00000100:00100000:3.0:1746144669.528975:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747607296:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746144669.528983:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c944380/2, rc 0, transno 17179873427 00000100:00100000:3.0:1746144669.528986:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747607808:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144669.530475:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c946d80/2, rc 0, transno 17179873424 00000100:00100000:2.0:1746144669.530483:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747607424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144669.530812:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f437800/2, rc 0, transno 17179873425 00000100:00100000:0.0:1746144669.530817:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747607168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144669.531695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.532220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.532282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.532299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.532309:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956032 00000100:00100000:3.0:1746144669.532316:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956032 00000100:00100000:3.0:1746144669.532352:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956288 00000100:00100000:3.0:1746144669.532354:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956288 00000100:00100000:2.0:1746144669.532359:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746955904 00000100:00100000:2.0:1746144669.532364:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746955904 00000100:00100000:3.0:1746144669.532365:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956416 00000100:00100000:3.0:1746144669.532367:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956416 00000100:00100000:1.0:1746144669.532385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.532400:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4177 00000100:00100000:1.0:1746144669.532407:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12553 00000100:00100000:2.0:1746144669.532408:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29480:x1830964746955904:12345-192.168.204.23@tcp:49:multiop.0 00000100:00100000:1.0:1746144669.532413:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+20:29471:x1830964746956032:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.532426:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.532444:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff32 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.532469:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.532477:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.532478:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.532481:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.532483:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12554 00000100:00100000:3.0:1746144669.532488:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29476:x1830964746956288:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.532496:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.532506:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff39 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.532511:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29480:x1830964746955904:12345-192.168.204.23@tcp:49:multiop.0 Request processed in 104us (819us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144669.532512:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 13 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.532517:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4177 00010000:00010000:3.0:1746144669.532522:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.532524:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 13 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.532528:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144669.532530:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144669.532533:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4935680->5242879] (req 4935680->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.532536:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747609472:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.532548:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.532557:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 13 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.532564:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747609600:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.532594:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.532595:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12555 00000100:00100000:3.0:1746144669.532599:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+25:29478:x1830964746956416:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:3.0:1746144669.532605:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.532610:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff40 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.532622:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.532627:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144669.532629:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144669.532631:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 26 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.532644:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.532655:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 13 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:3.0:1746144669.532662:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747609728:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144669.532680:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.532699:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.532749:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956160 00000100:00100000:0.0:1746144669.532752:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956160 00000100:00100000:0.0:1746144669.532782:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 656 00000100:00100000:0.0:1746144669.532787:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1961:x1830964746956160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.532796:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.532815:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0fe000/0xa7c849b16e01c0d7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff2b expref: 298 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.532830:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.532835:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.532861:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:1961:x1830964746956160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 74us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.532866:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 656 00000100:00100000:1.0:1746144669.534565:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830964747609472:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.534587:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.534600:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69e00, rc 0) 00000100:00100000:0.0:1746144669.534639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.534657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.534668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.534718:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747609600:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.534727:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16261e74-be72-4bb6-b857-d78345d984f7+21:29471:x1830964746956032:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2314us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.534734:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12553 00010000:00010000:2.0:1746144669.534735:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [4935680->5242879] (req 4935680->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.534743:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f629a00, rc 0) 00000100:00100000:2.0:1746144669.534756:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29476:x1830964746956288:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2268us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.534761:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12554 00000100:00100000:1.0:1746144669.534826:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956672 00000100:00100000:1.0:1746144669.534831:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956672 00000100:00100000:0.0:1746144669.534850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.534851:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956928 00000100:00100000:1.0:1746144669.534853:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956928 00000100:00100000:0.0:1746144669.534891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.535166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.535195:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957184 00000100:00100000:1.0:1746144669.535198:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957184 00000100:00100000:2.0:1746144669.535201:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956544 00000100:00100000:2.0:1746144669.535203:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956544 00000100:00100000:1.0:1746144669.535211:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746956800 00000100:00100000:1.0:1746144669.535213:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746956800 00000100:00100000:2.0:1746144669.535224:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12556 00000100:00100000:1.0:1746144669.535228:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12557 00000100:00100000:2.0:1746144669.535230:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746956672:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:1.0:1746144669.535231:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746956928:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:2.0:1746144669.535386:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144669.535386:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144669.535389:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.535389:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.535391:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.535391:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.535393:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:1.0:1746144669.535393:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:2.0:1746144669.535394:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:1.0:1746144669.535394:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144669.535415:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1961:x1830964746956672:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 185us (779us total) trans 21474840646 rc 0/0 00000100:00100000:1.0:1746144669.535415:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746956928:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 182us (756us total) trans 17179873428 rc 0/0 00000100:00100000:2.0:1746144669.535419:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12556 00000100:00100000:1.0:1746144669.535422:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12557 00000100:00100000:1.0:1746144669.535428:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12558 00000100:00100000:2.0:1746144669.535431:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12559 00000100:00100000:1.0:1746144669.535432:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746957184:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:2.0:1746144669.535437:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746956544:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:2.0:1746144669.535487:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746144669.535487:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746144669.535490:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.535490:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.535491:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.535492:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.535493:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:1.0:1746144669.535493:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:2.0:1746144669.535495:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00002000:00010000:1.0:1746144669.535495:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746144669.535509:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746956544:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 73us (659us total) trans 17179873429 rc 0/0 00000100:00100000:1.0:1746144669.535509:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1961:x1830964746957184:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 76us (839us total) trans 21474840647 rc 0/0 00000100:00100000:2.0:1746144669.535513:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12559 00000100:00100000:1.0:1746144669.535515:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12558 00000100:00100000:2.0:1746144669.535522:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12560 00000100:00100000:2.0:1746144669.535528:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746956800:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:1.0:1746144669.535576:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957056 00000100:00100000:1.0:1746144669.535579:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957056 00000100:00100000:1.0:1746144669.535593:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12561 00000100:00100000:1.0:1746144669.535597:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1961:x1830964746957056:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:0.0:1746144669.535604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.535620:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957312 00000100:00100000:1.0:1746144669.535623:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957312 00000100:00100000:1.0:1746144669.535636:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12562 00000100:00100000:1.0:1746144669.535641:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29480:x1830964746957312:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144669.535647:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.535657:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff47 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.535674:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.535681:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.535683:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.535685:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1392640->1421311] (req 1392640->1421311) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.535706:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.535716:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 16 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.535726:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747609856:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.535763:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af6c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746144669.535822:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:1.0:1746144669.535825:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.535827:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:1.0:1746144669.535828:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:1.0:1746144669.535830:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5617 00000100:00100000:1.0:1746144669.535847:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1961:x1830964746957056:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 249us (680us total) trans 17179873430 rc 0/0 00000100:00100000:1.0:1746144669.535853:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12561 00000100:00100000:3.0:1746144669.536095:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747609728:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.536110:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 26 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.536119:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f628400, rc 0) 00000100:00100000:3.0:1746144669.536157:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:29478:x1830964746956416:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 3557us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.536163:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12555 00002000:00010000:2.0:1746144669.537484:0:4760:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746144669.537488:0:4760:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.537491:0:4760:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144669 -> 1746144669 00002000:00010000:2.0:1746144669.537493:0:4760:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144670 -> 1746144670 00002000:00010000:2.0:1746144669.537495:0:4760:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746144669.537529:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1961:x1830964746956800:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 1999us (2635us total) trans 21474840648 rc 0/0 00000100:00100000:2.0:1746144669.537535:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12560 00000100:00100000:1.0:1746144669.540546:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747609856:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.540578:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1392640->1421311] (req 1392640->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.540596:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69a00, rc 0) 00000100:00100000:1.0:1746144669.540741:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29480:x1830964746957312:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 5097us (5134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.540750:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12562 00000100:00100000:0.0:1746144669.542476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.542513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.542543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.542708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.542736:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746958080 00000100:00100000:3.0:1746144669.542743:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746958080 00000100:00100000:2.0:1746144669.542824:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957440 00000100:00100000:2.0:1746144669.542829:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957440 00000100:00100000:3.0:1746144669.542854:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4178 00000100:00100000:3.0:1746144669.542861:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+7:29466:x1830964746958080:12345-192.168.204.23@tcp:35:lfs.0 00010000:00010000:2.0:1746144669.542864:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.542889:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957696 00000100:00100000:1.0:1746144669.542893:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957696 00010000:00010000:1.0:1746144669.542906:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 18 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.543346:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957568 00000100:00100000:2.0:1746144669.543349:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957568 00010000:00010000:2.0:1746144669.543364:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.543418:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6274 00000100:00100000:1.0:1746144669.543424:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+18:1960:x1830964746957440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.543434:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.543453:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 18 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.543463:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 18 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.543484:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7faa00/0xa7c849b16e01c0bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff0f expref: 18 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.543501:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.543503:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.543510:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 25 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.543517:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 25 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.543546:0:7100:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 25 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.543557:0:7100:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747609984:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144669.543558:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29466:x1830964746958080:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 698us (1014us total) trans 8589944158 rc 0/0 00000100:00100000:3.0:1746144669.543564:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4178 00000100:00100000:3.0:1746144669.543586:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6275 00000100:00100000:3.0:1746144669.543591:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1960:x1830964746957696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.543597:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144669.543602:0:7100:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144669.543608:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.543615:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.543626:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135782200/0xa7c849b16e01c0c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff16 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.543657:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6276 00000100:00100000:2.0:1746144669.543665:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1960:x1830964746957568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.543672:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.543687:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.543694:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.543705:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c02fc00/0xa7c849b16e01c0b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff08 expref: 17 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.543718:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.543720:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.543724:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.543730:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.543739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144669.543747:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.543754:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747610112:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144669.543754:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746957824 00000100:00100000:0.0:1746144669.543757:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746957824 00010000:00010000:0.0:1746144669.543774:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 17 pid: 22208 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.543775:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.543787:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6277 00000100:00100000:0.0:1746144669.543792:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1960:x1830964746957824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.543798:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.543927:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 17 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.543937:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 17 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.543948:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c0c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff1d expref: 17 pid: 22208 timeout: 748 lvb_type: 0 00010000:00010000:0.0:1746144669.543956:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.543958:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.543962:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.543969:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.543988:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.543996:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b570700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747610240:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144669.544016:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf09c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144669.546160:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.546164:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.546179:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.546189:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.546226:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.546237:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747610368:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144669.546313:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.549187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.549206:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747610368:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144669.549222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144669.549227:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.549247:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746958720 00000100:00100000:0.0:1746144669.549253:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746958720 00000100:00100000:3.0:1746144669.549264:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1960:x1830964746957696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5673us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.549274:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6275 00002000:00100000:0.0:1746144669.549299:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1392640->1396735) req@ffff88012b572300 x1830964746958720/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746144669.549304:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746958848 00000100:00100000:3.0:1746144669.549306:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746958848 00002000:00100000:0.0:1746144669.549309:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572300 with x1830964746958720 ext(1392640->1396735) 00002000:00010000:0.0:1746144669.549313:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b572300 00002000:00100000:3.0:1746144669.549319:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (2019328->2023423) req@ffff88012b570e00 x1830964746958848/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.549325:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570e00 with x1830964746958848 ext(2019328->2023423) 00000100:00100000:0.0:1746144669.549327:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4876 00002000:00010000:3.0:1746144669.549328:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b570e00 00000100:00100000:0.0:1746144669.549333:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746958720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144669.549337:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4877 00000100:00100000:3.0:1746144669.549340:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746958848:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144669.549465:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746958720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 132us (289us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144669.549467:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+26:1960:x1830964746958848:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 126us (245us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144669.549471:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4876 00000100:00100000:3.0:1746144669.549473:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4877 00002000:00100000:0.0:1746144669.549475:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1392640->1396735) req@ffff88012b572300 x1830964746958720/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.549477:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (2019328->2023423) req@ffff88012b570e00 x1830964746958848/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.549483:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570e00 with x1830964746958848 ext(2019328->2023423) 00002000:00100000:0.0:1746144669.549483:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572300 with x1830964746958720 ext(1392640->1396735) 00002000:00010000:3.0:1746144669.549485:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b570e00 00002000:00010000:0.0:1746144669.549485:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b572300 00000100:00100000:0.0:1746144669.549510:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b570700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747610240:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144669.549521:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.549533:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1960:x1830964746957824:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5741us (5794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.549543:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6277 00000100:00100000:1.0:1746144669.549702:0:7100:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7100:1830964747609984:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144669.549713:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.549731:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1960:x1830964746957440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6308us (7260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.549737:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6274 00000100:00100000:2.0:1746144669.549837:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747610112:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.549866:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.549887:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1960:x1830964746957568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6224us (7178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.549892:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6276 00000100:00100000:0.0:1746144669.550270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.550691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.551431:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746958464 00000100:00100000:2.0:1746144669.551437:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746958464 00000100:00100000:2.0:1746144669.551479:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4179 00000100:00100000:2.0:1746144669.551485:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+8:29466:x1830964746958464:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1746144669.551620:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746959104 00000100:00100000:1.0:1746144669.551624:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746959104 00002000:00100000:1.0:1746144669.551646:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012b570700 x1830964746959104/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.551654:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570700 with x1830964746959104 ext(2097152->3145727) 00002000:00010000:1.0:1746144669.551658:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b570700 00000100:00100000:1.0:1746144669.551670:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4878 00000100:00100000:1.0:1746144669.551676:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746959104:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144669.551985:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29466:x1830964746958464:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 499us (1715us total) trans 8589944159 rc 0/0 00000100:00100000:2.0:1746144669.551991:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4179 00000100:00100000:2.0:1746144669.555029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.555062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.555075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.555087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.555120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.555157:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746959232 00000100:00100000:2.0:1746144669.555164:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746959232 00000100:00100000:2.0:1746144669.555213:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746959360 00000100:00100000:2.0:1746144669.555215:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746959360 00000100:00100000:2.0:1746144669.555228:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746959488 00000100:00100000:2.0:1746144669.555229:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746959488 00000100:00100000:2.0:1746144669.555239:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746959616 00000100:00100000:2.0:1746144669.555240:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746959616 00000100:00100000:2.0:1746144669.555249:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746959744 00000100:00100000:2.0:1746144669.555250:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746959744 00000100:00100000:2.0:1746144669.555267:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12563 00000100:00100000:2.0:1746144669.555274:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746959232:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.555292:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.555311:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f600/0xa7c849b16e01c0fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff4e expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.555365:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747610496:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.555436:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.555454:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12564 00000100:00100000:3.0:1746144669.555461:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12565 00000100:00100000:2.0:1746144669.555461:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746959360:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144669.555467:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746959488:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.555469:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.555472:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.555479:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f629e00/0xa7c849b16e01c108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff5c expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.555479:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135782c00/0xa7c849b16e01c101 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff55 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.555502:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747610624:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.555502:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747610752:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.555532:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.555546:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12566 00000100:00100000:2.0:1746144669.555553:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746959616:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.555559:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.555565:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff63 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.555575:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.555577:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.555585:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.555604:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.555613:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783800, rc 0) 00000100:00100000:0.0:1746144669.555665:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12567 00000100:00100000:0.0:1746144669.555678:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+26:29478:x1830964746959744:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144669.555685:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.555692:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff6a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.555708:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 46 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.555714:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.555715:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144669.555718:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.555735:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e840 going to sleep for 11 seconds 00010000:00010000:0.0:1746144669.555736:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 46 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.555747:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 46 pid: 4760 timeout: 748 lvb_type: 0 00000100:00100000:0.0:1746144669.555755:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b571f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747610880:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.555778:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.557432:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746959616:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1870us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.557439:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12566 00000100:00100000:0.0:1746144669.557870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.558188:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b571f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747610880:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.558216:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.558233:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0ffc00, rc 0) 00000100:00100000:1.0:1746144669.558264:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:29478:x1830964746959744:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2593us (3143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.558270:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12567 00000100:00100000:2.0:1746144669.558417:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747610752:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.558450:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135782c00/0xa7c849b16e01c101 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff55 expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.558460:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135782c00/0xa7c849b16e01c101 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff55 expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.558480:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135782c00, rc 0) 00000100:00100000:2.0:1746144669.558505:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746959360:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3045us (3442us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.558511:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12564 00000100:00100000:2.0:1746144669.558550:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747610496:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.558565:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f600/0xa7c849b16e01c0fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff4e expref: 46 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.558572:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee5f600/0xa7c849b16e01c0fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff4e expref: 46 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.558583:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f600, rc 0) 00000100:00100000:2.0:1746144669.558613:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746959232:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3340us (3598us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.558619:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12563 00000100:00100000:3.0:1746144669.559565:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746960000 00000100:00100000:3.0:1746144669.559573:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746960000 00002000:00100000:3.0:1746144669.559611:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1417216->1421311) req@ffff88012b572a00 x1830964746960000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.559620:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572a00 with x1830964746960000 ext(1417216->1421311) 00002000:00010000:3.0:1746144669.559624:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b572a00 00000100:00100000:3.0:1746144669.559657:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4879 00000100:00100000:3.0:1746144669.559663:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746960000:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144669.559829:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746960000:12345-192.168.204.23@tcp:3:cat.0 Request processed in 165us (1959us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144669.559835:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4879 00002000:00100000:3.0:1746144669.559840:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1417216->1421311) req@ffff88012b572a00 x1830964746960000/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.559848:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572a00 with x1830964746960000 ext(1417216->1421311) 00002000:00010000:3.0:1746144669.559850:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b572a00 00002000:00010000:3.0:1746144669.561059:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime: 1746144669 -> 1746144670 00002000:00010000:3.0:1746144669.561064:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime: 1746144669 -> 1746144670 00000100:00100000:3.0:1746144669.561079:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747610624:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144669.561104:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f629e00/0xa7c849b16e01c108 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff5c expref: 44 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.561116:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f629e00/0xa7c849b16e01c108 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff5c expref: 44 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.561155:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f629e00, rc 0) 00000100:00100000:3.0:1746144669.561193:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1962:x1830964746959488:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5725us (6115us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.561209:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12565 00000100:00100000:0.0:1746144669.563480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.563552:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746960256 00000100:00100000:2.0:1746144669.563562:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746960256 00000100:00100000:2.0:1746144669.563626:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4180 00000100:00100000:2.0:1746144669.563633:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29480:x1830964746960256:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144669.563827:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29480:x1830964746960256:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 194us (352us total) trans 8589944160 rc 0/0 00000100:00100000:2.0:1746144669.563832:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4180 00000100:00100000:1.0:1746144669.563860:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746959104:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 12183us (13169us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.563868:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4878 00002000:00100000:1.0:1746144669.563876:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012b570700 x1830964746959104/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.563885:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570700 with x1830964746959104 ext(2097152->3145727) 00002000:00010000:1.0:1746144669.563889:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b570700 00000100:00100000:0.0:1746144669.565719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.565810:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746960512 00000100:00100000:1.0:1746144669.565816:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746960512 00002000:00100000:1.0:1746144669.565857:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4935680->4939775) req@ffff88012b570380 x1830964746960512/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.565867:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570380 with x1830964746960512 ext(4935680->4939775) 00010000:00010000:1.0:1746144669.565877:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.565898:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746144669.565905:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b570380 00000100:00100000:1.0:1746144669.565932:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 975 00000100:00100000:1.0:1746144669.565940:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746960512:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.566437:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1960:x1830964746960512:12345-192.168.204.23@tcp:3:cat.0 Request processed in 497us (723us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144669.566444:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 975 00002000:00100000:1.0:1746144669.566449:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (4935680->4939775) req@ffff88012b570380 x1830964746960512/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.566456:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b570380 with x1830964746960512 ext(4935680->4939775) 00010000:00010000:1.0:1746144669.566461:0:8458:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00010000:00010000:1.0:1746144669.566470:0:8458:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00002000:00010000:1.0:1746144669.566475:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b570380 00000100:00100000:0.0:1746144669.572631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.572736:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746960640 00000100:00100000:2.0:1746144669.572746:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746960640 00010000:00010000:2.0:1746144669.572786:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.572824:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6278 00000100:00100000:2.0:1746144669.572833:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1961:x1830964746960640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.572847:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.572871:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.572883:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.572912:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f629a00/0xa7c849b16e01c0e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4935680->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff39 expref: 43 pid: 4760 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.572946:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.572949:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.572956:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.572965:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.573000:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.573012:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747611008:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.573100:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.576553:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747611008:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.576595:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.576649:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746960640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3816us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.576660:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6278 00000100:00100000:0.0:1746144669.581002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.581061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.581191:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746960896 00000100:00100000:1.0:1746144669.581202:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746960896 00002000:00100000:1.0:1746144669.581248:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b572680 x1830964746960896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.581259:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572680 with x1830964746960896 ext(3145728->4194303) 00002000:00010000:1.0:1746144669.581265:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572680 00000100:00100000:2.0:1746144669.581342:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746961024 00000100:00100000:2.0:1746144669.581345:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746961024 00002000:00100000:2.0:1746144669.581375:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2547712->2551807) req@ffff88012b571180 x1830964746961024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.581387:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571180 with x1830964746961024 ext(2547712->2551807) 00002000:00010000:2.0:1746144669.581389:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b571180 00000100:00100000:1.0:1746144669.581951:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4880 00000100:00100000:1.0:1746144669.581960:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746960896:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144669.582327:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4881 00000100:00100000:2.0:1746144669.582335:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746961024:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144669.582471:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+28:1960:x1830964746961024:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 137us (1409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144669.582477:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4881 00002000:00100000:2.0:1746144669.582482:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2547712->2551807) req@ffff88012b571180 x1830964746961024/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.582489:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571180 with x1830964746961024 ext(2547712->2551807) 00002000:00010000:2.0:1746144669.582492:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b571180 00000100:00100000:0.0:1746144669.592561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.593930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.593994:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746961664 00000100:00100000:3.0:1746144669.594001:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746961408 00000100:00100000:2.0:1746144669.594004:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746961664 00000100:00100000:3.0:1746144669.594006:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746961408 00002000:00100000:3.0:1746144669.594047:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b571880 x1830964746961408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.594058:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571880 with x1830964746961408 ext(3145728->4194303) 00000100:00100000:2.0:1746144669.594058:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4181 00002000:00010000:3.0:1746144669.594064:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b571880 00000100:00100000:2.0:1746144669.594066:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+8:29478:x1830964746961664:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:3.0:1746144669.594077:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4882 00000100:00100000:3.0:1746144669.594082:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746961408:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:2.0:1746144669.594280:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+9:29478:x1830964746961664:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 215us (363us total) trans 8589944161 rc 0/0 00000100:00100000:2.0:1746144669.594287:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4181 00000100:00100000:1.0:1746144669.595293:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746960896:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 13331us (14301us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.595301:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4880 00002000:00100000:1.0:1746144669.595308:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012b572680 x1830964746960896/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.595316:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b572680 with x1830964746960896 ext(3145728->4194303) 00002000:00010000:1.0:1746144669.595320:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b572680 00000100:00100000:3.0:1746144669.604334:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746961408:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 9636us (11167us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.604349:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4882 00002000:00100000:3.0:1746144669.604363:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012b571880 x1830964746961408/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.604373:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b571880 with x1830964746961408 ext(3145728->4194303) 00002000:00010000:3.0:1746144669.604380:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b571880 00000100:00100000:0.0:1746144669.607622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.607750:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746961792 00000100:00100000:0.0:1746144669.607753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.607759:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746961792 00000100:00100000:3.0:1746144669.607800:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746961920 00000100:00100000:3.0:1746144669.607802:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746961920 00000100:00100000:2.0:1746144669.607813:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12568 00000100:00100000:0.0:1746144669.607835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.607836:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12569 00000100:00100000:2.0:1746144669.607837:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746961792:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:3.0:1746144669.607842:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746961920:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.607855:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.607855:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144669.607865:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962048 00000100:00100000:0.0:1746144669.607867:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962048 00010000:00010000:3.0:1746144669.607873:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c11d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff78 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.607873:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01c124 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff71 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.607889:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12570 00000100:00100000:0.0:1746144669.607893:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746962048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.607899:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.607906:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0fec00/0xa7c849b16e01c12b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff7f expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.607934:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747611264:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.607934:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747611136:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.607941:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747611392:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.608005:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.608186:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.608194:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.609816:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747611136:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.609858:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01c124 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff71 expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.609871:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01c124 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff71 expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.609885:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783600, rc 0) 00000100:00100000:2.0:1746144669.609915:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+27:1962:x1830964746961792:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2093us (2304us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.609934:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12568 00000100:00100000:3.0:1746144669.610043:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747611264:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144669.610060:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c11d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff78 expref: 24 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.610068:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c11d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff78 expref: 24 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.610079:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19d200, rc 0) 00000100:00100000:3.0:1746144669.610095:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746961920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2254us (2342us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.610101:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12569 00002000:00010000:1.0:1746144669.610184:0:8388:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime: 1746144669 -> 1746144670 00002000:00010000:1.0:1746144669.610188:0:8388:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime: 1746144669 -> 1746144670 00000100:00100000:1.0:1746144669.610197:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747611392:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.610226:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0fec00/0xa7c849b16e01c12b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff7f expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.610238:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0fec00/0xa7c849b16e01c12b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff7f expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.610249:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0fec00, rc 0) 00000100:00100000:1.0:1746144669.610266:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746962048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2373us (2432us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.610271:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12570 00000100:00100000:2.0:1746144669.614767:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.614888:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962304 00000100:00100000:3.0:1746144669.614899:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962304 00002000:00100000:3.0:1746144669.614959:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800943fb480 x1830964746962304/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.614970:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fb480 with x1830964746962304 ext(4194304->4939775) 00002000:00010000:3.0:1746144669.614976:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943fb480 00000100:00100000:3.0:1746144669.615222:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4883 00000100:00100000:3.0:1746144669.615231:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746962304:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144669.622636:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746962304:12345-192.168.204.23@tcp:3:cat.0 Request processed in 7393us (7867us total) trans 0 rc 745472/745472 00000100:00100000:3.0:1746144669.622653:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4883 00002000:00100000:3.0:1746144669.622666:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800943fb480 x1830964746962304/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.622675:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943fb480 with x1830964746962304 ext(4194304->4939775) 00002000:00010000:3.0:1746144669.622681:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800943fb480 00000100:00100000:0.0:1746144669.628253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.628301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.628335:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962560 00000100:00100000:1.0:1746144669.628346:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962560 00000100:00100000:0.0:1746144669.628347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.628400:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962432 00000100:00100000:2.0:1746144669.628403:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962432 00000100:00100000:2.0:1746144669.628461:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962688 00000100:00100000:2.0:1746144669.628463:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962688 00000100:00100000:2.0:1746144669.628480:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12571 00000100:00100000:2.0:1746144669.628487:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746962432:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.628505:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.628524:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01c132 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff86 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.628575:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747611520:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.628645:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.628751:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12572 00000100:00100000:2.0:1746144669.628757:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746962688:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.628764:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.628773:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e01c139 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff94 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.628795:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747611648:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.628813:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.628912:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12573 00000100:00100000:1.0:1746144669.628925:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746962560:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.628932:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.628940:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f68e00/0xa7c849b16e01c140 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff8d expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.628963:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747611776:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144669.628989:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.631613:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747611648:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144669.631657:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e01c139 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff94 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.631671:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee5f200/0xa7c849b16e01c139 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff94 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.631692:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5f200, rc 0) 00000100:00100000:3.0:1746144669.631730:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746962688:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2972us (3382us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.631737:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12572 00000100:00100000:2.0:1746144669.632018:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747611520:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.632037:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01c132 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff86 expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.632047:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135783600/0xa7c849b16e01c132 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff86 expref: 28 pid: 30345 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746144669.633449:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747611776:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.633470:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f68e00/0xa7c849b16e01c140 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff8d expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.633480:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f68e00/0xa7c849b16e01c140 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff8d expref: 22 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.633492:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f68e00, rc 0) 00000100:00100000:1.0:1746144669.633517:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+21:1963:x1830964746962560:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4601us (5276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.633522:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12573 00010000:00010000:2.0:1746144669.633804:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135783600, rc 0) 00000100:00100000:2.0:1746144669.633826:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+27:1963:x1830964746962432:12345-192.168.204.23@tcp:101:cat.0 Request processed in 5339us (5525us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.633831:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12571 00000100:00100000:2.0:1746144669.636865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.637012:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962816 00000100:00100000:0.0:1746144669.637021:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962816 00000100:00100000:1.0:1746144669.637270:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12574 00000100:00100000:1.0:1746144669.637280:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746962816:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:2.0:1746144669.637338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.637581:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746962944 00000100:00100000:0.0:1746144669.637585:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746962944 00010000:00010000:1.0:1746144669.637588:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.637607:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c147 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ff9b expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.637615:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12575 00000100:00100000:0.0:1746144669.637621:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+21:1961:x1830964746962944:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.637629:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.637638:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5600/0xa7c849b16e01c14e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffa2 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.637662:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747612032:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.637662:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747611904:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144669.637852:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.637887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.637927:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.637983:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746963072 00000100:00100000:3.0:1746144669.637989:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746963072 00000100:00100000:3.0:1746144669.638008:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12576 00000100:00100000:3.0:1746144669.638013:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+23:1960:x1830964746963072:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.638019:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.638026:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c155 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffa9 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144669.638049:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747612160:192.168.204.23@tcp:106: 00000100:00100000:3.0:1746144669.638070:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.639649:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747612032:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.639679:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c147 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff9b expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.639693:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c147 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff9b expref: 28 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.639705:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69800, rc 0) 00000100:00100000:1.0:1746144669.639737:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746962816:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2459us (2880us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.639743:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12574 00000100:00100000:2.0:1746144669.639830:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747611904:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.639850:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5600/0xa7c849b16e01c14e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffa2 expref: 24 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.639860:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5600/0xa7c849b16e01c14e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffa2 expref: 24 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.639868:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5600, rc 0) 00000100:00100000:2.0:1746144669.639886:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746962944:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2265us (2548us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.639896:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12575 00000100:00100000:3.0:1746144669.639975:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830964747612160:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144669.639990:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c155 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffa9 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.639999:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c155 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffa9 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.640010:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19ce00, rc 0) 00000100:00100000:3.0:1746144669.640027:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16261e74-be72-4bb6-b857-d78345d984f7+21:1960:x1830964746963072:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2014us (2141us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.640033:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12576 00000100:00100000:0.0:1746144669.644009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.644167:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746963328 00000100:00100000:2.0:1746144669.644176:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746963328 00000100:00100000:2.0:1746144669.644232:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4182 00000100:00100000:2.0:1746144669.644239:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+9:29471:x1830964746963328:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144669.644451:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16261e74-be72-4bb6-b857-d78345d984f7+10:29471:x1830964746963328:12345-192.168.204.23@tcp:35:cat.0 Request processed in 211us (452us total) trans 8589944162 rc 0/0 00000100:00100000:2.0:1746144669.644457:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4182 00000100:00100000:0.0:1746144669.694259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.694329:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746963584 00000100:00100000:3.0:1746144669.694339:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746963584 00000100:00100000:3.0:1746144669.694647:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10254 00000100:00100000:3.0:1746144669.694656:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29488:x1830964746963584:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1746144669.694684:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144669.694703:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01c15c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffb0 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.694836:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.694850:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.694861:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.694879:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.694884:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.694889:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695012:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695019:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695024:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144669.695032:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144669.695126:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695172:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695179:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695184:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.695187:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695193:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695203:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:3.0:1746144669.695206:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.695210:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695214:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695241:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695246:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695250:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695254:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:3.0:1746144669.695256:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695260:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695266:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012c041d00) 00010000:00010000:3.0:1746144669.695268:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144669.695269:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695273:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c16a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.695356:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19da00/0xa7c849b16e01c15c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.695369:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 300 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.695375:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.695377:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144669.695380:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19c200, rc 0) 00000100:00100000:3.0:1746144669.695773:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29488:x1830964746963584:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1116us (1522us total) trans 8589944163 rc 0/0 00000100:00100000:3.0:1746144669.695781:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10254 00000100:00100000:0.0:1746144669.697487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.697576:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746963840 00000100:00100000:2.0:1746144669.697585:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746963840 00000100:00100000:2.0:1746144669.697645:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4183 00000100:00100000:2.0:1746144669.697653:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+300:29488:x1830964746963840:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1746144669.697951:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29488:x1830964746963840:12345-192.168.204.23@tcp:35:cat.0 Request processed in 297us (469us total) trans 8589944164 rc 0/0 00000100:00100000:2.0:1746144669.697957:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4183 00000100:00100000:0.0:1746144669.701123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.701206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.701225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.701255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.701277:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746963968 00000100:00100000:0.0:1746144669.701285:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746963968 00000100:00100000:0.0:1746144669.701325:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964096 00000100:00100000:0.0:1746144669.701326:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964096 00000100:00100000:0.0:1746144669.701338:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964224 00000100:00100000:0.0:1746144669.701340:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964224 00000100:00100000:0.0:1746144669.701350:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964352 00000100:00100000:0.0:1746144669.701352:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964352 00000100:00100000:0.0:1746144669.701366:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12577 00000100:00100000:0.0:1746144669.701373:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746963968:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.701393:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.701410:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc5400/0xa7c849b16e01c17f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffb7 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.701468:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747612288:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.701551:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.701574:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12578 00000100:00100000:0.0:1746144669.701579:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746964096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.701587:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.701597:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc4000/0xa7c849b16e01c186 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffbe expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144669.701620:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747612416:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.701641:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.701650:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12579 00000100:00100000:0.0:1746144669.701655:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12580 00000100:00100000:1.0:1746144669.701657:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746964224:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144669.701659:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746964352:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.701663:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.701663:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.701670:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01c18d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffcc expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.701671:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f69600/0xa7c849b16e01c194 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffc5 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.701691:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747612672:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.701691:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801309d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747612544:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144669.701745:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.701908:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf03c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746144669.704275:0:4758:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime: 1746144669 -> 1746144670 00002000:00010000:0.0:1746144669.704283:0:4758:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime: 1746144669 -> 1746144670 00000100:00100000:0.0:1746144669.704306:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:4758:1830964747612544:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144669.704346:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01c18d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffcc expref: 47 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.704366:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5113200/0xa7c849b16e01c18d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffcc expref: 47 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144669.704380:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5113200, rc 0) 00000100:00100000:0.0:1746144669.704434:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746964352:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2773us (3176us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144669.704441:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12580 00000100:00100000:3.0:1746144669.704607:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747612672:192.168.204.23@tcp:106: 00010000:00010000:3.0:1746144669.704625:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f69600/0xa7c849b16e01c194 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffc5 expref: 45 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.704633:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f69600/0xa7c849b16e01c194 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffc5 expref: 45 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144669.704645:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69600, rc 0) 00000100:00100000:3.0:1746144669.704665:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1961:x1830964746964224:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3009us (3439us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144669.704671:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12579 00000100:00100000:1.0:1746144669.704698:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747612416:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.704716:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc4000/0xa7c849b16e01c186 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffbe expref: 28 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.704726:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4000/0xa7c849b16e01c186 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffbe expref: 28 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.704742:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4000, rc 0) 00000100:00100000:1.0:1746144669.704849:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746964096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3268us (3641us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.704854:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12578 00000100:00100000:2.0:1746144669.704981:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801309d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747612288:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144669.704997:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc5400/0xa7c849b16e01c17f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb7 expref: 43 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.705005:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc5400/0xa7c849b16e01c17f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb7 expref: 43 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144669.705012:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5400, rc 0) 00000100:00100000:2.0:1746144669.705029:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:1961:x1830964746963968:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3658us (3918us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144669.705034:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12577 00000100:00100000:0.0:1746144669.708130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.708898:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964480 00000100:00100000:1.0:1746144669.708908:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964480 00000100:00100000:1.0:1746144669.708977:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12581 00000100:00100000:1.0:1746144669.708986:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+42:29488:x1830964746964480:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.709005:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.709025:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffd3 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.709055:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.709062:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.709063:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.709066:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.709096:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.709113:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 14 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.709124:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747612800:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.709219:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.711987:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747612800:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.712017:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.712034:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69200, rc 0) 00000100:00100000:1.0:1746144669.712076:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29488:x1830964746964480:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3090us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.712084:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12581 00000100:00100000:0.0:1746144669.713004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.713077:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964608 00000100:00100000:2.0:1746144669.713084:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964608 00010000:00010000:2.0:1746144669.713119:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.713177:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6279 00000100:00100000:2.0:1746144669.713186:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746964608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.713200:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.713225:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.713237:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.713261:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c067 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fec9 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.713281:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.713284:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.713292:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.713299:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.713333:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 42 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.713345:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747612928:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.713418:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144669.717299:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747612928:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144669.717338:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.717392:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746964608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4207us (4388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.717403:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6279 00000100:00100000:0.0:1746144669.718612:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.718697:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964864 00000100:00100000:3.0:1746144669.718705:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964864 00002000:00100000:3.0:1746144669.718745:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8801309d5c00 x1830964746964864/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.718756:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5c00 with x1830964746964864 ext(0->1048575) 00002000:00010000:3.0:1746144669.718761:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5c00 00000100:00100000:3.0:1746144669.718786:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4884 00000100:00100000:3.0:1746144669.718792:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746964864:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144669.726904:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:1963:x1830964746964864:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8100us (8284us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.726926:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4884 00002000:00100000:3.0:1746144669.726940:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8801309d5c00 x1830964746964864/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.726950:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5c00 with x1830964746964864 ext(0->1048575) 00002000:00010000:3.0:1746144669.726955:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5c00 00010000:00010000:0.0:1746144669.729385:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144669.732944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.733288:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746964992 00000100:00100000:1.0:1746144669.733299:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746964992 00000100:00100000:1.0:1746144669.733354:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12582 00000100:00100000:1.0:1746144669.733361:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:29488:x1830964746964992:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.733381:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.733399:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffda expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.733432:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.733444:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.733446:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.733449:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.733476:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.733487:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 14 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.733498:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747613056:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.734823:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.739412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.739523:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746965120 00000100:00100000:2.0:1746144669.739533:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746965120 00010000:00010000:2.0:1746144669.739591:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:2.0:1746144669.739625:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6280 00000100:00100000:2.0:1746144669.739635:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746965120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.739652:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.739676:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.739693:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00010000:00010000:2.0:1746144669.739720:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.739722:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.739729:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.739737:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.739769:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144669.739781:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747613184:192.168.204.23@tcp:105: 00000100:00100000:2.0:1746144669.739864:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401540 going to sleep for 11 seconds 00010000:00010000:1.0:1746144669.740612:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4800/0xa7c849b16e01c083 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fee5 expref: 15 pid: 8450 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.740643:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747613056:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.740667:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 28 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.740677:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69400, rc 0) 00000100:00100000:1.0:1746144669.740720:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29488:x1830964746964992:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7358us (7786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.740728:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12582 00000100:00100000:0.0:1746144669.745940:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747613184:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144669.745985:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.746046:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746965120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6411us (6644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.746058:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6280 00000100:00100000:2.0:1746144669.746148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.746241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.746714:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746965504 00000100:00100000:0.0:1746144669.746721:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746965504 00002000:00100000:0.0:1746144669.746766:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012ce84000 x1830964746965504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 504/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.746775:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84000 with x1830964746965504 ext(1048576->2097151) 00002000:00010000:0.0:1746144669.746780:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84000 00000100:00100000:0.0:1746144669.746807:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746965376 00000100:00100000:0.0:1746144669.746810:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746965376 00002000:00100000:0.0:1746144669.746824:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880093762d80 x1830964746965376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.746830:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762d80 with x1830964746965376 ext(1048576->2097151) 00002000:00010000:0.0:1746144669.746833:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093762d80 00000100:00100000:0.0:1746144669.746851:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4885 00000100:00100000:0.0:1746144669.746858:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746965504:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.748365:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4886 00000100:00100000:0.0:1746144669.748374:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746965376:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.766649:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746965376:12345-192.168.204.23@tcp:3:cat.0 Request processed in 18263us (20392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.766662:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4886 00002000:00100000:1.0:1746144669.766675:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff880093762d80 x1830964746965376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.766684:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093762d80 with x1830964746965376 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.766690:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093762d80 00000100:00100000:2.0:1746144669.767049:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1960:x1830964746965504:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20190us (20913us total) trans 0 rc 1019904/1019904 00000100:00100000:2.0:1746144669.767057:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4885 00002000:00100000:2.0:1746144669.767062:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88012ce84000 x1830964746965504/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 504/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.767069:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce84000 with x1830964746965504 ext(1048576->2097151) 00002000:00010000:2.0:1746144669.767072:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce84000 00000100:00100000:0.0:1746144669.784922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.785013:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746965760 00000100:00100000:1.0:1746144669.785025:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746965760 00000100:00100000:1.0:1746144669.785085:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12583 00000100:00100000:1.0:1746144669.785093:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+43:29488:x1830964746965760:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.785113:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.785131:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffe1 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.785186:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 26 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.785194:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.785196:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.785199:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.785229:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 26 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.785242:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 26 pid: 30345 timeout: 748 lvb_type: 0 00000100:00100000:1.0:1746144669.785258:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747613312:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.785372:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.793204:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747613312:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.793243:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.793263:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69800, rc 0) 00000100:00100000:1.0:1746144669.793328:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:29488:x1830964746965760:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8235us (8427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.793330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.793337:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12583 00000100:00100000:3.0:1746144669.793685:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746966016 00000100:00100000:3.0:1746144669.793694:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746966016 00002000:00100000:3.0:1746144669.793736:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (2019328->2097151) req@ffff8801309d4380 x1830964746966016/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.793744:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4380 with x1830964746966016 ext(2019328->2097151) 00010000:00010000:3.0:1746144669.793751:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 27 pid: 30345 timeout: 748 lvb_type: 0 00010000:00010000:3.0:1746144669.793763:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 27 pid: 30345 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746144669.793769:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801309d4380 00000100:00100000:3.0:1746144669.793785:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 976 00000100:00100000:3.0:1746144669.793793:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+27:1960:x1830964746966016:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144669.794274:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.794340:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746966144 00000100:00100000:2.0:1746144669.794344:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746966144 00000100:00100000:2.0:1746144669.794388:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10255 00000100:00100000:2.0:1746144669.794394:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+301:29490:x1830964746966144:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.794409:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.794425:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01c1b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffe8 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.794514:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.794533:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 302 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.794540:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.794570:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 302 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.794580:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 302 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746144669.794590:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a51ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747613440:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144669.794641:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.798454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.798962:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+29:1960:x1830964746966016:12345-192.168.204.23@tcp:4:cat.0 Request processed in 5167us (5629us total) trans 17179873431 rc 0/0 00000100:00100000:3.0:1746144669.798975:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 976 00002000:00100000:3.0:1746144669.798988:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (2019328->2097151) req@ffff8801309d4380 x1830964746966016/t17179873431(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.798997:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d4380 with x1830964746966016 ext(2019328->2097151) 00010000:00010000:3.0:1746144669.799006:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 29 pid: 30345 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144669.799019:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 29 pid: 30345 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746144669.799026:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801309d4380 00000100:00100000:3.0:1746144669.799095:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a51ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747613440:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144669.799123:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144669.799645:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746966272 00000100:00100000:1.0:1746144669.799653:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746966272 00010000:00010000:1.0:1746144669.799679:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.799700:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6281 00000100:00100000:1.0:1746144669.799705:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1961:x1830964746966272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.799719:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.799725:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.799738:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.799759:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c200/0xa7c849b16e01c171 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffb0 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.799780:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144669.799784:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.799792:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.799798:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144669.800018:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.800050:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1961:x1830964746966272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 344us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.800056:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6281 00010000:00010000:3.0:1746144669.800360:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144669.800368:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144669.800388:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144669.800511:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5ea00/0xa7c849b16e01c1b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 303 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.800538:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 302 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144669.800549:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144669.800552:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144669.800554:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5e000, rc 0) 00000100:00100000:3.0:1746144669.800585:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29490:x1830964746966144:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6191us (6312us total) trans 8589944165 rc 0/0 00000100:00100000:3.0:1746144669.800591:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10255 00000100:00100000:0.0:1746144669.801355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.801440:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746966400 00000100:00100000:1.0:1746144669.801444:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746966400 00010000:00010000:1.0:1746144669.801462:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 29 pid: 30345 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.801478:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6282 00000100:00100000:1.0:1746144669.801483:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+29:1963:x1830964746966400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.801492:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.801512:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 29 pid: 30345 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.801521:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 29 pid: 30345 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.801544:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f628400/0xa7c849b16e01c0ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff40 expref: 29 pid: 30345 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.801558:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.801560:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.801566:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.801574:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.801602:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 43 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.801613:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747613568:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.802409:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.804708:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747613568:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144669.804731:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.805287:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+28:1963:x1830964746966400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3801us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.805298:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6282 00000100:00100000:0.0:1746144669.811337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.813388:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746966656 00000100:00100000:3.0:1746144669.813403:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746966656 00002000:00100000:3.0:1746144669.813461:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8801309d5880 x1830964746966656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.813472:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5880 with x1830964746966656 ext(1048576->2097151) 00002000:00010000:3.0:1746144669.813478:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5880 00000100:00100000:3.0:1746144669.813521:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4887 00000100:00100000:3.0:1746144669.813531:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746966656:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.835976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.836783:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746966656:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23250us (25456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144669.836796:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4887 00002000:00100000:3.0:1746144669.836808:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff8801309d5880 x1830964746966656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.836817:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801309d5880 with x1830964746966656 ext(1048576->2097151) 00002000:00010000:3.0:1746144669.836823:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801309d5880 00000100:00100000:2.0:1746144669.841798:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746966912 00000100:00100000:2.0:1746144669.841812:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746966912 00000100:00100000:2.0:1746144669.841900:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10256 00000100:00100000:2.0:1746144669.841909:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+10:29492:x1830964746966912:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:2.0:1746144669.841942:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.841961:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01c1c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152ffef expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.842081:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842095:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842105:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842119:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842124:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842128:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842258:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01c1da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842265:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01c1da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842270:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01c1da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144669.842278:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144669.842358:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842368:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842374:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842379:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5fe00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144669.842382:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842388:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842397:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144669.842400:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144669.842404:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842408:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fe00/0xa7c849b16e01c1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842433:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842437:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842441:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842445:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee5f600 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144669.842446:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842453:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842458:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea400) 00010000:00010000:2.0:1746144669.842460:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144669.842461:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842464:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5f600/0xa7c849b16e01c1d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144669.842494:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5fa00/0xa7c849b16e01c1c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffef expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.842503:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01c1da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffef expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.842507:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144669.842509:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144669.842511:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee5e200, rc 0) 00000100:00100000:2.0:1746144669.842566:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:29492:x1830964746966912:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 659us (6603us total) trans 8589944166 rc 0/0 00000100:00100000:2.0:1746144669.842572:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10256 00000100:00100000:0.0:1746144669.848196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.848272:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967040 00000100:00100000:1.0:1746144669.848280:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967040 00000100:00100000:1.0:1746144669.848329:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12584 00000100:00100000:1.0:1746144669.848336:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:29488:x1830964746967040:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.848355:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.848372:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fff6 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.848403:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.848410:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.848411:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.848414:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 45 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.848441:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.848452:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 27 pid: 8450 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.848464:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747613696:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.849587:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.852350:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4760:1830964747613696:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.852383:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 45 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.852400:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f68e00, rc 0) 00000100:00100000:1.0:1746144669.852443:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:29488:x1830964746967040:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4106us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.852452:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12584 00000100:00100000:0.0:1746144669.860423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.860571:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967168 00000100:00100000:3.0:1746144669.860584:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967168 00002000:00100000:3.0:1746144669.860641:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2551807) req@ffff8800a4ebfb80 x1830964746967168/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.860655:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebfb80 with x1830964746967168 ext(2097152->2551807) 00010000:00010000:3.0:1746144669.860668:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 28 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144669.860688:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 28 pid: 8450 timeout: 749 lvb_type: 0 00002000:00010000:3.0:1746144669.860696:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ebfb80 00000100:00100000:3.0:1746144669.860732:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 977 00000100:00100000:3.0:1746144669.860740:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+28:1961:x1830964746967168:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144669.876379:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746967168:12345-192.168.204.23@tcp:4:cat.0 Request processed in 15627us (15955us total) trans 17179873432 rc 0/0 00000100:00100000:2.0:1746144669.876393:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 977 00002000:00100000:2.0:1746144669.876406:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2551807) req@ffff8800a4ebfb80 x1830964746967168/t17179873432(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.876421:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebfb80 with x1830964746967168 ext(2097152->2551807) 00010000:00010000:2.0:1746144669.876432:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144669.876450:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144669.876456:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ebfb80 00000100:00100000:2.0:1746144669.887842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.887907:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967424 00000100:00100000:0.0:1746144669.887924:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967424 00000100:00100000:0.0:1746144669.887982:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10257 00000100:00100000:0.0:1746144669.887991:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+12:29495:x1830964746967424:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144669.888013:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144669.888031:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c1ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9152fffd expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.888171:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888184:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888195:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888208:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888214:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888219:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888327:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c800/0xa7c849b16e01c204 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888335:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c800/0xa7c849b16e01c204 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888341:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c800/0xa7c849b16e01c204 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:0.0:1746144669.888349:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:0.0:1746144669.888431:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888438:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888447:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888452:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19ce00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144669.888456:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888461:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888471:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144669.888474:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144669.888478:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888482:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19ce00/0xa7c849b16e01c1f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888504:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888508:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888513:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888516:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c19d200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144669.888518:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888522:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888531:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b53d7b00) 00010000:00010000:0.0:1746144669.888533:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144669.888535:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888540:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d200/0xa7c849b16e01c1fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144669.888574:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19d000/0xa7c849b16e01c1ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fffd expref: 15 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.888585:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c800/0xa7c849b16e01c204 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fffd expref: 14 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.888590:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.888592:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144669.888594:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c19c800, rc 0) 00000100:00100000:0.0:1746144669.890192:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16261e74-be72-4bb6-b857-d78345d984f7+14:29495:x1830964746967424:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2195us (2354us total) trans 8589944167 rc 0/0 00000100:00100000:0.0:1746144669.890201:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10257 00000100:00100000:0.0:1746144669.890685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.890950:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967552 00000100:00100000:1.0:1746144669.890958:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967552 00010000:00010000:1.0:1746144669.890986:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.891014:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6283 00000100:00100000:1.0:1746144669.891020:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+30:1961:x1830964746967552:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.891034:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.891055:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.891067:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.891085:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c116 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff6a expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.891105:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.891108:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.891115:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.891123:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.893030:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.893046:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747613824:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.894025:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.894164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.894261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.894285:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967680 00000100:00100000:0.0:1746144669.894291:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967680 00000100:00100000:0.0:1746144669.894325:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 657 00000100:00100000:0.0:1746144669.894330:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+14:1962:x1830964746967680:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144669.894340:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144669.894359:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c19c800/0xa7c849b16e01c204 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fffd expref: 14 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144669.894373:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144669.894377:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144669.894395:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16261e74-be72-4bb6-b857-d78345d984f7+13:1962:x1830964746967680:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144669.894400:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 657 00000100:00100000:1.0:1746144669.894580:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967808 00000100:00100000:1.0:1746144669.894583:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967808 00000100:00100000:1.0:1746144669.894608:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12585 00000100:00100000:1.0:1746144669.894613:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+30:1963:x1830964746967808:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.894627:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.894640:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530004 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.894656:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.894658:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.894664:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 31 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.894677:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 31 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.894685:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4a00, rc 0) 00000100:00100000:1.0:1746144669.894702:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+31:1963:x1830964746967808:12345-192.168.204.23@tcp:101:cat.0 Request processed in 89us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.894706:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12585 00000100:00100000:0.0:1746144669.902571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.902609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.902623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.902663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.902686:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746967936 00000100:00100000:0.0:1746144669.902695:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746967936 00000100:00100000:0.0:1746144669.902738:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746968064 00000100:00100000:0.0:1746144669.902740:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746968064 00000100:00100000:0.0:1746144669.902880:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746968192 00000100:00100000:0.0:1746144669.902883:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746968192 00000100:00100000:1.0:1746144669.902930:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746968320 00000100:00100000:1.0:1746144669.902934:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746968320 00000100:00100000:1.0:1746144669.902954:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12586 00000100:00100000:1.0:1746144669.902960:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746967936:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.902983:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.903001:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153000b expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.903026:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.903028:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.903036:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.903054:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.903064:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5400, rc 0) 00000100:00100000:1.0:1746144669.903110:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:1962:x1830964746967936:12345-192.168.204.23@tcp:101:cat.0 Request processed in 150us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.903116:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12586 00000100:00100000:1.0:1746144669.903149:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12587 00000100:00100000:1.0:1746144669.903155:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746968064:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.903160:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.903166:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc4000/0xa7c849b16e01c220 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530012 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.903203:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747613952:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144669.903250:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.903268:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12588 00000100:00100000:1.0:1746144669.903274:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746968192:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.903281:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.903291:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530019 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.903302:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.903303:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.903307:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.903318:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.903324:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4400, rc 0) 00000100:00100000:1.0:1746144669.903337:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:1962:x1830964746968192:12345-192.168.204.23@tcp:101:cat.0 Request processed in 63us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.903342:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12588 00000100:00100000:1.0:1746144669.903352:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12589 00000100:00100000:1.0:1746144669.903356:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746968320:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.903361:0:4760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.903367:0:4760:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530020 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.903377:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.903378:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.903382:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.903390:0:4760:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.903398:0:4760:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5c00, rc 0) 00000100:00100000:1.0:1746144669.903410:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746968320:12345-192.168.204.23@tcp:101:cat.0 Request processed in 54us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.903414:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12589 00000100:00100000:2.0:1746144669.904212:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.904238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.904264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.904284:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746968576 00000100:00100000:2.0:1746144669.904286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.904289:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746968576 00000100:00100000:2.0:1746144669.904299:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746968832 00000100:00100000:2.0:1746144669.904302:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746968832 00002000:00100000:0.0:1746144669.904321:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a51ed880 x1830964746968576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.904330:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a51ee300 x1830964746968832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.904330:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed880 with x1830964746968576 ext(2097152->3145727) 00002000:00010000:0.0:1746144669.904335:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ed880 00002000:00100000:2.0:1746144669.904338:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ee300 with x1830964746968832 ext(3145728->4194303) 00002000:00010000:2.0:1746144669.904341:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ee300 00000100:00100000:2.0:1746144669.904349:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746969088 00000100:00100000:2.0:1746144669.904351:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746969088 00000100:00100000:0.0:1746144669.904353:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746969344 00000100:00100000:0.0:1746144669.904355:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746969344 00002000:00100000:2.0:1746144669.904361:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a51ec380 x1830964746969088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.904367:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ec380 with x1830964746969088 ext(2097152->3145727) 00002000:00100000:0.0:1746144669.904369:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093e31f80 x1830964746969344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746144669.904371:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ec380 00002000:00100000:0.0:1746144669.904376:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31f80 with x1830964746969344 ext(3145728->4194303) 00002000:00010000:0.0:1746144669.904379:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e31f80 00000100:00100000:2.0:1746144669.904381:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4888 00000100:00100000:2.0:1746144669.904387:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746968576:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.904403:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4889 00000100:00100000:0.0:1746144669.904410:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1963:x1830964746968832:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.904447:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4890 00000100:00100000:0.0:1746144669.905680:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746969088:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.906945:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4891 00000100:00100000:0.0:1746144669.906956:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746969344:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.908442:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747613824:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144669.908463:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.909865:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746967552:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 18838us (19173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.909876:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6283 00000100:00100000:1.0:1746144669.926573:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746968832:12345-192.168.204.23@tcp:3:cat.0 Request processed in 22150us (22321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.926587:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4889 00002000:00100000:1.0:1746144669.926599:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff8800a51ee300 x1830964746968832/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.926609:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ee300 with x1830964746968832 ext(3145728->4194303) 00002000:00010000:1.0:1746144669.926615:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ee300 00000100:00100000:1.0:1746144669.926708:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747613952:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144669.926741:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc4000/0xa7c849b16e01c220 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530012 expref: 23 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.926757:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4000/0xa7c849b16e01c220 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530012 expref: 23 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.926778:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4000, rc 0) 00000100:00100000:1.0:1746144669.927344:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746968064:12345-192.168.204.23@tcp:101:cat.0 Request processed in 24186us (24731us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144669.927351:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12587 00000100:00100000:2.0:1746144669.927653:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746968576:12345-192.168.204.23@tcp:3:cat.0 Request processed in 23265us (23441us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144669.927659:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4888 00002000:00100000:2.0:1746144669.927665:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff8800a51ed880 x1830964746968576/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.927672:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ed880 with x1830964746968576 ext(2097152->3145727) 00002000:00010000:2.0:1746144669.927676:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a51ed880 00000100:00100000:2.0:1746144669.935027:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a51ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1963:x1830964746969088:12345-192.168.204.23@tcp:3:cat.0 Request processed in 30559us (30747us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144669.935040:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4890 00002000:00100000:2.0:1746144669.935053:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff8800a51ec380 x1830964746969088/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.935063:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a51ec380 with x1830964746969088 ext(2097152->3145727) 00002000:00010000:2.0:1746144669.935071:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a51ec380 00000100:00100000:2.0:1746144669.940427:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1962:x1830964746969344:12345-192.168.204.23@tcp:3:cat.0 Request processed in 33467us (36132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144669.940437:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4891 00002000:00100000:2.0:1746144669.940448:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff880093e31f80 x1830964746969344/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.940456:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e31f80 with x1830964746969344 ext(3145728->4194303) 00002000:00010000:2.0:1746144669.940461:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e31f80 00000100:00100000:0.0:1746144669.950522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.950569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.950610:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.950705:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746969472 00000100:00100000:1.0:1746144669.950715:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746969472 00000100:00100000:1.0:1746144669.950758:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12590 00000100:00100000:1.0:1746144669.950765:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29490:x1830964746969472:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144669.950785:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.950805:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530027 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.950837:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.950845:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.950851:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.950853:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.950856:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3346432->4149247] (req 3346432->4149247) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 29 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.950885:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 29 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.950907:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 29 pid: 8388 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746144669.950928:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747614080:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.951021:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.951029:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 21 pid: 8451 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.951037:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747614208:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.951054:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.951089:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746969728 00000100:00100000:1.0:1746144669.951093:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746969728 00002000:00100000:1.0:1746144669.951120:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4ebd880 x1830964746969728/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.951129:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebd880 with x1830964746969728 ext(0->1048575) 00002000:00010000:1.0:1746144669.951157:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebd880 00000100:00100000:1.0:1746144669.951175:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746969984 00000100:00100000:1.0:1746144669.951177:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746969984 00002000:00100000:1.0:1746144669.951190:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a4ebe680 x1830964746969984/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.951197:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebe680 with x1830964746969984 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.951201:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ebe680 00000100:00100000:2.0:1746144669.951213:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4892 00000100:00100000:2.0:1746144669.951236:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746969728:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.951507:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4893 00000100:00100000:1.0:1746144669.951514:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746969984:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144669.961200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144669.961281:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746970240 00000100:00100000:3.0:1746144669.961291:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746970240 00002000:00100000:3.0:1746144669.961437:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800a4ebdf80 x1830964746970240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.961447:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebdf80 with x1830964746970240 ext(4194304->4939775) 00002000:00010000:3.0:1746144669.961453:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebdf80 00000100:00100000:3.0:1746144669.961478:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4894 00000100:00100000:3.0:1746144669.961486:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746970240:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144669.964385:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747614080:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.966971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144669.967037:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746970368 00000100:00100000:2.0:1746144669.967046:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746970368 00010000:00010000:2.0:1746144669.967098:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 30 pid: 8388 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746144669.967126:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6284 00000100:00100000:2.0:1746144669.967154:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746970368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.967172:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.967195:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 30 pid: 8388 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746144669.967206:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 30 pid: 8388 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746144669.967228:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135783800/0xa7c849b16e01c10f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff63 expref: 30 pid: 8388 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746144669.967256:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.967295:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746970368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 163us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.967301:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6284 00000100:00100000:1.0:1746144669.967462:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747614208:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.967490:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3346432->4149247] (req 3346432->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 28 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.967500:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5000, rc 0) 00000100:00100000:1.0:1746144669.967523:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:29490:x1830964746969472:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 16760us (17014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.967530:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12590 00000100:00100000:0.0:1746144669.968377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.968401:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746970496 00000100:00100000:0.0:1746144669.968405:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746970496 00010000:00010000:0.0:1746144669.968425:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 24 pid: 8451 timeout: 749 lvb_type: 0 00000100:00100000:2.0:1746144669.968830:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746969728:12345-192.168.204.23@tcp:3:cat.0 Request processed in 17607us (18259us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144669.968839:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4892 00002000:00100000:2.0:1746144669.968849:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff8800a4ebd880 x1830964746969728/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.968862:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebd880 with x1830964746969728 ext(0->1048575) 00002000:00010000:2.0:1746144669.968865:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebd880 00000100:00100000:1.0:1746144669.970288:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6285 00000100:00100000:1.0:1746144669.970301:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746970496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144669.970323:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144669.970352:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 24 pid: 8451 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.970366:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 24 pid: 8451 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.970387:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f69e00/0xa7c849b16e01c0de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff32 expref: 24 pid: 8451 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.970416:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.970418:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.970426:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.970433:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.970466:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.970478:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747614336:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.970560:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.975517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.976557:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746970624 00000100:00100000:1.0:1746144669.976565:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746970624 00000100:00100000:0.0:1746144669.977254:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1962:x1830964746970240:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15764us (16061us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746144669.977266:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4894 00002000:00100000:0.0:1746144669.977279:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800a4ebdf80 x1830964746970240/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.977289:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebdf80 with x1830964746970240 ext(4194304->4939775) 00002000:00010000:0.0:1746144669.977296:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ebdf80 00000100:00100000:1.0:1746144669.977432:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12591 00000100:00100000:1.0:1746144669.977440:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+32:29492:x1830964746970624:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144669.977456:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.977474:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153002e expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.977504:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.977513:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.977519:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.977522:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.977525:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [462848->1048575] (req 462848->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.977556:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.977567:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746144669.977580:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747614464:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.977656:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 44 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.977664:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 44 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.977673:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747614592:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.977693:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144669.978031:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:16261e74-be72-4bb6-b857-d78345d984f7+22:1962:x1830964746969984:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26516us (27419us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144669.978038:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4893 00002000:00100000:1.0:1746144669.978043:0:8458:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff8800a4ebe680 x1830964746969984/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/440 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144669.978051:0:8458:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ebe680 with x1830964746969984 ext(1048576->2097151) 00002000:00010000:1.0:1746144669.978055:0:8458:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ebe680 00000100:00100000:1.0:1746144669.981966:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747614336:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144669.981991:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144669.982046:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+21:1962:x1830964746970496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 11747us (13669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.982057:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6285 00000100:00100000:0.0:1746144669.983005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.983030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.984123:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747614464:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.984152:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747614592:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.984181:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [462848->1048575] (req 462848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 33 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.984198:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4800, rc 0) 00000100:00100000:1.0:1746144669.984236:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+33:29492:x1830964746970624:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6796us (8731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.984243:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12591 00000100:00100000:2.0:1746144669.984339:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746970752 00000100:00100000:2.0:1746144669.984346:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746970752 00000100:00100000:3.0:1746144669.984350:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746971008 00000100:00100000:3.0:1746144669.984355:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746971008 00010000:00010000:3.0:1746144669.984379:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 45 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144669.984379:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746144669.984401:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6286 00000100:00100000:2.0:1746144669.984409:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746970752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.984422:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144669.984433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1746144669.984444:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746144669.984453:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746144669.984474:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4a00/0xa7c849b16e01c212 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530004 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:2.0:1746144669.984488:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144669.984506:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746970752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 99us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144669.984512:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6286 00000100:00100000:1.0:1746144669.984522:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746970880 00000100:00100000:2.0:1746144669.984523:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6287 00000100:00100000:1.0:1746144669.984525:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746970880 00000100:00100000:2.0:1746144669.984529:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746971008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144669.984535:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144669.984542:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.984546:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12592 00010000:00010000:2.0:1746144669.984550:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.984551:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1962:x1830964746970880:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144669.984561:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f69200/0xa7c849b16e01c19b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffd3 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144669.984564:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144669.984569:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144669.984571:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.984575:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f69e00/0xa7c849b16e01c243 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530035 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.984576:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.984584:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144669.984808:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144669.984810:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747614720:192.168.204.23@tcp:106: 00000100:00100000:2.0:1746144669.984817:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747614848:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144669.984922:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.985010:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144669.987538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.987712:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746971136 00000100:00100000:1.0:1746144669.987721:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746971136 00000100:00100000:1.0:1746144669.987815:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12593 00000100:00100000:1.0:1746144669.987823:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+21:29495:x1830964746971136:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144669.987841:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.987864:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153003c expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.988102:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.988110:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.988112:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144669.988116:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153003c expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.988159:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.988171:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 27 pid: 8450 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.988183:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747614976:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.989123:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.990816:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747614848:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144669.990850:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144669.990886:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746971008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6357us (7854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144669.990896:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6287 00000100:00100000:0.0:1746144669.991578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00002000:00010000:1.0:1746144669.991583:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime: 1746144669 -> 1746144670 00002000:00010000:1.0:1746144669.991586:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime: 1746144669 -> 1746144670 00000100:00100000:0.0:1746144669.991619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144669.991674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.991685:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830964747614720:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144669.991707:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746971392 00010000:00010000:1.0:1746144669.991709:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f69e00/0xa7c849b16e01c243 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530035 expref: 45 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746144669.991712:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746971392 00010000:00010000:1.0:1746144669.991723:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f69e00/0xa7c849b16e01c243 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530035 expref: 45 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.991735:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f69e00, rc 0) 00002000:00100000:0.0:1746144669.991749:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e8:0x0] (462848->466943) req@ffff88009287b800 x1830964746971392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746144669.991758:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1962:x1830964746970880:12345-192.168.204.23@tcp:101:cat.0 Request processed in 7207us (7326us total) trans 0 rc 301/301 00002000:00100000:0.0:1746144669.991758:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b800 with x1830964746971392 ext(462848->466943) 00002000:00010000:0.0:1746144669.991762:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009287b800 00000100:00100000:1.0:1746144669.991764:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12592 00000100:00100000:0.0:1746144669.991777:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746971648 00000100:00100000:0.0:1746144669.991779:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746971648 00002000:00100000:0.0:1746144669.991793:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e8:0x0] (4145152->4149247) req@ffff88009287a680 x1830964746971648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.991799:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287a680 with x1830964746971648 ext(4145152->4149247) 00002000:00010000:0.0:1746144669.991801:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287a680 00000100:00100000:0.0:1746144669.991815:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746971776 00000100:00100000:0.0:1746144669.991817:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746971776 00002000:00100000:0.0:1746144669.991825:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1392640->1421311) req@ffff88009287b480 x1830964746971776/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/0 e 0 to 0 dl 1746144680 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144669.991830:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b480 with x1830964746971776 ext(1392640->1421311) 00010000:00010000:0.0:1746144669.991836:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 29 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144669.991849:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 29 pid: 8450 timeout: 749 lvb_type: 0 00002000:00010000:0.0:1746144669.991854:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009287b480 00000100:00100000:0.0:1746144669.991864:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 978 00000100:00100000:0.0:1746144669.991869:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1960:x1830964746971776:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144669.991941:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747614976:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144669.991955:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153003c expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.991967:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5200, rc 0) 00000100:00100000:1.0:1746144669.991982:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:29495:x1830964746971136:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4161us (4455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144669.991987:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12593 00000100:00100000:2.0:1746144669.992043:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4895 00000100:00100000:3.0:1746144669.992052:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4896 00000100:00100000:3.0:1746144669.992057:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746971648:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144669.992059:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746971392:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144669.992192:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746971648:12345-192.168.204.23@tcp:3:cat.0 Request processed in 134us (572us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144669.992192:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746971392:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 140us (616us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144669.992198:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4896 00000100:00100000:2.0:1746144669.992201:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4895 00002000:00100000:3.0:1746144669.992203:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (4145152->4149247) req@ffff88009287a680 x1830964746971648/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.992204:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (462848->466943) req@ffff88009287b800 x1830964746971392/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:310/0 lens 488/4536 e 0 to 0 dl 1746144680 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144669.992209:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287a680 with x1830964746971648 ext(4145152->4149247) 00002000:00100000:2.0:1746144669.992211:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b800 with x1830964746971392 ext(462848->466943) 00002000:00010000:3.0:1746144669.992212:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009287a680 00002000:00010000:2.0:1746144669.992213:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009287b800 00000100:00100000:2.0:1746144669.995354:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1960:x1830964746971776:12345-192.168.204.23@tcp:4:cat.0 Request processed in 3473us (3669us total) trans 21474840649 rc 0/0 00000100:00100000:2.0:1746144669.995365:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 978 00002000:00100000:2.0:1746144669.995376:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1392640->1421311) req@ffff88009287b480 x1830964746971776/t21474840649(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:310/0 lens 488/448 e 0 to 0 dl 1746144680 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144669.995385:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009287b480 with x1830964746971776 ext(1392640->1421311) 00010000:00010000:2.0:1746144669.995396:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144669.995410:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144669.995417:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009287b480 00000100:00100000:0.0:1746144669.999106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144669.999211:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746971904 00000100:00100000:1.0:1746144669.999221:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746971904 00000100:00100000:1.0:1746144669.999280:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12594 00000100:00100000:1.0:1746144669.999288:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:29492:x1830964746971904:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:1.0:1746144669.999372:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144669.999394:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530043 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.999423:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.999432:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.999439:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.999441:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144669.999445:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.999474:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144669.999484:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746144669.999497:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747615104:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144669.999652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1746144669.999668:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144669.999677:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144669.999686:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747615232:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144669.999706:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144669.999842:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746972032 00000100:00100000:3.0:1746144669.999847:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746972032 00010000:00010000:3.0:1746144669.999866:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746144669.999893:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6288 00000100:00100000:3.0:1746144669.999899:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746972032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144669.999908:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144669.999938:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144669.999953:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144669.999971:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f69a00/0xa7c849b16e01c0f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1421311) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff47 expref: 30 pid: 8450 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144669.999986:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.999987:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144669.999993:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153003c expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.000000:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153003c expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.000020:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153003c expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144670.000267:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747615360:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144670.000315:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144670.001446:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747615360:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144670.001459:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144670.001483:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1961:x1830964746972032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1584us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144670.001490:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6288 00000100:00100000:1.0:1746144670.001563:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747615104:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144670.001572:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747615232:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144670.001590:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.001602:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc4200, rc 0) 00000100:00100000:1.0:1746144670.001619:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009287ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:29492:x1830964746971904:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2332us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.001624:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12594 00000100:00100000:0.0:1746144670.002470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.002769:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746972160 00000100:00100000:3.0:1746144670.002775:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746972160 00010000:00010000:3.0:1746144670.002837:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 749 lvb_type: 0 00000100:00080000:0.0:1746144670.002978:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144670.003164:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6289 00000100:00100000:3.0:1746144670.003173:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746972160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144670.003185:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144670.003207:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144670.003218:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144670.003240:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130f69400/0xa7c849b16e01c1a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffda expref: 29 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144670.003264:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144670.003324:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1963:x1830964746972160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 152us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144670.003330:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6289 00000100:00100000:1.0:1746144670.003521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.003581:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746972288 00000100:00100000:3.0:1746144670.003584:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746972288 00010000:00010000:3.0:1746144670.003600:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 749 lvb_type: 1 00000100:00100000:3.0:1746144670.003613:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6290 00000100:00080000:1.0:1746144670.003704:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144670.003731:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746972288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144670.003741:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144670.003748:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746144670.003757:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746144670.003770:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5400/0xa7c849b16e01c219 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153000b expref: 23 pid: 7257 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746144670.003779:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144670.003781:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144670.003786:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.003795:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.003826:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144670.003838:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747615488:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144670.003901:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9d840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.004868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.004985:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746972672 00000100:00100000:2.0:1746144670.004991:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746972672 00002000:00100000:2.0:1746144670.005040:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880092878700 x1830964746972672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.005049:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878700 with x1830964746972672 ext(1048576->2097151) 00002000:00010000:2.0:1746144670.005054:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092878700 00000100:00100000:2.0:1746144670.005070:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4897 00000100:00100000:2.0:1746144670.005077:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1963:x1830964746972672:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144670.005081:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15951:1830964747615488:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144670.005093:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144670.005131:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746972288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1512us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144670.005156:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6290 00000100:00100000:1.0:1746144670.005743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.005860:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746972800 00000100:00100000:0.0:1746144670.005864:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746972800 00002000:00100000:0.0:1746144670.005900:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88008b9a1f80 x1830964746972800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144670.005908:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a1f80 with x1830964746972800 ext(1048576->2097151) 00002000:00010000:0.0:1746144670.005921:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a1f80 00000100:00080000:1.0:1746144670.005972:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144670.006013:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4898 00000100:00100000:0.0:1746144670.006024:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746972800:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144670.006869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.007882:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746973056 00000100:00100000:3.0:1746144670.007891:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746973056 00002000:00100000:3.0:1746144670.007935:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1220608->1224703) req@ffff880092879500 x1830964746973056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.007944:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879500 with x1830964746973056 ext(1220608->1224703) 00002000:00010000:3.0:1746144670.007950:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092879500 00000100:00100000:3.0:1746144670.007982:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4899 00000100:00100000:3.0:1746144670.007989:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746973056:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144670.008100:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746973056:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 112us (1232us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144670.008106:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4899 00002000:00100000:3.0:1746144670.008112:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e6:0x0] (1220608->1224703) req@ffff880092879500 x1830964746973056/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.008119:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092879500 with x1830964746973056 ext(1220608->1224703) 00002000:00010000:3.0:1746144670.008122:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092879500 00000100:00100000:2.0:1746144670.014785:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+22:1963:x1830964746972672:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 9697us (9905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.014799:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4897 00002000:00100000:2.0:1746144670.014812:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff880092878700 x1830964746972672/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.014822:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092878700 with x1830964746972672 ext(1048576->2097151) 00002000:00010000:2.0:1746144670.014829:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092878700 00000100:00100000:0.0:1746144670.015502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.015525:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746973312 00000100:00100000:2.0:1746144670.015761:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746973312 00000100:00080000:0.0:1746144670.015807:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144670.015824:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4184 00000100:00100000:2.0:1746144670.016036:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+13:29492:x1830964746973312:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:2.0:1746144670.016255:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:29492:x1830964746973312:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 423us (755us total) trans 8589944168 rc 0/0 00000100:00100000:2.0:1746144670.016261:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4184 00000100:00100000:2.0:1746144670.016645:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1963:x1830964746972800:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10626us (10903us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.016653:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4898 00002000:00100000:2.0:1746144670.016661:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->2097151) req@ffff88008b9a1f80 x1830964746972800/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.016669:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a1f80 with x1830964746972800 ext(1048576->2097151) 00002000:00010000:2.0:1746144670.016673:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a1f80 00000100:00100000:0.0:1746144670.026962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.027100:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746973568 00000100:00100000:2.0:1746144670.027111:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746973568 00002000:00100000:2.0:1746144670.027204:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012cef9f80 x1830964746973568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.027214:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9f80 with x1830964746973568 ext(2097152->3145727) 00002000:00010000:2.0:1746144670.027220:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef9f80 00000100:00100000:2.0:1746144670.027241:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4900 00000100:00100000:2.0:1746144670.027250:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746973568:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144670.036255:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746973568:12345-192.168.204.23@tcp:3:cat.0 Request processed in 8993us (9290us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.036268:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4900 00002000:00100000:2.0:1746144670.036282:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->3145727) req@ffff88012cef9f80 x1830964746973568/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.036291:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9f80 with x1830964746973568 ext(2097152->3145727) 00002000:00010000:2.0:1746144670.036298:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef9f80 00000100:00100000:0.0:1746144670.043200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.043287:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746973696 00000100:00100000:1.0:1746144670.043298:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746973696 00000100:00100000:1.0:1746144670.043356:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12595 00000100:00100000:1.0:1746144670.043365:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+22:29495:x1830964746973696:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144670.043385:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144670.043404:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153004a expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.043440:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.043447:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144670.043449:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144670.043452:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153004a expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.043489:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 27 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.043501:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 27 pid: 7257 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144670.043514:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747615616:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144670.044294:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.047338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.047419:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746973824 00000100:00100000:2.0:1746144670.047428:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746973824 00002000:00100000:2.0:1746144670.047485:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3346432->4149247) req@ffff88012cefb800 x1830964746973824/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.047495:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb800 with x1830964746973824 ext(3346432->4149247) 00010000:00010000:2.0:1746144670.047503:0:21597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 28 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144670.047516:0:21597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 28 pid: 7257 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144670.047526:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cefb800 00000100:00100000:2.0:1746144670.047543:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 979 00000100:00100000:2.0:1746144670.047550:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746973824:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144670.048013:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747615616:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144670.048038:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153004a expref: 23 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.048052:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5e00, rc 0) 00000100:00100000:1.0:1746144670.048105:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:16261e74-be72-4bb6-b857-d78345d984f7+23:29495:x1830964746973696:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4741us (4916us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.048112:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12595 00000100:00100000:2.0:1746144670.056725:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1961:x1830964746973824:12345-192.168.204.23@tcp:4:cat.0 Request processed in 9164us (9384us total) trans 21474840650 rc 0/0 00000100:00100000:2.0:1746144670.056738:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 979 00002000:00100000:2.0:1746144670.056751:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3346432->4149247) req@ffff88012cefb800 x1830964746973824/t21474840650(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/448 e 0 to 0 dl 1746144681 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.056761:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cefb800 with x1830964746973824 ext(3346432->4149247) 00010000:00010000:2.0:1746144670.056771:0:21597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 30 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144670.056789:0:21597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 30 pid: 7257 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144670.056796:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cefb800 00000100:00100000:0.0:1746144670.059005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.059074:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746973952 00000100:00100000:3.0:1746144670.059083:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746973952 00010000:00010000:3.0:1746144670.059119:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 30 pid: 7257 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144670.059650:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6291 00000100:00100000:1.0:1746144670.059661:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+30:1962:x1830964746973952:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144670.059679:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144670.059703:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144669 -> 1746144670 00010000:00010000:1.0:1746144670.059710:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 30 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.059728:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 30 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.059752:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c235 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3346432->4149247) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530027 expref: 30 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.059772:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.059774:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.059782:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153004a expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.059791:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153004a expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.059824:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153004a expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.059836:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747615744:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144670.059925:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144670.066562:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747615744:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144670.066587:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144670.066634:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1962:x1830964746973952:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6975us (7636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.066644:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6291 00000100:00100000:0.0:1746144670.070381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.070418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.070479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.070743:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746974336 00000100:00100000:2.0:1746144670.070753:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746974336 00002000:00100000:2.0:1746144670.070818:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012cef9c00 x1830964746974336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.070828:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9c00 with x1830964746974336 ext(2097152->3145727) 00002000:00010000:2.0:1746144670.070834:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef9c00 00000100:00100000:2.0:1746144670.070853:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746974464 00000100:00100000:2.0:1746144670.070856:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746974464 00002000:00100000:2.0:1746144670.070872:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012cef8e00 x1830964746974464/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.070878:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8e00 with x1830964746974464 ext(3145728->4194303) 00002000:00010000:2.0:1746144670.070881:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8e00 00000100:00100000:2.0:1746144670.070889:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746974720 00000100:00100000:2.0:1746144670.070892:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746974720 00002000:00100000:2.0:1746144670.070906:0:21597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012cef9880 x1830964746974720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.070921:0:21597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9880 with x1830964746974720 ext(3145728->4194303) 00002000:00010000:2.0:1746144670.070924:0:21597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef9880 00000100:00100000:2.0:1746144670.070946:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4901 00000100:00100000:2.0:1746144670.070955:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746974336:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144670.071111:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4902 00000100:00100000:3.0:1746144670.071119:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+24:1961:x1830964746974464:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144670.071166:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4903 00000100:00100000:1.0:1746144670.071175:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746974720:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144670.076096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.076506:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746974848 00000100:00100000:3.0:1746144670.076517:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746974848 00000100:00100000:3.0:1746144670.076657:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10258 00000100:00100000:3.0:1746144670.076665:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+9:29499:x1830964746974848:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144670.076692:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144670.076710:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc600/0xa7c849b16e01c25f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530051 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.076770:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076782:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076791:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076802:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076807:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076811:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076924:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076936:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.076943:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.076976:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 301 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.076987:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 301 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746144670.076999:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747615872:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144670.077068:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144670.086252:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747615872:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144670.086253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1746144670.086277:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144670.086659:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975104 00000100:00100000:1.0:1746144670.086664:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746974720:12345-192.168.204.23@tcp:3:cat.0 Request processed in 15489us (16182us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.086666:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975104 00000100:00100000:1.0:1746144670.086674:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4903 00002000:00100000:1.0:1746144670.086687:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3145728->4194303) req@ffff88012cef9880 x1830964746974720/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144670.086695:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9880 with x1830964746974720 ext(3145728->4194303) 00002000:00010000:1.0:1746144670.086699:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef9880 00000100:00100000:2.0:1746144670.086725:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4185 00000100:00100000:2.0:1746144670.086733:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29069:x1830964746975104:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746144670.086772:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144670.086945:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:29069:x1830964746975104:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 212us (701us total) trans 8589944169 rc 0/0 00000100:00100000:2.0:1746144670.086951:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4185 00000100:00100000:1.0:1746144670.091488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.092015:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746974464:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20895us (21593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144670.092026:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4902 00002000:00100000:3.0:1746144670.092038:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff88012cef8e00 x1830964746974464/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.092047:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8e00 with x1830964746974464 ext(3145728->4194303) 00002000:00010000:3.0:1746144670.092054:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef8e00 00000100:00100000:0.0:1746144670.092687:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975232 00000100:00100000:0.0:1746144670.092698:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975232 00010000:00010000:0.0:1746144670.092805:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.092842:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6292 00000100:00100000:0.0:1746144670.092850:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+303:1963:x1830964746975232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144670.092865:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144670.092870:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.092880:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.092902:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e000/0xa7c849b16e01c1b7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe8 expref: 303 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.092933:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144670.092938:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.092946:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.092953:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.092985:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144670.093013:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:1963:x1830964746975232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 164us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.093020:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6292 00010000:00010000:2.0:1746144670.093099:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093108:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144670.093173:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:2.0:1746144670.093178:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144670.093193:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093202:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093212:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093218:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093225:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093230:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5dc800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144670.093233:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093239:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093247:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144670.093249:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144670.093252:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093256:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc800/0xa7c849b16e01c266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093273:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093277:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093283:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093287:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5dca00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144670.093289:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093293:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093298:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b4ef1e00) 00010000:00010000:2.0:1746144670.093300:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144670.093301:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093305:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dca00/0xa7c849b16e01c26d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.093336:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dc600/0xa7c849b16e01c25f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.093348:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 10 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.093354:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144670.093355:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144670.093357:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dcc00, rc 0) 00000100:00100000:2.0:1746144670.093382:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29499:x1830964746974848:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 16718us (17296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144670.093388:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10258 00000100:00100000:2.0:1746144670.097084:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746974336:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26118us (26699us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.097370:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4901 00002000:00100000:2.0:1746144670.097386:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012cef9c00 x1830964746974336/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.097396:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef9c00 with x1830964746974336 ext(2097152->3145727) 00002000:00010000:2.0:1746144670.097401:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cef9c00 00000100:00100000:2.0:1746144670.101031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.101363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.101743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.102505:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975360 00000100:00100000:1.0:1746144670.102515:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975360 00000100:00100000:1.0:1746144670.102555:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975488 00000100:00100000:1.0:1746144670.102557:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975488 00000100:00100000:1.0:1746144670.102567:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975616 00000100:00100000:1.0:1746144670.102568:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975616 00000100:00100000:1.0:1746144670.102587:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12596 00000100:00100000:1.0:1746144670.102594:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1962:x1830964746975360:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144670.102612:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144670.102632:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc5800/0xa7c849b16e01c27b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530058 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.102691:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747616000:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144670.102765:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144670.102779:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12597 00000100:00100000:1.0:1746144670.102784:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1962:x1830964746975488:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144670.102793:0:7257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144670.102804:0:7257:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c282 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153005f expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.102827:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747616128:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144670.102844:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b8af9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.103011:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12598 00000100:00100000:0.0:1746144670.103023:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746975616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144670.103029:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.103038:0:8453:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dcac000/0xa7c849b16e01c289 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530066 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.103050:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.103052:0:8453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.103060:0:8453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcac000/0xa7c849b16e01c289 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530066 expref: 17 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.103075:0:8453:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dcac000/0xa7c849b16e01c289 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530066 expref: 17 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.103085:0:8453:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcac000, rc 0) 00000100:00100000:0.0:1746144670.103112:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1962:x1830964746975616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 94us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.103117:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12598 00000100:00100000:2.0:1746144670.103283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.103297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.103322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.103347:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975744 00000100:00100000:2.0:1746144670.103349:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975744 00000100:00100000:2.0:1746144670.103378:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746975872 00000100:00100000:2.0:1746144670.103379:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746975872 00000100:00100000:2.0:1746144670.103389:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746976000 00000100:00100000:2.0:1746144670.103391:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746976000 00000100:00100000:2.0:1746144670.103402:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12599 00000100:00100000:2.0:1746144670.103406:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1962:x1830964746975744:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144670.103412:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144670.103419:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153006d expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.103429:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144670.103430:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144670.103435:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.103445:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.103453:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092459200, rc 0) 00000100:00100000:2.0:1746144670.103470:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+18:1962:x1830964746975744:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144670.103475:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12599 00000100:00100000:2.0:1746144670.103484:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12600 00000100:00100000:2.0:1746144670.103490:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1962:x1830964746975872:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144670.103496:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144670.103502:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530074 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.103511:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144670.103708:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12601 00000100:00100000:0.0:1746144670.103716:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+17:1962:x1830964746976000:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144670.103723:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.103731:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dcac400/0xa7c849b16e01c29e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153007b expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.103740:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.103741:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.103745:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dcac400/0xa7c849b16e01c29e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153007b expref: 18 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.103755:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dcac400/0xa7c849b16e01c29e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153007b expref: 18 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.103761:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcac400, rc 0) 00000100:00100000:0.0:1746144670.103775:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+18:1962:x1830964746976000:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 62us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.103780:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12601 00010000:00010000:2.0:1746144670.106411:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144670.106434:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.106461:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.106473:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092458a00, rc 0) 00000100:00100000:2.0:1746144670.106534:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+18:1962:x1830964746975872:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3043us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144670.106542:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12600 00000100:00100000:1.0:1746144670.111998:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747616000:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144670.112035:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc5800/0xa7c849b16e01c27b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530058 expref: 17 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144670.112049:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc5800/0xa7c849b16e01c27b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530058 expref: 17 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144670.112063:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5800, rc 0) 00000100:00100000:1.0:1746144670.112107:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746975360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9513us (11085us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144670.112115:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12596 00002000:00010000:2.0:1746144670.112270:0:7257:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime: 1746144669 -> 1746144670 00002000:00010000:2.0:1746144670.112274:0:7257:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime: 1746144669 -> 1746144670 00000100:00100000:2.0:1746144670.112286:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:7257:1830964747616128:192.168.204.23@tcp:106: 00010000:00010000:2.0:1746144670.112301:0:7257:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c282 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153005f expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.112309:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0ffc00/0xa7c849b16e01c282 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153005f expref: 17 pid: 7257 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.112322:0:7257:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0ffc00, rc 0) 00000100:00100000:2.0:1746144670.112354:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746975488:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9569us (10991us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144670.112359:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12597 00000100:00100000:0.0:1746144670.114779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.114871:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746976256 00000100:00100000:2.0:1746144670.114881:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746976256 00002000:00100000:2.0:1746144670.114951:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88012cef8700 x1830964746976256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.114962:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8700 with x1830964746976256 ext(4194304->4939775) 00002000:00010000:2.0:1746144670.114967:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef8700 00000100:00100000:2.0:1746144670.114999:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4904 00000100:00100000:2.0:1746144670.115009:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746976256:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144670.118986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.119647:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746976512 00000100:00100000:3.0:1746144670.119657:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746976512 00000100:00100000:3.0:1746144670.119703:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10259 00000100:00100000:3.0:1746144670.119711:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+10:29499:x1830964746976512:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144670.119732:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144670.119750:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd200/0xa7c849b16e01c2a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530082 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.120563:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.120579:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.120586:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.120618:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 11 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.120630:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 11 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746144670.120642:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747616256:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144670.121839:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.122238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.123122:0:14708:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746976768 00000100:00100000:2.0:1746144670.123131:0:14708:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746976768 00000100:00100000:2.0:1746144670.123210:0:14708:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10260 00000100:00100000:2.0:1746144670.123218:0:14708:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+302:29504:x1830964746976768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144670.123246:0:14708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144670.123260:0:14708:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01c2b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530089 expref: -99 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.123364:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123377:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123387:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123400:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123406:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123412:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123509:0:14708:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ade00/0xa7c849b16e01c2c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123517:0:14708:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ade00/0xa7c849b16e01c2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123522:0:14708:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ade00/0xa7c849b16e01c2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14708 initiator: MDT0 00000004:00200000:2.0:1746144670.123531:0:14708:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144670.123608:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123618:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123624:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123629:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130f69200 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144670.123633:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123639:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123649:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144670.123651:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144670.123655:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.123660:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f69200/0xa7c849b16e01c2ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124683:0:14708:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124691:0:14708:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124697:0:14708:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124701:0:14708:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7adc00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144670.124704:0:14708:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124712:0:14708:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124720:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ebea400) 00010000:00010000:2.0:1746144670.124722:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144670.124724:0:14708:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124730:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c2c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14708 initiator: MDT0 00010000:00010000:2.0:1746144670.124773:0:14708:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092459800/0xa7c849b16e01c2b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530089 expref: 305 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.124784:0:14708:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ade00/0xa7c849b16e01c2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530089 expref: 304 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.124791:0:14708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144670.124793:0:14708:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746144670.124795:0:14708:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7ade00, rc 0) 00000100:00100000:2.0:1746144670.125172:0:14708:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29504:x1830964746976768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1952us (2935us total) trans 8589944170 rc 0/0 00000100:00100000:2.0:1746144670.125179:0:14708:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10260 00000100:00100000:2.0:1746144670.128077:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+32:1960:x1830964746976256:12345-192.168.204.23@tcp:3:cat.0 Request processed in 13060us (13297us total) trans 0 rc 745472/745472 00000100:00100000:2.0:1746144670.128088:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4904 00002000:00100000:2.0:1746144670.128099:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff88012cef8700 x1830964746976256/t0(0) o3->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.128113:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cef8700 with x1830964746976256 ext(4194304->4939775) 00002000:00010000:2.0:1746144670.128119:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cef8700 00000100:00100000:3.0:1746144670.130304:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747616256:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144670.130332:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144670.130634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.130671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.130742:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746977152 00000100:00100000:0.0:1746144670.130750:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746977152 00000100:00100000:0.0:1746144670.130795:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4186 00000100:00100000:0.0:1746144670.130803:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+304:29504:x1830964746977152:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1746144670.130842:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746976896 00000100:00100000:3.0:1746144670.130845:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746976896 00010000:00010000:3.0:1746144670.130870:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 12 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746144670.130900:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6293 00000100:00100000:3.0:1746144670.130906:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1960:x1830964746976896:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144670.130930:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144670.130937:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 12 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144670.130948:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 12 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144670.130969:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dcc00/0xa7c849b16e01c274 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530051 expref: 12 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:3.0:1746144670.130991:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144670.130996:0:15951:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.131005:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.131013:0:15951:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.131030:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144670.131044:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:3.0:1746144670.131050:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:3.0:1746144670.131073:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:3.0:1746144670.131249:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd200/0xa7c849b16e01c2a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.131263:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.131270:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144670.131272:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746144670.131274:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f5dd400, rc 0) 00000100:00100000:3.0:1746144670.131311:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29499:x1830964746976512:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 11601us (12336us total) trans 8589944171 rc 0/0 00000100:00100000:3.0:1746144670.131318:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10259 00000100:00100000:3.0:1746144670.131348:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1960:x1830964746976896:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 442us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144670.131353:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6293 00000100:00100000:0.0:1746144670.132524:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29504:x1830964746977152:12345-192.168.204.23@tcp:35:cat.0 Request processed in 1717us (1846us total) trans 8589944172 rc 0/0 00000100:00100000:0.0:1746144670.132534:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4186 00000100:00100000:0.0:1746144670.150277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.150523:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746977280 00000100:00100000:0.0:1746144670.150533:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746977280 00000100:00100000:0.0:1746144670.150572:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978304 00000100:00100000:0.0:1746144670.150574:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978304 00000100:00100000:0.0:1746144670.150591:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10261 00000100:00100000:0.0:1746144670.150598:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29499:x1830964746977280:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144670.150624:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.150643:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad600/0xa7c849b16e01c2dd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530090 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.150777:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.150793:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.150799:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.150836:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.150847:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 12 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.150862:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747616384:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144670.150946:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.150964:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746977536 00000100:00100000:0.0:1746144670.150967:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746977536 00000100:00100000:0.0:1746144670.150987:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4187 00000100:00100000:0.0:1746144670.150992:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+14:29495:x1830964746977536:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1746144670.151160:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:16261e74-be72-4bb6-b857-d78345d984f7+15:29495:x1830964746977536:12345-192.168.204.23@tcp:35:cat.0 Request processed in 166us (810us total) trans 8589944173 rc 0/0 00000100:00100000:0.0:1746144670.151168:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4187 00000100:00100000:0.0:1746144670.151188:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746977792 00000100:00100000:0.0:1746144670.151191:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746977792 00000100:00100000:0.0:1746144670.151216:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978048 00000100:00100000:0.0:1746144670.151218:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978048 00000100:00100000:0.0:1746144670.151228:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746977920 00000100:00100000:0.0:1746144670.151230:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746977920 00000100:00100000:0.0:1746144670.151238:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978176 00000100:00100000:0.0:1746144670.151240:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978176 00000100:00100000:0.0:1746144670.151251:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12602 00000100:00100000:0.0:1746144670.151255:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746977792:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144670.151264:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.151275:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dcacc00/0xa7c849b16e01c2eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153009e expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144670.151305:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747616512:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144670.151333:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.151350:0:14709:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10262 00000100:00100000:0.0:1746144670.151355:0:14709:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+305:29503:x1830964746978304:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144670.151379:0:14709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.151388:0:14709:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcada00/0xa7c849b16e01c2f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530097 expref: -99 pid: 14709 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.151795:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12603 00000100:00100000:1.0:1746144670.151805:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746978048:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144670.151814:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144670.151826:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300ac expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.151840:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.151842:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.151850:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 32 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144670.151864:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 32 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144670.151874:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e87dc00, rc 0) 00000100:00100000:1.0:1746144670.151894:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746978048:12345-192.168.204.23@tcp:101:cat.0 Request processed in 92us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.151899:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12603 00000100:00100000:1.0:1746144670.151925:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12604 00000100:00100000:1.0:1746144670.151931:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746977920:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1746144670.151937:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144670.151943:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e87c800/0xa7c849b16e01c307 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300a5 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.151968:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747616640:192.168.204.23@tcp:106: 00000100:00100000:1.0:1746144670.151994:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b144480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144670.152522:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12605 00000100:00100000:2.0:1746144670.152544:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1963:x1830964746978176:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1746144670.152551:0:4758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144670.152560:0:4758:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300b3 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.152570:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144670.152571:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144670.152576:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 33 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.152585:0:4758:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 33 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.152591:0:4758:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b7adc00, rc 0) 00000100:00100000:2.0:1746144670.152607:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1963:x1830964746978176:12345-192.168.204.23@tcp:101:cat.0 Request processed in 79us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144670.152611:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12605 00010000:00010000:0.0:1746144670.153197:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153210:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153220:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153249:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153255:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153260:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153529:0:14709:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297b200/0xa7c849b16e01c31c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153539:0:14709:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009297b200/0xa7c849b16e01c31c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153545:0:14709:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009297b200/0xa7c849b16e01c31c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14709 initiator: MDT0 00000004:00200000:0.0:1746144670.153554:0:14709:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:0.0:1746144670.153632:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153638:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153645:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153650:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd86400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144670.153653:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153660:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153669:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144670.153672:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144670.153676:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153681:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd86400/0xa7c849b16e01c2f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153691:0:14709:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153696:0:14709:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153700:0:14709:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153703:0:14709:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009297a800 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144670.153705:0:14709:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153710:0:14709:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153715:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009f3c3c00) 00010000:00010000:0.0:1746144670.153717:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144670.153719:0:14709:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153722:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009297a800/0xa7c849b16e01c315 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14709 initiator: MDT0 00010000:00010000:0.0:1746144670.153758:0:14709:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcada00/0xa7c849b16e01c2f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530097 expref: 308 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.153770:0:14709:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009297b200/0xa7c849b16e01c31c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530097 expref: 307 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.153775:0:14709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144670.153777:0:14709:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144670.153780:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.153786:0:14709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.153791:0:14709:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009297b200, rc 0) 00000100:00100000:0.0:1746144670.154028:0:14709:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29503:x1830964746978304:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 2467us (3504us total) trans 8589944174 rc 0/0 00000100:00100000:0.0:1746144670.154035:0:14709:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10262 00000100:00080000:0.0:1746144670.154067:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144670.158547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.158564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.159071:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747616384:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144670.159101:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144670.159247:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978560 00000100:00100000:0.0:1746144670.159255:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978560 00000100:00100000:0.0:1746144670.159288:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978432 00000100:00100000:0.0:1746144670.159290:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978432 00010000:00010000:0.0:1746144670.159302:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 13 pid: 20319 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.159318:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6294 00000100:00100000:0.0:1746144670.159323:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+13:1962:x1830964746978432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144670.159334:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144670.159339:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 13 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.159348:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 13 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.159364:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5dd400/0xa7c849b16e01c2ac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530082 expref: 13 pid: 20319 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.159380:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144670.159385:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.159393:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.159399:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00000100:00100000:3.0:1746144670.159888:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 658 00000100:00100000:3.0:1746144670.159900:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:1962:x1830964746978560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144670.159924:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144670.159943:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009297b200/0xa7c849b16e01c31c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530097 expref: 307 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144670.159960:0:15951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144670.159963:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144670.160018:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:1962:x1830964746978560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 121us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144670.160025:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 658 00010000:00010000:0.0:1746144670.160302:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144670.160315:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144670.160322:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144670.160370:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:2.0:1746144670.160375:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144670.160392:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:0.0:1746144670.160392:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747616512:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144670.160416:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dcacc00/0xa7c849b16e01c2eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153009e expref: 45 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144670.160427:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad600/0xa7c849b16e01c2dd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530090 expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.160432:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dcacc00/0xa7c849b16e01c2eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153009e expref: 45 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.160442:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcacc00, rc 0) 00010000:00010000:2.0:1746144670.160446:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530090 expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144670.160453:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144670.160455:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144670.160457:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dcad400, rc 0) 00000100:00100000:0.0:1746144670.160474:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:1963:x1830964746977792:12345-192.168.204.23@tcp:101:cat.0 Request processed in 9217us (10035us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144670.160481:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12602 00000100:00100000:2.0:1746144670.160491:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29499:x1830964746977280:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9893us (10225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144670.160498:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10261 00000100:00100000:0.0:1746144670.160510:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1962:x1830964746978432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1187us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.160516:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6294 00000100:00100000:0.0:1746144670.160562:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747616640:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144670.160576:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e87c800/0xa7c849b16e01c307 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300a5 expref: 32 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.160584:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e87c800/0xa7c849b16e01c307 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300a5 expref: 32 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.160591:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e87c800, rc 0) 00000100:00100000:0.0:1746144670.160604:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1963:x1830964746977920:12345-192.168.204.23@tcp:101:cat.0 Request processed in 8674us (10130us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144670.160612:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12604 00000100:00100000:0.0:1746144670.164508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.164543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.164568:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978688 00000100:00100000:0.0:1746144670.164578:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978688 00000100:00100000:0.0:1746144670.164628:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978816 00000100:00100000:0.0:1746144670.164631:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978816 00000100:00100000:0.0:1746144670.164648:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12606 00000100:00100000:0.0:1746144670.164656:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+44:29504:x1830964746978688:12345-192.168.204.23@tcp:101:cat.0 00000100:00100000:0.0:1746144670.165462:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12607 00010000:00010000:0.0:1746144670.165492:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.165510:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300ba expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.165540:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.165547:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144670.165549:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144670.165552:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 45 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.165580:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 31 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.165591:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 31 pid: 7257 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.165609:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747616768:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144670.165679:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.165693:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1963:x1830964746978816:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144670.165702:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.165708:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129cc5400/0xa7c849b16e01c331 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300c1 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144670.165733:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747616896:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144670.165754:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.169373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.169460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.169485:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746979072 00000100:00100000:2.0:1746144670.169573:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746978944 00000100:00100000:2.0:1746144670.169582:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746978944 00002000:00100000:2.0:1746144670.169626:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (462848->1048575) req@ffff88009e9f8a80 x1830964746978944/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.169636:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9f8a80 with x1830964746978944 ext(462848->1048575) 00010000:00010000:2.0:1746144670.169645:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 32 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144670.169660:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 32 pid: 7257 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144670.169667:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9f8a80 00000100:00100000:2.0:1746144670.169686:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 980 00000100:00100000:2.0:1746144670.169694:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+32:1961:x1830964746978944:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:0.0:1746144670.169923:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746979072 00000100:00100000:0.0:1746144670.169947:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12608 00000100:00100000:0.0:1746144670.169952:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746979072:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144670.169962:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.169977:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c338 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300c8 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144670.170028:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747617024:192.168.204.23@tcp:106: 00000100:00100000:0.0:1746144670.170671:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.170710:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:30345:1830964747616768:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.170735:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 45 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.170749:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942f1800, rc 0) 00000100:00100000:0.0:1746144670.170773:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:29504:x1830964746978688:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6118us (6277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.170779:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12606 00000100:00100000:0.0:1746144670.171028:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747616896:192.168.204.23@tcp:106: 00010000:00010000:0.0:1746144670.171049:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129cc5400/0xa7c849b16e01c331 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300c1 expref: 17 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.171059:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc5400/0xa7c849b16e01c331 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300c1 expref: 17 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.171069:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5400, rc 0) 00000100:00100000:0.0:1746144670.171092:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1963:x1830964746978816:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 5623us (6548us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144670.171098:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12607 00000100:00100000:1.0:1746144670.179251:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747617024:192.168.204.23@tcp:106: 00010000:00010000:1.0:1746144670.179281:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c338 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300c8 expref: 17 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144670.179299:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5000/0xa7c849b16e01c338 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300c8 expref: 17 pid: 8388 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144670.179313:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129cc5000, rc 0) 00000100:00100000:1.0:1746144670.179350:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746979072:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9397us (9889us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144670.179358:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12608 00000100:00100000:1.0:1746144670.185266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.185477:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746979328 00000100:00100000:0.0:1746144670.185484:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746979328 00000100:00100000:0.0:1746144670.185527:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10263 00000100:00100000:0.0:1746144670.185534:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29499:x1830964746979328:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144670.185550:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.185566:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a000/0xa7c849b16e01c33f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300cf expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.185642:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185653:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185662:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185672:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185676:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185681:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185686:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b428b000 already unused, calling callback (ffffffffa1376690) 00010000:00010000:0.0:1746144670.185688:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185694:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185702:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144670.185705:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746144670.185708:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185712:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428b000/0xa7c849b16e01c346 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:0.0:1746144670.185734:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a000/0xa7c849b16e01c33f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300cf expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.185745:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b428a000/0xa7c849b16e01c33f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300cf expref: 12 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.185751:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b428a000, rc 0) 00000100:00100000:0.0:1746144670.185788:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29499:x1830964746979328:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 254us (529us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144670.185793:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10263 00000100:00100000:2.0:1746144670.187051:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746978944:12345-192.168.204.23@tcp:4:cat.0 Request processed in 17354us (17686us total) trans 17179873433 rc 0/0 00000100:00100000:2.0:1746144670.187059:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 980 00002000:00100000:2.0:1746144670.187068:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (462848->1048575) req@ffff88009e9f8a80 x1830964746978944/t17179873433(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/448 e 0 to 0 dl 1746144681 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.187077:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e9f8a80 with x1830964746978944 ext(462848->1048575) 00010000:00010000:2.0:1746144670.187084:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 34 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144670.187097:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 34 pid: 7257 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144670.187103:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e9f8a80 00000100:00100000:0.0:1746144670.191559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.191579:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746979584 00000100:00100000:0.0:1746144670.191585:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746979584 00000100:00100000:0.0:1746144670.191613:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4188 00000100:00100000:0.0:1746144670.191619:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+11:29499:x1830964746979584:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1746144670.191759:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:435b7708-7ae3-4eb4-a292-361a088a3e41+12:29499:x1830964746979584:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 140us (208us total) trans 8589944175 rc 0/0 00000100:00100000:0.0:1746144670.191766:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4188 00000100:00100000:0.0:1746144670.198854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.198886:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746979712 00000100:00100000:0.0:1746144670.198893:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746979712 00010000:00010000:0.0:1746144670.198931:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 34 pid: 7257 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.198957:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6295 00000100:00100000:0.0:1746144670.198963:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+34:1961:x1830964746979712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144670.198975:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144670.198992:0:15951:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 34 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.199003:0:15951:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 34 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.199021:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4800/0xa7c849b16e01c23c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9153002e expref: 34 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:0.0:1746144670.199033:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.199034:0:15951:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.199040:0:15951:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 44 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.199046:0:15951:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 44 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.199072:0:15951:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 44 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144670.199082:0:15951:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747617152:192.168.204.23@tcp:105: 00000100:00100000:0.0:1746144670.199151:0:15951:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.205892:0:15951:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15951:1830964747617152:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144670.205920:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144670.205954:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:16261e74-be72-4bb6-b857-d78345d984f7+33:1961:x1830964746979712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6990us (7106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.205964:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6295 00000100:00100000:0.0:1746144670.208802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.209001:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746979968 00000100:00100000:2.0:1746144670.209008:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746979968 00002000:00100000:2.0:1746144670.209050:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fd97800 x1830964746979968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.209059:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd97800 with x1830964746979968 ext(0->1048575) 00002000:00010000:2.0:1746144670.209064:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd97800 00000100:00100000:2.0:1746144670.209081:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4905 00000100:00100000:2.0:1746144670.209088:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746979968:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144670.229109:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746979968:12345-192.168.204.23@tcp:3:cat.0 Request processed in 20013us (20304us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144670.229123:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4905 00002000:00100000:3.0:1746144670.229153:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e8:0x0] (0->1048575) req@ffff88009fd97800 x1830964746979968/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.229164:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd97800 with x1830964746979968 ext(0->1048575) 00002000:00010000:3.0:1746144670.229170:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd97800 00000100:00100000:1.0:1746144670.242759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.247174:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980096 00000100:00100000:0.0:1746144670.247187:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980096 00000100:00100000:0.0:1746144670.247234:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12609 00000100:00100000:0.0:1746144670.247241:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:29504:x1830964746980096:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1746144670.247261:0:8388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.247280:0:8388:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300d6 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247308:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247316:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144670.247318:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144670.247321:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 32 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247350:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 22 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247361:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 22 pid: 7257 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.247372:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747617280:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144670.247469:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.247584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.247641:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980224 00000100:00100000:0.0:1746144670.247644:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980224 00000100:00100000:0.0:1746144670.247664:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12610 00000100:00100000:0.0:1746144670.247669:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:29503:x1830964746980224:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144670.247678:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.247688:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300dd expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247704:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 46 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247712:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 15 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.247718:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 32 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.247724:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.247725:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.247728:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [1482752->2097151] (req 1482752->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 46 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247745:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 32 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.247753:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 32 pid: 4760 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746144670.247761:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747617408:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.247789:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 15 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.247797:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 15 pid: 4758 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746144670.247803:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747617536:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.247819:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 46 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.247824:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.247830:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747617664:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144670.247841:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144670.251095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.251112:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.251787:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:8388:1830964747617280:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144670.251821:0:8388:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 32 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.251841:0:8388:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d8bfa00, rc 0) 00000100:00100000:1.0:1746144670.251891:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:29504:x1830964746980096:12345-192.168.204.23@tcp:101:cat.0 Request processed in 4650us (9139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.251901:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12609 00000100:00100000:0.0:1746144670.252660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.252690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.252713:0:15951:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980352 00000100:00100000:1.0:1746144670.252716:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980608 00000100:00100000:0.0:1746144670.252719:0:15951:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980352 00000100:00100000:1.0:1746144670.252720:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980608 00010000:00010000:1.0:1746144670.252746:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746144670.252746:0:15951:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 16 pid: 4758 timeout: 749 lvb_type: 1 00000100:00100000:2.0:1746144670.252778:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980480 00000100:00100000:2.0:1746144670.252782:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980480 00002000:00100000:2.0:1746144670.252826:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1224703) req@ffff88009fd95c00 x1830964746980480/t0(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.252837:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd95c00 with x1830964746980480 ext(1048576->1224703) 00010000:00010000:2.0:1746144670.252843:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 23 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144670.252853:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 23 pid: 7257 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144670.252859:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd95c00 00000100:00100000:2.0:1746144670.252870:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 981 00000100:00100000:2.0:1746144670.252876:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+23:1961:x1830964746980480:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:1.0:1746144670.253107:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980736 00000100:00100000:1.0:1746144670.253110:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980736 00000100:00100000:3.0:1746144670.253120:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6296 00010000:00010000:1.0:1746144670.253121:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 47 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746144670.253129:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746980352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746144670.253150:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6297 00010000:00010000:3.0:1746144670.253154:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144670.253155:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746980608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144670.253162:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144670.253174:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746144670.253175:0:7309:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 16 pid: 4758 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746144670.253184:0:7309:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 16 pid: 4758 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746144670.253192:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 33 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:3.0:1746144670.253222:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144670.253222:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144670.253277:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+33:1963:x1830964746980608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 122us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.253283:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6297 00000100:00100000:1.0:1746144670.253293:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6298 00000100:00100000:1.0:1746144670.253297:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1963:x1830964746980736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144670.253303:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144670.253309:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 47 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.253317:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 47 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:3.0:1746144670.253321:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435b7708-7ae3-4eb4-a292-361a088a3e41+16:1962:x1830964746980352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 193us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144670.253328:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6296 00010000:00010000:1.0:1746144670.253328:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.253330:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.253338:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.253347:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.253373:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.253386:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747617792:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144670.253625:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49600 going to sleep for 11 seconds 00010000:00010000:0.0:1746144670.253903:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc4400/0xa7c849b16e01c227 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530019 expref: 32 pid: 4760 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746144670.253925:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747617408:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.253939:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092459200/0xa7c849b16e01c290 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153006d expref: 15 pid: 4758 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746144670.253947:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747617536:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.253956:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f69800/0xa7c849b16e01c1a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffe1 expref: 47 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.253964:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd96680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747617664:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.253984:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 46 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.253992:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f025600, rc 0) 00000100:00100000:0.0:1746144670.254016:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:29503:x1830964746980224:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 6346us (6432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.254023:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12610 00000100:00100000:0.0:1746144670.256534:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747617792:192.168.204.23@tcp:105: 00010000:00010000:0.0:1746144670.256556:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144670.256594:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746980736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3294us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.256604:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6298 00000100:00100000:2.0:1746144670.257502:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:16261e74-be72-4bb6-b857-d78345d984f7+25:1961:x1830964746980480:12345-192.168.204.23@tcp:4:cat.0 Request processed in 4621us (6383us total) trans 21474840651 rc 0/0 00000100:00100000:2.0:1746144670.257511:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 981 00002000:00100000:2.0:1746144670.257522:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->1224703) req@ffff88009fd95c00 x1830964746980480/t21474840651(0) o4->16261e74-be72-4bb6-b857-d78345d984f7@192.168.204.23@tcp:311/0 lens 488/448 e 0 to 0 dl 1746144681 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.257532:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd95c00 with x1830964746980480 ext(1048576->1224703) 00010000:00010000:2.0:1746144670.257541:0:31509:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 25 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:2.0:1746144670.257557:0:31509:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 25 pid: 7257 timeout: 749 lvb_type: 0 00002000:00010000:2.0:1746144670.257563:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fd95c00 00000100:00100000:0.0:1746144670.258728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.260051:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746980992 00000100:00100000:3.0:1746144670.260062:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746980992 00002000:00100000:3.0:1746144670.260108:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1482752->1486847) req@ffff88009fd96680 x1830964746980992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.260118:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd96680 with x1830964746980992 ext(1482752->1486847) 00002000:00010000:3.0:1746144670.260122:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd96680 00000100:00100000:3.0:1746144670.260155:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4906 00000100:00100000:3.0:1746144670.260163:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1960:x1830964746980992:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144670.260898:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1960:x1830964746980992:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 733us (2171us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144670.260919:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4906 00002000:00100000:3.0:1746144670.260926:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3ea:0x0] (1482752->1486847) req@ffff88009fd96680 x1830964746980992/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.260934:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd96680 with x1830964746980992 ext(1482752->1486847) 00002000:00010000:3.0:1746144670.260937:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd96680 00000100:00100000:0.0:1746144670.261755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.262154:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746981120 00000100:00100000:1.0:1746144670.262162:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746981120 00010000:00010000:1.0:1746144670.262190:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 25 pid: 7257 timeout: 749 lvb_type: 0 00000100:00100000:1.0:1746144670.262214:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6299 00000100:00100000:1.0:1746144670.262219:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+25:1962:x1830964746981120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144670.262232:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144670.262250:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 25 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.262262:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 25 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.262283:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc4200/0xa7c849b16e01c251 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c91530043 expref: 25 pid: 7257 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.262299:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.262301:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.262308:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 31 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.262316:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 31 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.262347:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 31 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.262358:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747617920:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144670.262416:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144670.266332:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747617920:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144670.266353:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144670.266395:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+24:1962:x1830964746981120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4174us (4641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.266406:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6299 00000100:00100000:1.0:1746144670.268423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.268441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.268453:0:31509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746981376 00000100:00100000:2.0:1746144670.268462:0:31509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746981376 00000100:00100000:1.0:1746144670.268467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.268486:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746981632 00000100:00100000:1.0:1746144670.268489:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746981632 00002000:00100000:2.0:1746144670.268506:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008b9a1c00 x1830964746981376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144670.268506:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88008b9a0700 x1830964746981632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.268515:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a1c00 with x1830964746981376 ext(1048576->2097151) 00002000:00100000:1.0:1746144670.268515:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0700 with x1830964746981632 ext(1048576->2097151) 00002000:00010000:2.0:1746144670.268520:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a1c00 00002000:00010000:1.0:1746144670.268520:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a0700 00000100:00100000:1.0:1746144670.268536:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746981888 00000100:00100000:1.0:1746144670.268538:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746981888 00002000:00100000:1.0:1746144670.268550:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1482751) req@ffff88008b9a0380 x1830964746981888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144670.268557:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0380 with x1830964746981888 ext(1048576->1482751) 00002000:00010000:1.0:1746144670.268561:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0380 00000100:00100000:2.0:1746144670.268682:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4907 00000100:00100000:2.0:1746144670.268693:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746981632:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:1.0:1746144670.268795:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4908 00000100:00100000:3.0:1746144670.268802:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4909 00000100:00100000:1.0:1746144670.268802:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+33:1960:x1830964746981376:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:3.0:1746144670.268811:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1960:x1830964746981888:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144670.271437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.271463:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746982016 00000100:00100000:0.0:1746144670.271471:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746982016 00000100:00100000:0.0:1746144670.271504:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12611 00000100:00100000:0.0:1746144670.271510:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:29503:x1830964746982016:12345-192.168.204.23@tcp:101:multiop.0 00010000:00010000:0.0:1746144670.271524:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144670.271542:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300e4 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.271566:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 48 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.271575:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 14 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.271581:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 31 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.271587:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.271588:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144670.271591:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 48 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.271616:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 31 pid: 4760 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.271626:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 31 pid: 4760 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746144670.271636:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747618048:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.271708:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 14 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144670.271716:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 14 pid: 4758 timeout: 749 lvb_type: 1 00000100:00100000:0.0:1746144670.271724:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747618176:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144670.271759:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 48 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144670.271767:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 48 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.271775:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747618304:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144670.271791:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bf0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144670.278933:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1960:x1830964746981888:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 10115us (10455us total) trans 0 rc 434176/434176 00000100:00100000:3.0:1746144670.278945:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4909 00002000:00100000:3.0:1746144670.278957:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3ea:0x0] (1048576->1482751) req@ffff88008b9a0380 x1830964746981888/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 434176/434176 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.278967:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0380 with x1830964746981888 ext(1048576->1482751) 00002000:00010000:3.0:1746144670.278973:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008b9a0380 00000100:00100000:1.0:1746144670.280743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.280768:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746982400 00000100:00100000:1.0:1746144670.280777:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746982400 00010000:00010000:1.0:1746144670.280808:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 32 pid: 4760 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746144670.280834:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6300 00000100:00100000:1.0:1746144670.280841:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746982400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144670.280854:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144670.280875:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 32 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746144670.280887:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 32 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746144670.280924:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144670.280951:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f44050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:16261e74-be72-4bb6-b857-d78345d984f7+32:1962:x1830964746982400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 110us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.280957:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6300 00000100:00100000:3.0:1746144670.281295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.281379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144670.282241:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746982144 00000100:00100000:1.0:1746144670.282246:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746982144 00010000:00010000:1.0:1746144670.282266:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 15 pid: 4758 timeout: 749 lvb_type: 1 00000100:00100000:1.0:1746144670.282290:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746982272 00000100:00100000:1.0:1746144670.282292:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746982272 00010000:00010000:0.0:1746144670.282301:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129cc5c00/0xa7c849b16e01c22e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530020 expref: 31 pid: 4760 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746144670.282302:0:7102:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 47 pid: 4760 timeout: 749 lvb_type: 0 00000100:00100000:0.0:1746144670.282314:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747618048:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144670.282316:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6301 00000100:00100000:1.0:1746144670.282321:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+15:1961:x1830964746982144:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144670.282328:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd97480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747618176:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144670.282331:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144670.282337:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747618304:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144670.282346:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 15 pid: 4758 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746144670.282354:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 15 pid: 4758 timeout: 749 lvb_type: 1 00010000:00010000:1.0:1746144670.282369:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092458a00/0xa7c849b16e01c297 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530074 expref: 15 pid: 4758 timeout: 749 lvb_type: 1 00010000:00010000:0.0:1746144670.282372:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 6 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 47 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.282379:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144670.282389:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009447d200, rc 0) 00000100:00100000:1.0:1746144670.282404:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+14:1961:x1830964746982144:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.282409:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:29503:x1830964746982016:12345-192.168.204.23@tcp:101:multiop.0 Request processed in 10899us (10979us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144670.282415:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12611 00000100:00100000:1.0:1746144670.282416:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6301 00000100:00100000:1.0:1746144670.282426:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6302 00000100:00100000:1.0:1746144670.282431:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746982272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144670.282438:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144670.282445:0:7102:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.282453:0:7102:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.282465:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f68e00/0xa7c849b16e01c1e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c9152fff6 expref: 46 pid: 4760 timeout: 749 lvb_type: 0 00010000:00010000:1.0:1746144670.282472:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.282474:0:7102:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144670.282480:0:7102:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 45 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.282488:0:7102:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 45 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144670.282516:0:7102:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 45 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144670.282526:0:7102:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747618432:192.168.204.23@tcp:105: 00000100:00100000:1.0:1746144670.282580:0:7102:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144670.283356:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1960:x1830964746981632:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 14665us (14910us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.283365:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4907 00002000:00100000:2.0:1746144670.283373:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e7:0x0] (1048576->2097151) req@ffff88008b9a0700 x1830964746981632/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.283383:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a0700 with x1830964746981632 ext(1048576->2097151) 00002000:00010000:2.0:1746144670.283386:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a0700 00000100:00100000:1.0:1746144670.286969:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1960:x1830964746981376:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 18156us (18539us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144670.287212:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4908 00002000:00100000:1.0:1746144670.287225:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e6:0x0] (1048576->2097151) req@ffff88008b9a1c00 x1830964746981376/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746144670.287241:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008b9a1c00 with x1830964746981376 ext(1048576->2097151) 00002000:00010000:1.0:1746144670.287246:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008b9a1c00 00000100:00100000:1.0:1746144670.287342:0:7102:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008b9a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7102:1830964747618432:192.168.204.23@tcp:105: 00010000:00010000:1.0:1746144670.287357:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144670.287376:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746982272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4944us (5997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144670.287383:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6302 00000100:00100000:3.0:1746144670.292430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.294727:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746982656 00000100:00100000:0.0:1746144670.294739:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746982656 00002000:00100000:0.0:1746144670.294792:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2134016->2138111) req@ffff88009fb46300 x1830964746982656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144670.294803:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46300 with x1830964746982656 ext(2134016->2138111) 00002000:00010000:0.0:1746144670.294809:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb46300 00000100:00100000:0.0:1746144670.294832:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4910 00000100:00100000:0.0:1746144670.294840:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746982656:12345-192.168.204.23@tcp:3:multiop.0 00000100:00100000:0.0:1746144670.295649:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1963:x1830964746982656:12345-192.168.204.23@tcp:3:multiop.0 Request processed in 806us (3225us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144670.295656:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4910 00002000:00100000:0.0:1746144670.295663:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2134016->2138111) req@ffff88009fb46300 x1830964746982656/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/4536 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746144670.295669:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb46300 with x1830964746982656 ext(2134016->2138111) 00002000:00010000:0.0:1746144670.295672:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb46300 00000100:00100000:1.0:1746144670.302717:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.303066:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746982912 00000100:00100000:0.0:1746144670.303079:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746982912 00000100:00100000:0.0:1746144670.303149:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4189 00000100:00100000:0.0:1746144670.303156:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+306:29503:x1830964746982912:12345-192.168.204.23@tcp:35:multiop.0 00000100:00100000:0.0:1746144670.304749:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29503:x1830964746982912:12345-192.168.204.23@tcp:35:multiop.0 Request processed in 1587us (2038us total) trans 8589944176 rc 0/0 00000100:00100000:0.0:1746144670.304760:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4189 00000100:00100000:2.0:1746144670.311379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.311403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144670.311427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144670.311508:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746983168 00000100:00100000:3.0:1746144670.311519:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746983168 00002000:00100000:3.0:1746144670.311567:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (2138112->3186687) req@ffff88012cfba680 x1830964746983168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746144670.311573:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746983424 00002000:00100000:3.0:1746144670.311577:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfba680 with x1830964746983168 ext(2138112->3186687) 00000100:00100000:1.0:1746144670.311578:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746983424 00002000:00010000:3.0:1746144670.311583:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfba680 00002000:00100000:1.0:1746144670.311596:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (3186688->4194303) req@ffff88012cfbb100 x1830964746983424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746144670.311600:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746983680 00000100:00100000:3.0:1746144670.311603:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746983680 00002000:00100000:1.0:1746144670.311605:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbb100 with x1830964746983424 ext(3186688->4194303) 00002000:00010000:1.0:1746144670.311608:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfbb100 00002000:00100000:3.0:1746144670.311616:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012cfbbb80 x1830964746983680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.311623:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbbb80 with x1830964746983680 ext(2097152->3145727) 00000100:00100000:1.0:1746144670.311623:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4911 00002000:00010000:3.0:1746144670.311627:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfbbb80 00000100:00100000:1.0:1746144670.311630:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746983168:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1746144670.311638:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4912 00000100:00100000:3.0:1746144670.311643:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+46:1961:x1830964746983424:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144670.311692:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4913 00000100:00100000:1.0:1746144670.311697:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746983680:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:2.0:1746144670.317708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.324131:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746983936 00000100:00100000:0.0:1746144670.324156:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746983936 00002000:00100000:0.0:1746144670.324206:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a50e0380 x1830964746983936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144670.324215:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e0380 with x1830964746983936 ext(3145728->4194303) 00002000:00010000:0.0:1746144670.324221:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a50e0380 00000100:00100000:0.0:1746144670.324241:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4914 00000100:00100000:0.0:1746144670.324249:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746983936:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1746144670.328513:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+34:1961:x1830964746983680:12345-192.168.204.23@tcp:3:cat.0 Request processed in 16804us (17073us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144670.328526:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4913 00002000:00100000:1.0:1746144670.328543:0:31509:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e8:0x0] (2097152->3145727) req@ffff88012cfbbb80 x1830964746983680/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144670.328560:0:31509:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbbb80 with x1830964746983680 ext(2097152->3145727) 00002000:00010000:1.0:1746144670.328565:0:31509:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cfbbb80 00000100:00100000:3.0:1746144670.335720:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+47:1961:x1830964746983424:12345-192.168.204.23@tcp:3:cat.0 Request processed in 24063us (24302us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746144670.335732:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4912 00002000:00100000:3.0:1746144670.335745:0:31508:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3eb:0x0] (3186688->4194303) req@ffff88012cfbb100 x1830964746983424/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746144670.335755:0:31508:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfbb100 with x1830964746983424 ext(3186688->4194303) 00002000:00010000:3.0:1746144670.335761:0:31508:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfbb100 00000100:00100000:1.0:1746144670.336248:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+32:1961:x1830964746983936:12345-192.168.204.23@tcp:3:cat.0 Request processed in 11998us (18549us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144670.336254:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4914 00002000:00100000:1.0:1746144670.336259:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e8:0x0] (3145728->4194303) req@ffff8800a50e0380 x1830964746983936/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144670.336264:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e0380 with x1830964746983936 ext(3145728->4194303) 00002000:00010000:1.0:1746144670.336267:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a50e0380 00000100:00100000:2.0:1746144670.338614:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+45:1961:x1830964746983168:12345-192.168.204.23@tcp:3:cat.0 Request processed in 26976us (27236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144670.338625:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4911 00002000:00100000:2.0:1746144670.338634:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (2138112->3186687) req@ffff88012cfba680 x1830964746983168/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746144670.338643:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cfba680 with x1830964746983168 ext(2138112->3186687) 00002000:00010000:2.0:1746144670.338648:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cfba680 00000001:00080000:0.0:1746144670.342761:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873424 is committed 00000001:00080000:0.0:1746144670.342782:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873397 is committed 00000001:00080000:0.0:1746144670.342791:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873376 is committed 00000001:00080000:0.0:1746144670.342801:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873363 is committed 00000001:00080000:0.0:1746144670.342839:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873430 is committed 00000001:00080000:0.0:1746144670.342874:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873396 is committed 00000001:00080000:0.0:1746144670.342946:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873432 is committed 00000001:00080000:0.0:1746144670.343010:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873427 is committed 00000100:00100000:2.0:1746144670.346840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144670.346969:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984192 00000100:00100000:0.0:1746144670.346980:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984192 00002000:00100000:0.0:1746144670.347029:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800a50e2d80 x1830964746984192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/0 e 0 to 0 dl 1746144681 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144670.347038:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e2d80 with x1830964746984192 ext(4194304->4939775) 00002000:00010000:0.0:1746144670.347044:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a50e2d80 00000100:00100000:0.0:1746144670.347082:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4915 00000100:00100000:0.0:1746144670.347090:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746984192:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1746144670.353671:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+21:1963:x1830964746984192:12345-192.168.204.23@tcp:3:cat.0 Request processed in 6569us (6831us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746144670.353684:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4915 00002000:00100000:0.0:1746144670.353696:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3eb:0x0] (4194304->4939775) req@ffff8800a50e2d80 x1830964746984192/t0(0) o3->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:311/0 lens 488/440 e 0 to 0 dl 1746144681 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144670.353706:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a50e2d80 with x1830964746984192 ext(4194304->4939775) 00002000:00010000:0.0:1746144670.353712:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a50e2d80 00010000:00010000:0.0:1746144670.732178:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144671.283735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.283751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.283761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.283771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.283782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.283802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.283822:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984320 00000100:00100000:0.0:1746144671.283829:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984320 00000100:00100000:0.0:1746144671.283859:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984576 00000100:00100000:0.0:1746144671.283861:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984576 00000100:00100000:0.0:1746144671.283871:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984832 00000100:00100000:0.0:1746144671.283873:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984832 00000100:00100000:0.0:1746144671.283881:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984448 00000100:00100000:0.0:1746144671.283883:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984448 00000100:00100000:0.0:1746144671.283903:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984704 00000100:00100000:0.0:1746144671.283905:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984704 00000100:00100000:0.0:1746144671.283914:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746984960 00000100:00100000:0.0:1746144671.283915:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746984960 00000100:00100000:0.0:1746144671.283927:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12612 00000100:00100000:0.0:1746144671.283934:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746984320:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:0.0:1746144671.283983:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12613 00000100:00100000:0.0:1746144671.283987:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746984576:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:0.0:1746144671.284012:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12614 00000100:00100000:0.0:1746144671.284015:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746984832:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:0.0:1746144671.284068:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746984832:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 51us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.284073:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12614 00000100:00100000:0.0:1746144671.284084:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12615 00000100:00100000:0.0:1746144671.284088:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746984448:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:0.0:1746144671.284105:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12616 00000100:00100000:0.0:1746144671.284109:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746984704:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:0.0:1746144671.284132:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746984704:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 22us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.284155:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12616 00000100:00100000:0.0:1746144671.284164:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12617 00000100:00100000:0.0:1746144671.284168:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+26:1961:x1830964746984960:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:0.0:1746144671.369185:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:16261e74-be72-4bb6-b857-d78345d984f7+7:1961:x1830964746984320:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 85243us (85447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.369196:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12612 00000001:00080000:0.0:1746144671.369220:0:2358:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873433 is committed 00000001:00080000:3.0:1746144671.373269:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840636 is committed 00000001:00080000:3.0:1746144671.373279:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840618 is committed 00000001:00080000:3.0:1746144671.373294:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840594 is committed 00000001:00080000:3.0:1746144671.373304:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840647 is committed 00000001:00080000:3.0:1746144671.373308:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840640 is committed 00000001:00080000:3.0:1746144671.373323:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840617 is committed 00000001:00080000:3.0:1746144671.373355:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840651 is committed 00000001:00080000:3.0:1746144671.373360:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840650 is committed 00000001:00080000:3.0:1746144671.373368:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840648 is committed 00000001:00080000:3.0:1746144671.373385:0:648:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840645 is committed 00000100:00100000:1.0:1746144671.373521:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16261e74-be72-4bb6-b857-d78345d984f7+10:1961:x1830964746984448:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 89428us (89744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.373531:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12615 00000100:00100000:3.0:1746144671.374171:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:16261e74-be72-4bb6-b857-d78345d984f7+9:1961:x1830964746984576:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 90182us (90417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.374178:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12613 00000100:00100000:1.0:1746144671.374241:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:1961:x1830964746984960:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 90072us (90438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.374246:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12617 00000100:00100000:0.0:1746144671.398062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.398099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.398124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.398155:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746985088 00000100:00100000:1.0:1746144671.398163:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746985088 00000100:00100000:1.0:1746144671.398206:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746985344 00000100:00100000:1.0:1746144671.398208:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746985344 00000100:00100000:0.0:1746144671.398222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.398224:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746985216 00000100:00100000:1.0:1746144671.398226:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746985216 00000100:00100000:1.0:1746144671.398240:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 659 00000100:00100000:1.0:1746144671.398246:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:087a468c-8f92-434b-ae24-50378d554a48+17:1961:x1830964746985088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144671.398246:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 660 00000100:00100000:0.0:1746144671.398253:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:087a468c-8f92-434b-ae24-50378d554a48+17:1961:x1830964746985344:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144671.398258:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144671.398261:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144671.398272:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f2dc200/0xa7c849b16e010845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91529169 expref: 17 pid: 14707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.398272:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f2dc000/0xa7c849b16e010853 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152919a expref: 17 pid: 14707 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.398288:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144671.398288:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144671.398320:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:087a468c-8f92-434b-ae24-50378d554a48+15:1961:x1830964746985344:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.398326:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 660 00000100:00100000:0.0:1746144671.398343:0:15951:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 661 00000100:00100000:0.0:1746144671.398348:0:15951:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:087a468c-8f92-434b-ae24-50378d554a48+14:1961:x1830964746985216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144671.398354:0:15951:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144671.398361:0:15951:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009f2dc600/0xa7c849b16e01084c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91529193 expref: 14 pid: 14707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.398368:0:15951:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144671.399007:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:087a468c-8f92-434b-ae24-50378d554a48+13:1961:x1830964746985088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 758us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.399012:0:15951:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:087a468c-8f92-434b-ae24-50378d554a48+13:1961:x1830964746985216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 662us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.399013:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 659 00000100:00100000:0.0:1746144671.399018:0:15951:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 661 00000100:00100000:1.0:1746144671.399036:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746985472 00000100:00100000:1.0:1746144671.399039:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746985472 00000100:00100000:1.0:1746144671.399072:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12618 00000100:00100000:1.0:1746144671.399077:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+5:1959:x1830964746985472:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:1.0:1746144671.399096:0:30345:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xa7c849b16e010868 00000100:00080000:1.0:1746144671.399104:0:30345:0:(import.c:66:import_set_state_nolock()) ffff880130981800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746144671.399311:0:30345:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873433 00000100:00100000:1.0:1746144671.399510:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+2:1959:x1830964746985472:12345-192.168.204.23@tcp:9:umount.0 Request processed in 432us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.399516:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12618 00010000:00010000:2.0:1746144671.399743:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144671.417821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.417897:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746985984 00000100:00100000:1.0:1746144671.417905:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746985984 00000100:00100000:1.0:1746144671.417961:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12619 00000100:00100000:1.0:1746144671.417969:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+8:1959:x1830964746985984:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:1.0:1746144671.417995:0:30345:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xa7c849b16e010861 00000020:00010000:1.0:1746144671.418002:0:30345:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a5e0f000: total 0 00000100:00080000:1.0:1746144671.418006:0:30345:0:(import.c:66:import_set_state_nolock()) ffff8800a5e0e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746144671.418043:0:30345:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840651 00000020:00010000:0.0:1746144671.418045:0:7103:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a5e0f000: total 0 00010000:00010000:0.0:1746144671.418073:0:7103:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a5e0f000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746144671.418119:0:7103:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5e00/0xa7c849b16e01c258 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153004a expref: 7 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.418178:0:7103:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009984da00/0xa7c849b16e0109e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91529288 expref: 6 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.418194:0:7103:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129cc5200/0xa7c849b16e01c24a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153003c expref: 5 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.418202:0:7103:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a5e0f000, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746144671.418211:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144671.418213:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144671.418214:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746144671.418279:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:16261e74-be72-4bb6-b857-d78345d984f7+2:1959:x1830964746985984:12345-192.168.204.23@tcp:9:umount.0 Request processed in 311us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.418286:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12619 00000100:00100000:0.0:1746144671.425232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.425301:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746986368 00000100:00100000:1.0:1746144671.425309:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746986368 00000100:00100000:1.0:1746144671.425354:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10264 00000100:00100000:1.0:1746144671.425360:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+15:1959:x1830964746986368:12345-192.168.204.23@tcp:39:umount.0 00000020:00000080:1.0:1746144671.425386:0:14710:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xa7c849b16e01085a 00000020:00010000:1.0:1746144671.425397:0:14710:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a5e0c800: total 0 00000100:00080000:1.0:1746144671.425400:0:14710:0:(import.c:66:import_set_state_nolock()) ffff8800a5e0e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746144671.425413:0:14710:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944176 00000020:00010000:0.0:1746144671.425414:0:7104:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a5e0c800: total 0 00010000:00010000:0.0:1746144671.425445:0:7104:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a5e0c800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1746144671.425471:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:0.0:1746144671.425474:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144671.425480:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c323e00/0xa7c849b16e01091e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91529242 expref: 14 pid: 14709 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.425571:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144671.425574:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144671.425577:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02fe00/0xa7c849b16e01c0ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff01 expref: 14 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.425589:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144671.425591:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746144671.425594:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0ff400/0xa7c849b16e01c09f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fef3 expref: 13 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.425605:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:0.0:1746144671.425607:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746144671.425609:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee5e200/0xa7c849b16e01c1da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ffef expref: 13 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.425617:0:7104:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a5e0c800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1746144671.425626:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144671.425628:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144671.425629:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746144671.425652:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16261e74-be72-4bb6-b857-d78345d984f7+9:1959:x1830964746986368:12345-192.168.204.23@tcp:39:umount.0 Request processed in 291us (428us total) trans 8589944177 rc 0/0 00000100:00100000:1.0:1746144671.425657:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10264 00010000:00010000:0.0:1746144671.736260:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144671.862028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.862092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.862123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.862210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.862238:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746986624 00000100:00100000:0.0:1746144671.862248:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746986624 00000100:00100000:0.0:1746144671.862304:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746986880 00000100:00100000:0.0:1746144671.862306:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746986880 00000100:00100000:0.0:1746144671.862319:0:7102:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746986752 00000100:00100000:0.0:1746144671.862321:0:7102:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746986752 00000100:00100000:0.0:1746144671.862336:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 662 00000100:00100000:0.0:1746144671.862343:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:087a468c-8f92-434b-ae24-50378d554a48+14:1962:x1830964746986624:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144671.862358:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144671.862378:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008e46c000/0xa7c849b16e01086f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915291c4 expref: 14 pid: 14704 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.862395:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144671.862440:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:087a468c-8f92-434b-ae24-50378d554a48+13:1962:x1830964746986624:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 97us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.862446:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 662 00000100:00100000:0.0:1746144671.862459:0:7102:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 663 00000100:00100000:0.0:1746144671.862463:0:7102:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:087a468c-8f92-434b-ae24-50378d554a48+12:1962:x1830964746986880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144671.862470:0:7102:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144671.862476:0:7102:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008be70c00/0xa7c849b16e01087d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915291f5 expref: 12 pid: 14707 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.862483:0:7102:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144671.862638:0:7309:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 664 00000100:00100000:2.0:1746144671.862645:0:7309:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:087a468c-8f92-434b-ae24-50378d554a48+11:1962:x1830964746986752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144671.862652:0:7309:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144671.862660:0:7309:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800b1bcaa00/0xa7c849b16e010876 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915291ee expref: 11 pid: 14704 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.862672:0:7309:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144671.862687:0:7309:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:087a468c-8f92-434b-ae24-50378d554a48+10:1962:x1830964746986752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 44us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144671.862692:0:7309:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 664 00000100:00100000:3.0:1746144671.862789:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746986496 00000100:00100000:3.0:1746144671.862800:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746986496 00000100:00080000:2.0:1746144671.862845:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144671.862855:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12620 00000100:00100000:3.0:1746144671.862870:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1959:x1830964746986496:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:3.0:1746144671.862924:0:30345:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xa7c849b16e010892 00000100:00080000:3.0:1746144671.862931:0:30345:0:(import.c:66:import_set_state_nolock()) ffff880130985000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746144671.862958:0:30345:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873433 00000100:00100000:3.0:1746144671.863113:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+2:1959:x1830964746986496:12345-192.168.204.23@tcp:9:umount.0 Request processed in 249us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.863119:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12620 00010000:00010000:2.0:1746144671.863570:0:12866:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144671.865361:0:7102:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:087a468c-8f92-434b-ae24-50378d554a48+11:1962:x1830964746986880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 31us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.865386:0:7102:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 663 00000100:00100000:0.0:1746144671.866429:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.868236:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746987264 00000100:00100000:3.0:1746144671.868251:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746987264 00000100:00100000:3.0:1746144671.868338:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12621 00000100:00100000:3.0:1746144671.868356:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+7:1959:x1830964746987264:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:3.0:1746144671.868392:0:30345:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xa7c849b16e01088b 00000020:00010000:3.0:1746144671.868399:0:30345:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a5e10000: total 0 00000100:00080000:3.0:1746144671.868404:0:30345:0:(import.c:66:import_set_state_nolock()) ffff8800a5e12000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746144671.868450:0:30345:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840651 00000100:00100000:3.0:1746144671.868649:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:435b7708-7ae3-4eb4-a292-361a088a3e41+5:1959:x1830964746987264:12345-192.168.204.23@tcp:9:umount.0 Request processed in 303us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.868656:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12621 00000100:00080000:2.0:1746144671.868831:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1746144671.868915:0:7103:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a5e10000: total 0 00010000:00010000:1.0:1746144671.868955:0:7103:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a5e10000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1746144671.869012:0:7103:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcac000/0xa7c849b16e01c289 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530066 expref: 4 pid: 8453 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144671.869044:0:7103:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dcac400/0xa7c849b16e01c29e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153007b expref: 3 pid: 22208 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144671.869053:0:7103:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a5e10000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1746144671.869064:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746144671.869066:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746144671.869067:0:7103:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144671.876598:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.876678:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746987648 00000100:00100000:1.0:1746144671.876689:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746987648 00000100:00100000:1.0:1746144671.876746:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10265 00000100:00100000:1.0:1746144671.876757:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+12:1959:x1830964746987648:12345-192.168.204.23@tcp:39:umount.0 00000020:00000080:1.0:1746144671.876795:0:14710:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xa7c849b16e010884 00000020:00010000:1.0:1746144671.876803:0:14710:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009207d000: total 0 00000100:00080000:1.0:1746144671.876807:0:14710:0:(import.c:66:import_set_state_nolock()) ffff88009207b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746144671.876827:0:14710:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944177 00000100:00100000:1.0:1746144671.877016:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:435b7708-7ae3-4eb4-a292-361a088a3e41+11:1959:x1830964746987648:12345-192.168.204.23@tcp:39:umount.0 Request processed in 261us (427us total) trans 8589944178 rc 0/0 00000100:00100000:1.0:1746144671.877023:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10265 00000100:00080000:2.0:1746144671.877434:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1746144671.877455:0:7104:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009207d000: total 0 00010000:00010000:2.0:1746144671.877458:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144671.877499:0:7104:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009207d000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746144671.877529:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144671.877533:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746144671.877540:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdec00/0xa7c849b16e0108a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152921f expref: 10 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.877575:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.877578:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144671.877582:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f628600/0xa7c849b16e01c0d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152ff24 expref: 9 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.877596:0:7104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.877598:0:7104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144671.877600:0:7104:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dcad400/0xa7c849b16e01c2e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530090 expref: 8 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.877613:0:7104:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009207d000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746144671.877621:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144671.877623:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144671.877624:0:7104:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144671.906612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.906742:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746987776 00000100:00100000:2.0:1746144671.906752:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746987776 00000100:00100000:2.0:1746144671.907518:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10266 00000100:00100000:2.0:1746144671.907527:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+307:29551:x1830964746987776:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144671.907553:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144671.907574:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300eb expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.907633:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907645:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907657:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907671:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907676:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907681:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907956:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907964:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.907971:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144671.908003:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:2.0:1746144671.908008:0:20319:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144671.908023:0:20319:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908032:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908039:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908044:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908053:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908058:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b4fa00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144671.908062:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908068:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908078:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a49f1f00) 00010000:00010000:2.0:1746144671.908081:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144671.908086:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.908090:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909068:0:20319:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909076:0:20319:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909081:0:20319:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909086:0:20319:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b4f400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144671.909089:0:20319:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909094:0:20319:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909105:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130e5e600) 00010000:00010000:2.0:1746144671.909108:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144671.909110:0:20319:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909115:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.909164:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 309 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.909175:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 308 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.909181:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.909183:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144671.909185:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62ea00, rc 0) 00000100:00100000:2.0:1746144671.910095:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29551:x1830964746987776:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2566us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144671.910105:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10266 00000100:00100000:1.0:1746144671.913041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.913153:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746988032 00000100:00100000:2.0:1746144671.913164:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746988032 00000100:00100000:2.0:1746144671.913220:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10267 00000100:00100000:2.0:1746144671.913228:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+308:29551:x1830964746988032:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144671.913249:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144671.913265:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e01c37e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300f2 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.913365:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.913379:0:20319:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 309 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.913386:0:20319:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.913418:0:20319:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 309 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.913430:0:20319:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 309 pid: 20319 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746144671.913442:0:20319:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747618560:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144671.915512:0:20319:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144671.916170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.916222:0:20319:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20319:1830964747618560:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144671.916244:0:20319:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:1.0:1746144671.916334:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746988160 00000100:00100000:1.0:1746144671.916341:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746988160 00010000:00010000:1.0:1746144671.916375:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 310 pid: 20319 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746144671.916413:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6303 00000100:00100000:1.0:1746144671.916421:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:1961:x1830964746988160:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144671.916434:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144671.916439:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 310 pid: 20319 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746144671.916449:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 310 pid: 20319 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746144671.916468:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62ea00/0xa7c849b16e01c377 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300eb expref: 310 pid: 20319 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746144671.916611:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144671.916616:0:7100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144671.916625:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144671.916634:0:7100:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20319 initiator: MDT0 00010000:00010000:1.0:1746144671.916650:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144671.916655:0:20319:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.916660:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144671.916674:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000100:00100000:1.0:1746144671.916696:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:1961:x1830964746988160:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 276us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.916704:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6303 00010000:00010000:2.0:1746144671.916798:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62f400/0xa7c849b16e01c37e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f2 expref: 310 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.916827:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f2 expref: 309 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.916834:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.916836:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746144671.916839:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f62fa00, rc 0) 00000100:00100000:2.0:1746144671.916862:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29551:x1830964746988032:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3635us (3830us total) trans 8589944179 rc 0/0 00000100:00100000:2.0:1746144671.916868:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10267 00000100:00100000:0.0:1746144671.921164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.921586:0:16907:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746988416 00000100:00100000:2.0:1746144671.921596:0:16907:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746988416 00000100:00100000:2.0:1746144671.921641:0:16907:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4190 00000100:00100000:2.0:1746144671.921649:0:16907:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+309:29551:x1830964746988416:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746144671.922014:0:16907:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29551:x1830964746988416:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 364us (887us total) trans 8589944180 rc 0/0 00000100:00100000:2.0:1746144671.922021:0:16907:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4190 00000100:00100000:0.0:1746144671.924684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.924956:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746988672 00000100:00100000:2.0:1746144671.924967:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746988672 00000100:00100000:2.0:1746144671.925034:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10268 00000100:00100000:2.0:1746144671.925042:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29551:x1830964746988672:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144671.925064:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144671.925067:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746144671.925096:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f62fa00/0xa7c849b16e01c385 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f2 expref: 310 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.925122:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d461000/0xa7c849b16e011e80 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91529e27 expref: 309 pid: 15388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.925132:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.925180:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144671.925192:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4ee00/0xa7c849b16e01c393 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c915300f9 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.925283:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c39a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.925295:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c39a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.925304:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c39a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000004:00200000:2.0:1746144671.925315:0:20319:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00010000:00010000:2.0:1746144671.925545:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4ee00/0xa7c849b16e01c393 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f9 expref: 311 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.925556:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c39a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f9 expref: 310 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.925562:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.925564:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144671.925566:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4f400, rc 0) 00000100:00100000:2.0:1746144671.925840:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29551:x1830964746988672:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 798us (1162us total) trans 8589944181 rc 0/0 00000100:00100000:2.0:1746144671.925850:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10268 00000100:00100000:1.0:1746144671.930282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144671.930559:0:8388:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746988800 00000100:00100000:0.0:1746144671.930568:0:8388:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746988800 00000100:00100000:2.0:1746144671.930697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.930727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.931048:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746988928 00000100:00100000:3.0:1746144671.931054:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746988928 00000100:00100000:2.0:1746144671.931058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.931074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.931082:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989184 00000100:00100000:3.0:1746144671.931084:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989184 00000100:00100000:3.0:1746144671.931174:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989440 00000100:00100000:3.0:1746144671.931177:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989440 00000100:00100000:3.0:1746144671.931191:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989056 00000100:00100000:3.0:1746144671.931193:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989056 00000100:00100000:0.0:1746144671.931205:0:8388:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12622 00000100:00100000:3.0:1746144671.931211:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12623 00000100:00100000:0.0:1746144671.931214:0:8388:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746988800:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:3.0:1746144671.931218:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746988928:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:3.0:1746144671.931260:0:30345:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.931260:0:8388:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931279:0:30345:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.931279:0:8388:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 22 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931287:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144671.931287:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.931288:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144671.931289:0:8388:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.931291:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.931291:0:8388:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931324:0:30345:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 18 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931337:0:30345:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 18 pid: 8388 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746144671.931351:0:30345:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747618688:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144671.931413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.931422:0:30345:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144671.931439:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989312 00000100:00100000:3.0:1746144671.931442:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989312 00000100:00100000:3.0:1746144671.931460:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12624 00000100:00100000:3.0:1746144671.931465:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746989184:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:2.0:1746144671.931471:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12625 00000100:00100000:2.0:1746144671.931478:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746989440:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:3.0:1746144671.931482:0:10724:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931493:0:10724:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.931494:0:4758:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931498:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144671.931499:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144671.931501:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.931505:0:4758:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144671.931511:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144671.931512:0:4758:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144671.931514:0:4758:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931516:0:10724:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931523:0:10724:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 23 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746144671.931530:0:4758:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 18 pid: 4758 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746144671.931532:0:10724:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747618816:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144671.931538:0:4758:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 18 pid: 4758 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746144671.931546:0:4758:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747618944:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746144671.931552:0:10724:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144671.931566:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12626 00000100:00100000:2.0:1746144671.931568:0:4758:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144671.931572:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1960:x1830964746989056:12345-192.168.204.23@tcp:1:lfs.0 00000100:00100000:2.0:1746144671.931586:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12627 00010000:00010000:3.0:1746144671.931587:0:4760:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.931591:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746989312:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:3.0:1746144671.931598:0:4760:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 18 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144671.931609:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144671.931609:0:7257:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931610:0:4760:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.931612:0:4760:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.931619:0:7257:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931625:0:4760:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 18 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144671.931625:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144671.931626:0:7257:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144671.931628:0:7257:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.931631:0:4760:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 18 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144671.931639:0:4760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747619072:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144671.931642:0:7257:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 23 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.931650:0:7257:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 23 pid: 22208 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746144671.931654:0:4760:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c9d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144671.931657:0:7257:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747619200:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746144671.931807:0:8388:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 23 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.931815:0:8388:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 23 pid: 30345 timeout: 751 lvb_type: 0 00000100:00100000:0.0:1746144671.931822:0:8388:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747619328:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144671.931856:0:8388:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e49840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144671.933269:0:7257:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144671.933547:0:30345:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:30345:1830964747618688:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746144671.933567:0:30345:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.933613:0:10724:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10724:1830964747618816:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144671.933625:0:10724:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144671.938915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.938933:0:4760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4760:1830964747619072:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746144671.938950:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989696 00000100:00100000:0.0:1746144671.938957:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989696 00010000:00010000:3.0:1746144671.938964:0:4760:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144671.939066:0:8388:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:8388:1830964747619328:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144671.939082:0:8388:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.939092:0:4758:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:4758:1830964747618944:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144671.939108:0:4758:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144671.939128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.939201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.939233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.939247:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989952 00000100:00100000:1.0:1746144671.939250:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989952 00002000:00100000:1.0:1746144671.939293:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2138111) req@ffff88009fd96a00 x1830964746989952/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:312/0 lens 488/0 e 0 to 0 dl 1746144682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746144671.939307:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989568 00002000:00100000:1.0:1746144671.939308:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd96a00 with x1830964746989952 ext(2097152->2138111) 00000100:00100000:2.0:1746144671.939311:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989568 00010000:00010000:1.0:1746144671.939316:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 25 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746144671.939331:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 19 pid: 8388 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746144671.939356:0:7100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746989824 00000100:00100000:2.0:1746144671.939358:0:7100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746989824 00000100:00100000:3.0:1746144671.939361:0:7257:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:7257:1830964747619200:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144671.939366:0:7100:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 20 pid: 4758 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144671.939373:0:7257:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.939382:0:7100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6304 00000100:00100000:2.0:1746144671.939389:0:7100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746989568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144671.939399:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6305 00010000:00010000:2.0:1746144671.939405:0:7100:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144671.939425:0:7100:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:2.0:1746144671.939430:0:7100:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 20 pid: 8388 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746144671.939441:0:7100:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 20 pid: 8388 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746144671.939464:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d8bfa00/0xa7c849b16e01c34d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300d6 expref: 20 pid: 8388 timeout: 751 lvb_type: 0 00010000:00010000:2.0:1746144671.939484:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144671.939486:0:7100:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144671.939491:0:7100:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144671.939494:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746989824:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144671.939499:0:7100:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939504:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144671.939517:0:7100:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144671.939519:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 19 pid: 4758 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144671.939527:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 19 pid: 4758 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144671.939539:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b7adc00/0xa7c849b16e01c30e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300b3 expref: 19 pid: 4758 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144671.939552:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.939554:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.939556:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.939559:0:7100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1962:x1830964746989568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 169us (430us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144671.939563:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.939566:0:7100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6304 00010000:00010000:3.0:1746144671.939575:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144671.939585:0:4758:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939592:0:4758:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144671.939593:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746989824:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 188us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.939600:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6305 00010000:00010000:2.0:1746144671.939612:0:4758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939617:0:30345:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939620:0:4758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939625:0:30345:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939626:0:4758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939637:0:4758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b4f800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144671.939638:0:30345:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939640:0:4758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939644:0:30345:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939647:0:4758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939650:0:30345:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939655:0:30345:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c02f600 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144671.939657:0:4758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939658:0:30345:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.939663:0:4758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b4f800/0xa7c849b16e01c3bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939664:0:30345:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939673:0:30345:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.939678:0:30345:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c02f600/0xa7c849b16e01c3af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.939713:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1960:x1830964746989440:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 8236us (8655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144671.939721:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12625 00010000:00010000:1.0:1746144671.939747:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 25 pid: 22208 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746144671.939759:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd96a00 00000100:00100000:1.0:1746144671.939774:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 982 00000100:00100000:1.0:1746144671.939780:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746989952:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:3.0:1746144671.939870:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1960:x1830964746988928:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 8652us (9172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.939887:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12623 00002000:00100000:0.0:1746144671.939891:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1482752->2097151) req@ffff880093ee6680 x1830964746989696/t0(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:312/0 lens 488/0 e 0 to 0 dl 1746144682 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746144671.939899:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6680 with x1830964746989696 ext(1482752->2097151) 00010000:00010000:0.0:1746144671.939905:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 25 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:0.0:1746144671.939912:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 25 pid: 22208 timeout: 751 lvb_type: 0 00002000:00010000:0.0:1746144671.939917:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ee6680 00000100:00100000:0.0:1746144671.939931:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 983 00000100:00100000:0.0:1746144671.939936:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746989696:12345-192.168.204.23@tcp:4:cat.0 00000100:00100000:2.0:1746144671.940233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.940265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144671.940293:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990080 00000100:00100000:1.0:1746144671.940297:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990080 00010000:00010000:1.0:1746144671.940311:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 15 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746144671.940324:0:7101:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990208 00000100:00100000:1.0:1746144671.940326:0:7101:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990208 00010000:00010000:1.0:1746144671.940334:0:7101:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 27 pid: 30345 timeout: 751 lvb_type: 0 00000100:00100000:1.0:1746144671.940346:0:7101:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6306 00000100:00100000:1.0:1746144671.940351:0:7101:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1962:x1830964746990080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144671.940358:0:7101:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144671.940368:0:7101:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 15 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746144671.940375:0:7101:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 15 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746144671.940387:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e87dc00/0xa7c849b16e01c300 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ac expref: 15 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:1.0:1746144671.940404:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144671.940406:0:7101:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144671.940408:0:7101:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940414:0:7101:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940426:0:7101:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144671.940493:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6307 00000100:00100000:3.0:1746144671.940500:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746990208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144671.940508:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144671.940520:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 27 pid: 30345 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.940528:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 27 pid: 30345 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.940542:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942f1800/0xa7c849b16e01c32a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300ba expref: 27 pid: 30345 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.940551:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.940553:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.940555:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.940561:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.940575:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144671.940659:0:7101:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+14:1962:x1830964746990080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 307us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.940665:0:7101:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6306 00010000:00010000:2.0:1746144671.940685:0:4760:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940692:0:4760:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940701:0:8388:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940706:0:4760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940707:0:8388:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940718:0:4760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940720:0:8388:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940724:0:4760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940726:0:8388:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940729:0:4760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c02ee00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144671.940731:0:8388:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940732:0:4760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940738:0:4760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940741:0:8388:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b7ac000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144671.940743:0:8388:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940746:0:4760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940749:0:8388:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.940752:0:4760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c02ee00/0xa7c849b16e01c3c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4760 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144671.940758:0:8388:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.940785:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+13:1960:x1830964746989056:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 9213us (9709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144671.940791:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12626 00010000:00010000:1.0:1746144671.941255:0:8388:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b7ac000/0xa7c849b16e01c3a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144671.942096:0:8388:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746988800:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 10881us (11821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144671.942103:0:8388:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12622 00000100:00100000:3.0:1746144671.942174:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746990208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1674us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.942181:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6307 00000100:00100000:1.0:1746144671.947900:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746989952:12345-192.168.204.23@tcp:4:cat.0 Request processed in 8106us (8652us total) trans 17179873434 rc 0/0 00000100:00100000:1.0:1746144671.947914:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 982 00002000:00100000:1.0:1746144671.947927:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3eb:0x0] (2097152->2138111) req@ffff88009fd96a00 x1830964746989952/t17179873434(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:312/0 lens 488/448 e 0 to 0 dl 1746144682 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144671.947937:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd96a00 with x1830964746989952 ext(2097152->2138111) 00010000:00010000:1.0:1746144671.947947:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 26 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746144671.947965:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 26 pid: 22208 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746144671.947972:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd96a00 00000100:00100000:2.0:1746144671.954659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.955181:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990336 00000100:00100000:3.0:1746144671.955192:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990336 00010000:00010000:3.0:1746144671.955235:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 26 pid: 22208 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746144671.957278:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6308 00000100:00100000:3.0:1746144671.957293:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746990336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144671.957309:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144671.957324:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144670 -> 1746144671 00002000:00010000:3.0:1746144671.957327:0:16008:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144670 -> 1746144671 00002000:00010000:3.0:1746144671.957329:0:16008:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144670 -> 1746144671 00002000:00010000:3.0:1746144671.957331:0:16008:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5617 -> 5623 00010000:00010000:3.0:1746144671.957336:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 27 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.957347:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 27 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.957369:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009447d200/0xa7c849b16e01c35b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300e4 expref: 27 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.957395:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.957397:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.957402:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.957411:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.957437:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144671.957538:0:7257:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957548:0:7257:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957564:0:7257:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957571:0:7257:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957578:0:7257:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957584:0:7257:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f62fe00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:0.0:1746144671.957587:0:7257:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957595:0:7257:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957605:0:7257:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144671.957615:0:7257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f62fe00/0xa7c849b16e01c3cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7257 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144671.964422:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746990336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7120us (9757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.964436:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6308 00000100:00100000:1.0:1746144671.964567:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1962:x1830964746989696:12345-192.168.204.23@tcp:4:cat.0 Request processed in 24628us (25665us total) trans 17179873435 rc 0/0 00000100:00100000:1.0:1746144671.964577:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 983 00002000:00100000:1.0:1746144671.964590:0:21596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3ea:0x0] (1482752->2097151) req@ffff880093ee6680 x1830964746989696/t17179873435(0) o4->a00d6683-c21a-4de9-a7b1-674f4a36e4fa@192.168.204.23@tcp:312/0 lens 488/448 e 0 to 0 dl 1746144682 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746144671.964599:0:21596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ee6680 with x1830964746989696 ext(1482752->2097151) 00010000:00010000:1.0:1746144671.964609:0:21596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 25 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:1.0:1746144671.964627:0:21596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 25 pid: 22208 timeout: 751 lvb_type: 0 00002000:00010000:1.0:1746144671.964634:0:21596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ee6680 00000100:00100000:0.0:1746144671.964723:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746989312:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 33129us (33307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144671.964733:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12627 00000100:00100000:2.0:1746144671.968649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144671.968847:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990464 00000100:00100000:3.0:1746144671.968857:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990464 00010000:00010000:3.0:1746144671.968929:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 24 pid: 22208 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746144671.968968:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6309 00000100:00100000:3.0:1746144671.968976:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1961:x1830964746990464:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144671.968991:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144671.969013:0:16008:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144670 -> 1746144671 00002000:00010000:3.0:1746144671.969016:0:16008:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144670 -> 1746144671 00010000:00010000:3.0:1746144671.969022:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 24 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.969034:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 24 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.969057:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f025600/0xa7c849b16e01c354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0xff14939c915300dd expref: 24 pid: 22208 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144671.969085:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.969087:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144671.969093:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.969102:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144671.969124:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144671.969166:0:10724:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969180:0:10724:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969201:0:10724:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969208:0:10724:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969216:0:10724:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969222:0:10724:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c02ec00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144671.969225:0:10724:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969232:0:10724:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969242:0:10724:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.969247:0:10724:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c02ec00/0xa7c849b16e01c3b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144671.969313:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746989184:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 37846us (38583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144671.969327:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12624 00000100:00100000:3.0:1746144671.969806:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1961:x1830964746990464:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 831us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144671.969813:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6309 00000100:00100000:0.0:1746144671.972965:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144671.973551:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990720 00000100:00100000:2.0:1746144671.973562:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990720 00000100:00100000:2.0:1746144671.973620:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10269 00000100:00100000:2.0:1746144671.973629:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+310:29551:x1830964746990720:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746144671.973852:0:20319:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746144671.973889:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b7ade00/0xa7c849b16e01c2c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530089 expref: 310 pid: 14708 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.973909:0:20319:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c02e600/0xa7c849b16e01c0a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9152fefa expref: 309 pid: 22257 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144671.973921:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144671.973925:0:20319:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144671.973961:0:20319:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.973973:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144671.973982:0:20319:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000040:00080000:2.0:1746144671.975550:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3040, 88 off254480 00000004:00080000:2.0:1746144671.975561:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184425833ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975614:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2946, 88 off246200 00000004:00080000:2.0:1746144671.975618:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184483954ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975640:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2947, 88 off246288 00000004:00080000:2.0:1746144671.975643:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184508577ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975650:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3041, 88 off254568 00000004:00080000:2.0:1746144671.975653:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184518756ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975664:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3042, 88 off254656 00000004:00080000:2.0:1746144671.975667:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184532481ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975673:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2948, 88 off246376 00000004:00080000:2.0:1746144671.975676:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184541641ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975682:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2949, 88 off246464 00000004:00080000:2.0:1746144671.975685:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184550316ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975691:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2950, 88 off246552 00000004:00080000:2.0:1746144671.975695:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184560168ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975721:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3043, 88 off254744 00000004:00080000:2.0:1746144671.975724:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184589913ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975734:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2951, 88 off246640 00000004:00080000:2.0:1746144671.975736:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184601914ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975743:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3044, 88 off254832 00000004:00080000:2.0:1746144671.975745:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184610734ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975751:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2952, 88 off246728 00000004:00080000:2.0:1746144671.975754:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184619348ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144671.975760:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3045, 88 off254920 00000004:00080000:2.0:1746144671.975762:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184627921ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975768:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3046, 88 off255008 00000004:00080000:2.0:1746144671.975771:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184636499ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975777:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3047, 88 off255096 00000004:00080000:2.0:1746144671.975780:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184645184ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975786:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3048, 88 off255184 00000004:00080000:2.0:1746144671.975788:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651184653476ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144671.975794:0:20319:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2953, 88 off246816 00000004:00080000:2.0:1746144671.975797:0:20319:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651184662644ns, next at 593480289301ns, rc = 0 00000001:00080000:1.0:1746144672.006503:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944176 is committed 00000001:00080000:1.0:1746144672.006519:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944175 is committed 00000001:00080000:1.0:1746144672.006528:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944173 is committed 00000001:00100000:1.0:1746144672.006539:0:14781:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 435b7708-7ae3-4eb4-a292-361a088a3e41 00000001:00080000:1.0:1746144672.006544:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944178 is committed 00000001:00100000:1.0:1746144672.006547:0:14781:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16261e74-be72-4bb6-b857-d78345d984f7 00000001:00080000:1.0:1746144672.006551:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944177 is committed 00000001:00080000:1.0:1746144672.006555:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944182 is committed 00000004:00080000:1.0:1746144672.006562:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2137 committed 00000004:00080000:1.0:1746144672.006568:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2228 committed 00000004:00080000:1.0:1746144672.006576:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2227 committed 00000004:00080000:1.0:1746144672.006578:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2226 committed 00000004:00080000:1.0:1746144672.006580:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2225 committed 00000004:00080000:1.0:1746144672.006582:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2136 committed 00000004:00080000:1.0:1746144672.006583:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2224 committed 00000004:00080000:1.0:1746144672.006585:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2135 committed 00000004:00080000:1.0:1746144672.006586:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2223 committed 00000004:00080000:1.0:1746144672.006588:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2134 committed 00000004:00080000:1.0:1746144672.006590:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2133 committed 00000004:00080000:1.0:1746144672.006595:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2132 committed 00000004:00080000:1.0:1746144672.006597:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2222 committed 00000004:00080000:1.0:1746144672.006599:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2221 committed 00000004:00080000:1.0:1746144672.006600:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2131 committed 00000004:00080000:1.0:1746144672.006602:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2130 committed 00000004:00080000:1.0:1746144672.006603:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2220 committed 00000020:00000080:1.0:1746144672.006629:0:14781:0:(genops.c:904:class_export_put()) final put ffff8800a5e0c800/16261e74-be72-4bb6-b857-d78345d984f7 00000020:00000080:1.0:1746144672.006652:0:14781:0:(genops.c:904:class_export_put()) final put ffff88009207d000/435b7708-7ae3-4eb4-a292-361a088a3e41 00000100:00100000:1.0:1746144672.006811:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747619456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.006890:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.006936:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747619968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.006953:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.006970:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746144672.006975:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747619840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.006989:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.007000:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747620352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007013:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.007029:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747619584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007046:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.007055:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747620096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007067:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.007079:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746144672.007083:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747619712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007098:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.007108:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747620224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.007159:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747619456 00000100:00100000:1.0:1746144672.007166:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747619456 00000100:00100000:1.0:1746144672.007206:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747619968 00000100:00100000:1.0:1746144672.007207:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747619968 00000100:00100000:1.0:1746144672.007218:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747619840 00000100:00100000:1.0:1746144672.007220:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747619840 00000100:00100000:1.0:1746144672.007229:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620352 00000100:00100000:1.0:1746144672.007231:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620352 00000100:00100000:1.0:1746144672.007239:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747619584 00000100:00100000:1.0:1746144672.007241:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747619584 00000100:00100000:1.0:1746144672.007250:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620096 00000100:00100000:1.0:1746144672.007251:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620096 00000100:00100000:1.0:1746144672.007258:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747619712 00000100:00100000:1.0:1746144672.007260:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747619712 00000100:00100000:1.0:1746144672.007266:0:7257:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620224 00000100:00100000:1.0:1746144672.007267:0:7257:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620224 00000100:00100000:1.0:1746144672.007276:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12628 00000100:00100000:1.0:1746144672.007283:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747619456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007498:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747619456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (607us total) trans 17179873436 rc 0/0 00000100:00100000:1.0:1746144672.007504:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12628 00000100:00100000:1.0:1746144672.007524:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12629 00000100:00100000:1.0:1746144672.007528:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747619968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007614:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747619968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (660us total) trans 17179873437 rc 0/0 00000100:00100000:1.0:1746144672.007619:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12629 00000100:00100000:1.0:1746144672.007629:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12630 00000100:00100000:1.0:1746144672.007633:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747619840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007706:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747619840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (716us total) trans 17179873438 rc 0/0 00000100:00100000:1.0:1746144672.007712:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12630 00000100:00100000:1.0:1746144672.007720:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12631 00000100:00100000:1.0:1746144672.007725:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3294:x1830964747620352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.007794:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3294:x1830964747620352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (779us total) trans 17179873439 rc 0/0 00000100:00100000:1.0:1746144672.007799:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12631 00000100:00100000:1.0:1746144672.007807:0:7257:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12632 00000100:00100000:1.0:1746144672.007811:0:7257:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830964747619584:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746144672.007936:0:20319:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093ee5880 reply state ffff88009e816c00 transno 8589944182 ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144672.007947:0:20319:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746144672.008022:0:20319:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746144672.008033:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29551:x1830964746990720:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 34404us (35077us total) trans 8589944182 rc 0/0 00000100:00100000:2.0:1746144672.008039:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10269 00000100:00100000:2.0:1746144672.008066:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12633 00000100:00100000:2.0:1746144672.008072:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747620096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.008179:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747620096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (1109us total) trans 17179873441 rc 0/0 00000100:00100000:2.0:1746144672.008184:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12633 00000100:00100000:2.0:1746144672.008194:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12634 00000100:00100000:2.0:1746144672.008198:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747619712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.008273:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747619712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1174us total) trans 17179873442 rc 0/0 00000100:00100000:2.0:1746144672.008278:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12634 00000100:00100000:2.0:1746144672.008287:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12635 00000100:00100000:2.0:1746144672.008292:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830964747620224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.008358:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3295:x1830964747620224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1237us total) trans 17179873443 rc 0/0 00000100:00100000:2.0:1746144672.008363:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12635 00000100:00080000:2.0:1746144672.008381:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1746144672.009275:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a5e0c800/16261e74-be72-4bb6-b857-d78345d984f7 for lustre-MDT0000 00000020:00000080:3.0:1746144672.009332:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff88009207d000/435b7708-7ae3-4eb4-a292-361a088a3e41 for lustre-MDT0000 00000020:00000080:3.0:1746144672.009365:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a5e0e000 for lustre-MDT0000 00000020:00000080:3.0:1746144672.009369:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009207b800 for lustre-MDT0000 00000100:00100000:3.0:1746144672.009383:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747620864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009413:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144672.009434:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747621376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009445:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144672.009455:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746144672.009458:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747620480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009468:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144672.009474:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747620992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009484:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144672.009497:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620864 00000100:00100000:3.0:1746144672.009502:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620864 00000100:00100000:3.0:1746144672.009522:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747621376 00000100:00100000:3.0:1746144672.009524:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747621376 00000100:00100000:3.0:1746144672.009531:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620480 00000100:00100000:3.0:1746144672.009532:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620480 00000100:00100000:3.0:1746144672.009536:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620992 00000100:00100000:3.0:1746144672.009538:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620992 00000100:00100000:3.0:1746144672.009544:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12636 00000100:00100000:3.0:1746144672.009548:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747620864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746144672.009666:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144672.009668:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144672.009671:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144672.009672:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:3.0:1746144672.009674:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746144672.009694:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747620864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (281us total) trans 21474840652 rc 0/0 00000100:00100000:3.0:1746144672.009699:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12636 00000100:00100000:3.0:1746144672.009707:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12637 00000100:00100000:3.0:1746144672.009712:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747621376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009784:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747621376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (337us total) trans 21474840653 rc 0/0 00000100:00100000:3.0:1746144672.009789:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12637 00000100:00100000:3.0:1746144672.009797:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12638 00000100:00100000:3.0:1746144672.009801:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747620480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009897:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747620480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (427us total) trans 21474840654 rc 0/0 00000100:00100000:3.0:1746144672.009902:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12638 00000100:00100000:3.0:1746144672.009909:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12639 00000100:00100000:3.0:1746144672.009914:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3293:x1830964747620992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746144672.009987:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3293:x1830964747620992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (501us total) trans 21474840655 rc 0/0 00000100:00100000:3.0:1746144672.009991:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12639 00000100:00080000:3.0:1746144672.010013:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144672.010033:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840645 gen 2 00000004:00080000:3.0:1746144672.010037:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009398b800, transno 21474840588 00000004:00080000:3.0:1746144672.010042:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd94380, transno 21474840589 00000004:00080000:3.0:1746144672.010044:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009398bb80, transno 21474840590 00000004:00080000:3.0:1746144672.010046:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd96300, transno 21474840591 00000004:00080000:3.0:1746144672.010048:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093989c00, transno 21474840592 00000004:00080000:3.0:1746144672.010050:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009398b100, transno 21474840593 00000004:00080000:3.0:1746144672.010052:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd95f80, transno 21474840594 00000004:00080000:3.0:1746144672.010054:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093989180, transno 21474840595 00000004:00080000:3.0:1746144672.010056:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4e00, transno 21474840599 00000004:00080000:3.0:1746144672.010058:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f5880, transno 21474840600 00000004:00080000:3.0:1746144672.010060:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f7480, transno 21474840601 00000004:00080000:3.0:1746144672.010062:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4000, transno 21474840602 00000004:00080000:3.0:1746144672.010064:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f7100, transno 21474840603 00000004:00080000:3.0:1746144672.010066:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f6a00, transno 21474840604 00000004:00080000:3.0:1746144672.010068:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f4a80, transno 21474840605 00000004:00080000:3.0:1746144672.010070:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f398380, transno 21474840606 00000004:00080000:3.0:1746144672.010072:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ec700, transno 21474840607 00000004:00080000:3.0:1746144672.010074:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ef100, transno 21474840608 00000004:00080000:3.0:1746144672.010076:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eed80, transno 21474840609 00000004:00080000:3.0:1746144672.010079:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ed500, transno 21474840610 00000004:00080000:3.0:1746144672.010080:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ef480, transno 21474840611 00000004:00080000:3.0:1746144672.010082:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eea00, transno 21474840612 00000004:00080000:3.0:1746144672.010084:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51eca80, transno 21474840613 00000004:00080000:3.0:1746144672.010087:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51edf80, transno 21474840614 00000004:00080000:3.0:1746144672.010089:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0000, transno 21474840619 00000004:00080000:3.0:1746144672.010091:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a3100, transno 21474840620 00000004:00080000:3.0:1746144672.010093:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a1180, transno 21474840621 00000004:00080000:3.0:1746144672.010094:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0380, transno 21474840622 00000004:00080000:3.0:1746144672.010096:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a3480, transno 21474840623 00000004:00080000:3.0:1746144672.010097:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a2680, transno 21474840624 00000004:00080000:3.0:1746144672.010099:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a1c00, transno 21474840625 00000004:00080000:3.0:1746144672.010101:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800937a0a80, transno 21474840626 00000004:00080000:3.0:1746144672.010103:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092936d80, transno 21474840627 00000004:00080000:3.0:1746144672.010105:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092937480, transno 21474840628 00000004:00080000:3.0:1746144672.010107:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136958700, transno 21474840629 00000004:00080000:3.0:1746144672.010109:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb0d180, transno 21474840630 00000004:00080000:3.0:1746144672.010111:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092935500, transno 21474840631 00000004:00080000:3.0:1746144672.010114:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a51ec000, transno 21474840632 00000004:00080000:3.0:1746144672.010116:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092937800, transno 21474840633 00000004:00080000:3.0:1746144672.010118:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb0fb80, transno 21474840634 00000004:00080000:3.0:1746144672.010120:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f169f80, transno 21474840638 00000004:00080000:3.0:1746144672.010122:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f169180, transno 21474840639 00000004:00080000:3.0:1746144672.010125:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16b100, transno 21474840640 00000004:00080000:3.0:1746144672.010127:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16ad80, transno 21474840641 00000004:00080000:3.0:1746144672.010129:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f168380, transno 21474840642 00000004:00080000:3.0:1746144672.010131:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16b800, transno 21474840643 00000004:00080000:3.0:1746144672.010151:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093e32300, transno 21474840644 00000004:00080000:3.0:1746144672.010153:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f168700, transno 21474840645 00000100:00100000:3.0:1746144672.010158:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009fb47800 x1830964747620480/t21474840654(21474840654) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144688 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746144672.010166:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47800/2, rc 0, transno 21474840654 00000100:00100000:3.0:1746144672.010170:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747620480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144672.010179:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47100/2, rc 0, transno 21474840655 00000100:00100000:3.0:1746144672.010181:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747620992:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144672.010186:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44700/2, rc 0, transno 21474840652 00000100:00100000:3.0:1746144672.010188:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747620864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144672.010193:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45880/2, rc 0, transno 21474840653 00000100:00100000:3.0:1746144672.010195:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747621376:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746144672.010490:0:14751:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 48 done 00010000:00010000:2.0:1746144672.010582:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144672.010594:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144672.010600:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144672.010606:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013490d400 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144672.010610:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144672.010617:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144672.010633:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144672.010636:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144672.010640:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00010000:00010000:2.0:1746144672.010644:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d400/0xa7c849b16e01c3d2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20319 initiator: MDT0 00000100:00100000:2.0:1746144672.010672:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747620736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.010696:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144672.010711:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747621248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.010724:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144672.010735:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746144672.010739:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747620608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.010752:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144672.010760:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747621120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.010776:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144672.010792:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620736 00000100:00100000:2.0:1746144672.010796:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620736 00000100:00100000:2.0:1746144672.010812:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747621248 00000100:00100000:2.0:1746144672.010814:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747621248 00000100:00100000:2.0:1746144672.010821:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747620608 00000100:00100000:2.0:1746144672.010823:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747620608 00000100:00100000:2.0:1746144672.010828:0:29370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747621120 00000100:00100000:2.0:1746144672.010830:0:29370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747621120 00000100:00100000:2.0:1746144672.010837:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12640 00000100:00100000:2.0:1746144672.010842:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747620736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.010974:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3296:x1830964747620736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (276us total) trans 21474840656 rc 0/0 00000100:00100000:2.0:1746144672.010980:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12640 00000100:00100000:2.0:1746144672.010990:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12641 00000100:00100000:2.0:1746144672.010994:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747621248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.011073:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3296:x1830964747621248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (347us total) trans 21474840657 rc 0/0 00000100:00100000:2.0:1746144672.011078:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12641 00000100:00100000:2.0:1746144672.011086:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12642 00000100:00100000:2.0:1746144672.011090:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747620608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.011193:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3296:x1830964747620608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (440us total) trans 21474840658 rc 0/0 00000100:00100000:2.0:1746144672.011198:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12642 00000100:00100000:2.0:1746144672.011206:0:29370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12643 00000100:00100000:2.0:1746144672.011210:0:29370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830964747621120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746144672.011284:0:29370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3296:x1830964747621120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (506us total) trans 21474840659 rc 0/0 00000100:00100000:2.0:1746144672.011290:0:29370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12643 00000100:00100000:2.0:1746144672.011321:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873427 gen 2 00000004:00080000:2.0:1746144672.011324:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9f9500, transno 17179873365 00000004:00080000:2.0:1746144672.011332:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fad80, transno 17179873366 00000004:00080000:2.0:1746144672.011334:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fb480, transno 17179873367 00000004:00080000:2.0:1746144672.011336:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c944e00, transno 17179873368 00000004:00080000:2.0:1746144672.011338:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fb100, transno 17179873369 00000004:00080000:2.0:1746144672.011340:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9f9880, transno 17179873370 00000004:00080000:2.0:1746144672.011342:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9faa00, transno 17179873371 00000004:00080000:2.0:1746144672.011345:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fb800, transno 17179873372 00000004:00080000:2.0:1746144672.011347:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e9fa680, transno 17179873373 00000004:00080000:2.0:1746144672.011350:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39b800, transno 17179873377 00000004:00080000:2.0:1746144672.011352:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12f480, transno 17179873378 00000004:00080000:2.0:1746144672.011354:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f399500, transno 17179873379 00000004:00080000:2.0:1746144672.011357:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12f800, transno 17179873380 00000004:00080000:2.0:1746144672.011359:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12c380, transno 17179873381 00000004:00080000:2.0:1746144672.011361:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12c000, transno 17179873382 00000004:00080000:2.0:1746144672.011363:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e12ca80, transno 17179873383 00000004:00080000:2.0:1746144672.011366:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b573b80, transno 17179873384 00000004:00080000:2.0:1746144672.011368:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287bb80, transno 17179873385 00000004:00080000:2.0:1746144672.011370:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009287aa00, transno 17179873386 00000004:00080000:2.0:1746144672.011372:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f399f80, transno 17179873387 00000004:00080000:2.0:1746144672.011375:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093763b80, transno 17179873388 00000004:00080000:2.0:1746144672.011377:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093762300, transno 17179873389 00000004:00080000:2.0:1746144672.011380:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092879880, transno 17179873390 00000004:00080000:2.0:1746144672.011382:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093761500, transno 17179873391 00000004:00080000:2.0:1746144672.011384:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f39a300, transno 17179873392 00000004:00080000:2.0:1746144672.011386:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093761880, transno 17179873393 00000004:00080000:2.0:1746144672.011388:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd96d80, transno 17179873394 00000004:00080000:2.0:1746144672.011391:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce87100, transno 17179873398 00000004:00080000:2.0:1746144672.011393:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce84700, transno 17179873399 00000004:00080000:2.0:1746144672.011395:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce86a00, transno 17179873400 00000004:00080000:2.0:1746144672.011397:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce87480, transno 17179873401 00000004:00080000:2.0:1746144672.011399:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b572d80, transno 17179873402 00000004:00080000:2.0:1746144672.011401:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce86d80, transno 17179873403 00000004:00080000:2.0:1746144672.011402:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce85180, transno 17179873404 00000004:00080000:2.0:1746144672.011404:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce87800, transno 17179873405 00000004:00080000:2.0:1746144672.011406:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce85f80, transno 17179873406 00000004:00080000:2.0:1746144672.011408:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b5f5500, transno 17179873407 00000004:00080000:2.0:1746144672.011411:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb5c00, transno 17179873408 00000004:00080000:2.0:1746144672.011413:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b733b80, transno 17179873409 00000004:00080000:2.0:1746144672.011415:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c7100, transno 17179873410 00000004:00080000:2.0:1746144672.011417:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c7480, transno 17179873411 00000004:00080000:2.0:1746144672.011419:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b733800, transno 17179873412 00000004:00080000:2.0:1746144672.011421:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d0c7800, transno 17179873413 00000004:00080000:2.0:1746144672.011423:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbb6300, transno 17179873414 00000004:00080000:2.0:1746144672.011425:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb44380, transno 17179873415 00000004:00080000:2.0:1746144672.011427:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd93800, transno 17179873419 00000004:00080000:2.0:1746144672.011430:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008b9a1880, transno 17179873420 00000004:00080000:2.0:1746144672.011432:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c947800, transno 17179873421 00000004:00080000:2.0:1746144672.011434:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c946680, transno 17179873422 00000004:00080000:2.0:1746144672.011436:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b810380, transno 17179873423 00000004:00080000:2.0:1746144672.011438:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c946d80, transno 17179873424 00000004:00080000:2.0:1746144672.011440:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f437800, transno 17179873425 00000004:00080000:2.0:1746144672.011442:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c947100, transno 17179873426 00000004:00080000:2.0:1746144672.011445:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c944380, transno 17179873427 00000100:00100000:2.0:1746144672.011449:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009fd95180 x1830964747619712/t17179873442(17179873442) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746144688 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746144672.011461:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd95180/2, rc 0, transno 17179873442 00000100:00100000:2.0:1746144672.011465:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747619712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144672.011475:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f272d80/2, rc 0, transno 17179873443 00000100:00100000:2.0:1746144672.011478:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747620224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144672.011486:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f273800/2, rc 0, transno 17179873441 00000100:00100000:2.0:1746144672.011489:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747620096:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144672.011508:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb46a00/2, rc 0, transno 21474840658 00000100:00100000:2.0:1746144672.011511:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747620608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144672.011516:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb45500/2, rc 0, transno 21474840659 00000100:00100000:2.0:1746144672.011519:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747621120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144672.011524:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb44000/2, rc 0, transno 21474840656 00000100:00100000:2.0:1746144672.011526:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747620736:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144672.011532:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb47480/2, rc 0, transno 21474840657 00000100:00100000:2.0:1746144672.011534:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747621248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746144672.011855:0:14755:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 54 done 00000100:00100000:2.0:1746144672.011900:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746144672.011907:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a50e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747621504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.011928:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144672.011947:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747621504 00000100:00100000:2.0:1746144672.011950:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747621504 00000100:00100000:2.0:1746144672.011966:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12644 00000100:00100000:2.0:1746144672.011971:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3293:x1830964747621504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.012081:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3293:x1830964747621504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (151us total) trans 17179873444 rc 0/0 00000100:00100000:2.0:1746144672.012088:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12644 00000100:00100000:1.0:1746144672.012088:0:7257:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013695b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3295:x1830964747619584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4274us (5039us total) trans 17179873440 rc 0/0 00000100:00100000:1.0:1746144672.012097:0:7257:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12632 00000004:00080000:2.0:1746144672.012106:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd95500/2, rc 0, transno 17179873440 00000100:00100000:2.0:1746144672.012109:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747619584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746144672.012122:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a50e2680/2, rc 0, transno 17179873444 00000100:00100000:2.0:1746144672.012125:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a50e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747621504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144672.013177:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd95880/2, rc 0, transno 17179873438 00000100:00100000:1.0:1746144672.013184:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747619840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144672.013193:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f273100/2, rc 0, transno 17179873439 00000100:00100000:1.0:1746144672.013196:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747620352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144672.013207:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd94700/2, rc 0, transno 17179873436 00000100:00100000:1.0:1746144672.013209:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747619456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144672.013215:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093761180/2, rc 0, transno 17179873437 00000100:00100000:1.0:1746144672.013217:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093761180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747619968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.016375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.016419:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990848 00000100:00100000:3.0:1746144672.016429:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990848 00000100:00100000:3.0:1746144672.016693:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10270 00000100:00100000:3.0:1746144672.016706:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:29551:x1830964746990848:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144672.016727:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144672.016747:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530100 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.016801:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 297 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.016814:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 297 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.016830:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144672.016832:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144672.016835:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942f1e00, rc 0) 00000100:00100000:3.0:1746144672.016897:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29551:x1830964746990848:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 196us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.016905:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10270 00000100:00080000:2.0:1746144672.016979:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144672.020548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.020623:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746990976 00000100:00100000:2.0:1746144672.020632:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746990976 00000100:00100000:2.0:1746144672.020676:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10271 00000100:00100000:2.0:1746144672.020683:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29551:x1830964746990976:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144672.020703:0:14710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144672.020723:0:14710:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177400/0xa7c849b16e01c3e0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530107 expref: -99 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.020807:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e01c3e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.020821:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e01c3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.020832:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e01c3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00200000:2.0:1746144672.020860:0:14710:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36c:0x0]: returning size 9133152 00000004:00200000:2.0:1746144672.020864:0:14710:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144672.020892:0:14710:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e01c3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.020923:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f177400/0xa7c849b16e01c3e0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530107 expref: 299 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.020937:0:14710:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e01c3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530107 expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.020945:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144672.021428:0:14710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144672.021433:0:14710:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013490d600, rc 0) 00000100:00100000:2.0:1746144672.021601:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29551:x1830964746990976:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 917us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144672.021607:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10271 00000100:00100000:0.0:1746144672.024976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.025049:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746991104 00000100:00100000:3.0:1746144672.025059:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746991104 00000100:00100000:3.0:1746144672.025165:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12645 00000100:00100000:3.0:1746144672.025174:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1960:x1830964746991104:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144672.025194:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144672.025228:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153010e expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144672.025254:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e8:0x0] initial LVB size: 1048576, mtime: 0x68140d9e, atime: 0x68140d9d, ctime: 0x68140d9e, blocks: 0x809 00010000:00010000:3.0:1746144672.025276:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.025278:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.025289:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 23 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144672.025313:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 23 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144672.025325:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1ba000, rc 0) 00000100:00100000:3.0:1746144672.025379:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1960:x1830964746991104:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 206us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.025389:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12645 00000100:00080000:2.0:1746144672.025487:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746144672.028461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.029342:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746991232 00000100:00100000:0.0:1746144672.029352:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746991232 00000100:00100000:0.0:1746144672.029422:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12646 00000100:00100000:0.0:1746144672.029430:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+13:1961:x1830964746991232:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144672.029452:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144672.029474:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530115 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746144672.029489:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1746144672.029497:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e6:0x0] initial LVB size: 2097152, mtime: 0x68140d9e, atime: 0x68140d9d, ctime: 0x68140d9e, blocks: 0x821 00010000:00010000:0.0:1746144672.029515:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.029517:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.029526:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 14 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144672.029641:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 14 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144672.029658:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4fa00, rc 0) 00000100:00100000:2.0:1746144672.029665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.029700:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746991488 00000100:00100000:3.0:1746144672.029704:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746991488 00000100:00100000:0.0:1746144672.029712:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+14:1961:x1830964746991232:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 281us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144672.029718:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12646 00000100:00100000:3.0:1746144672.029731:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12647 00000100:00100000:3.0:1746144672.029736:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+23:1961:x1830964746991488:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1746144672.029746:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144672.029758:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530123 expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144672.029773:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3ea:0x0] initial LVB size: 2097152, mtime: 0x68140d9f, atime: 0x68140d9f, ctime: 0x68140d9e, blocks: 0x81f 00010000:00010000:3.0:1746144672.029781:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.029782:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.029786:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 24 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144672.029796:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 24 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144672.029802:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f000, rc 0) 00000100:00100000:2.0:1746144672.029891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.029917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.029928:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746991360 00000100:00100000:0.0:1746144672.029931:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746991360 00000100:00100000:2.0:1746144672.029938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.029956:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746991744 00000100:00100000:0.0:1746144672.029958:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746991744 00000100:00100000:0.0:1746144672.029968:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746991616 00000100:00100000:0.0:1746144672.029970:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746991616 00000100:00100000:2.0:1746144672.029974:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12648 00000100:00100000:3.0:1746144672.029980:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746991488:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 243us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144672.029981:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1960:x1830964746991360:12345-192.168.204.23@tcp:101:lfs.0 00000100:00100000:0.0:1746144672.029986:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12649 00010000:00010000:2.0:1746144672.029988:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144672.029994:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12647 00000100:00100000:0.0:1746144672.029996:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+15:1961:x1830964746991744:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144672.029998:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153011c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.030003:0:10724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144672.030005:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12650 00000100:00100000:3.0:1746144672.030010:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+24:1960:x1830964746991616:12345-192.168.204.23@tcp:101:lfs.0 00002000:00010000:2.0:1746144672.030010:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e7:0x0] initial LVB size: 2097152, mtime: 0x68140d9e, atime: 0x68140d9e, ctime: 0x68140d9e, blocks: 0x81f 00010000:00010000:0.0:1746144672.030011:0:10724:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530131 expref: -99 pid: 10724 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.030015:0:30345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144672.030018:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.030020:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.030024:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746144672.030024:0:10724:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e8:0x0] initial LVB size: 4194304, mtime: 0x68140d9e, atime: 0x68140d9d, ctime: 0x68140d9e, blocks: 0x1029 00010000:00010000:3.0:1746144672.030025:0:30345:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153012a expref: -99 pid: 30345 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.030033:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.030034:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144672.030034:0:10724:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746144672.030036:0:30345:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3eb:0x0] initial LVB size: 4938848, mtime: 0x68140d9f, atime: 0x68140d9f, ctime: 0x68140d9f, blocks: 0x15f7 00010000:00010000:0.0:1746144672.030039:0:10724:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.030040:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013490c200, rc 0) 00010000:00010000:3.0:1746144672.030042:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.030043:0:30345:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.030047:0:30345:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 25 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144672.030048:0:10724:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144672.030055:0:30345:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 25 pid: 30345 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144672.030055:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746991360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 75us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144672.030056:0:10724:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f62de00, rc 0) 00000100:00100000:2.0:1746144672.030060:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12648 00010000:00010000:3.0:1746144672.030062:0:30345:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c02fa00, rc 0) 00000100:00100000:0.0:1746144672.030073:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746991744:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 82us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.030075:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746991616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144672.030078:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12649 00000100:00100000:3.0:1746144672.030081:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12650 00000100:00100000:0.0:1746144672.036618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.036683:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144672.036802:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746992000 00000100:00100000:1.0:1746144672.036814:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746992000 00000100:00100000:1.0:1746144672.036889:0:21596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746992256 00000100:00100000:1.0:1746144672.036892:0:21596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746992256 00000100:00100000:1.0:1746144672.036926:0:21596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4916 00000100:00100000:1.0:1746144672.036933:0:21596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746992000:12345-192.168.204.23@tcp:3:lfs.0 00000100:00100000:0.0:1746144672.036965:0:31509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4917 00010000:00010000:1.0:1746144672.036974:0:21596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144672.036978:0:31509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746992256:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144672.036989:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.036991:0:21596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.036996:0:21596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.037010:0:21596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.037016:0:31509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.037027:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.037029:0:31509:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.037033:0:31509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.037044:0:31509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.038364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.038411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.038432:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746992640 00000100:00100000:2.0:1746144672.038437:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746992640 00000100:00100000:3.0:1746144672.038456:0:31508:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746992768 00000100:00100000:3.0:1746144672.038461:0:31508:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746992768 00000100:00100000:2.0:1746144672.038479:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4918 00000100:00100000:2.0:1746144672.038485:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1963:x1830964746992640:12345-192.168.204.23@tcp:3:lfs.0 00000100:00100000:3.0:1746144672.038496:0:31508:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4919 00000100:00100000:3.0:1746144672.038502:0:31508:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1963:x1830964746992768:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:2.0:1746144672.038508:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.038517:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.038518:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.038521:0:31508:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.038522:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.038531:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.038532:0:31508:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.038532:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.038535:0:31508:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.038543:0:31508:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144672.039285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.040186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.040214:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746993024 00000100:00100000:0.0:1746144672.040222:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746993024 00000100:00100000:0.0:1746144672.040269:0:8458:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746993280 00000100:00100000:0.0:1746144672.040271:0:8458:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746993280 00000100:00100000:0.0:1746144672.040292:0:8458:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4920 00000100:00100000:0.0:1746144672.040299:0:8458:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1962:x1830964746993024:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144672.040330:0:8458:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.040347:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.040349:0:8458:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.040354:0:8458:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.040364:0:8458:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144672.040790:0:1570:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4921 00000100:00100000:0.0:1746144672.040797:0:1570:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1962:x1830964746993280:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:0.0:1746144672.040814:0:1570:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.040821:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.040822:0:1570:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144672.040825:0:1570:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.040833:0:1570:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144672.043179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144672.043820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144672.043843:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746993536 00000100:00100000:1.0:1746144672.043850:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746993536 00000100:00100000:1.0:1746144672.043911:0:21597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746993792 00000100:00100000:1.0:1746144672.043914:0:21597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746993792 00000100:00100000:1.0:1746144672.043934:0:21597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4922 00000100:00100000:1.0:1746144672.043940:0:21597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746993536:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:1.0:1746144672.043966:0:21597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.043978:0:21597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.043980:0:21597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.043984:0:21597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.043994:0:21597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.044762:0:21334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4923 00000100:00100000:3.0:1746144672.044774:0:21334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746993792:12345-192.168.204.23@tcp:3:lfs.0 00010000:00010000:3.0:1746144672.044792:0:21334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.044799:0:21334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.044800:0:21334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.044803:0:21334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.044811:0:21334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054449:0:31509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054464:0:31509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054471:0:31509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054478:0:31509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f62cc00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144672.054481:0:31509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054488:0:31509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054505:0:31509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.054511:0:31509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f62cc00/0xa7c849b16e01c41f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.054613:0:31509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+22:1963:x1830964746992256:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 17635us (17925us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144672.054622:0:31509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4917 00010000:00010000:3.0:1746144672.060231:0:31508:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.060247:0:31508:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.060254:0:31508:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.060260:0:31508:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e370200 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144672.060264:0:31508:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.060270:0:31508:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.060286:0:31508:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.060291:0:31508:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e370200/0xa7c849b16e01c42d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31508 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.060369:0:31508:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+20:1963:x1830964746992768:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 21863us (21953us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144672.060378:0:31508:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4919 00010000:00010000:2.0:1746144672.065316:0:1570:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.065331:0:1570:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.065344:0:1570:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.065350:0:1570:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b43c5000 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144672.065353:0:1570:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.065360:0:1570:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.065373:0:1570:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.065378:0:1570:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b43c5000/0xa7c849b16e01c43b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1570 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.065448:0:1570:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1962:x1830964746993280:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 24648us (25260us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144672.065456:0:1570:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4921 00010000:00010000:2.0:1746144672.073096:0:8458:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.073110:0:8458:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.073117:0:8458:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.073128:0:8458:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b43c4800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144672.073131:0:8458:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.073663:0:8458:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.073679:0:8458:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.073684:0:8458:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b43c4800/0xa7c849b16e01c434 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.074741:0:8458:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+31:1962:x1830964746993024:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 34435us (35454us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144672.074751:0:8458:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4920 00010000:00010000:3.0:1746144672.075776:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.075788:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.075796:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.075803:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f322e00 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:3.0:1746144672.075807:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.075815:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.075830:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.075835:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f322e00/0xa7c849b16e01c426 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.075894:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+29:1963:x1830964746992640:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 37407us (37534us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144672.075904:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4918 00010000:00010000:2.0:1746144672.080379:0:21334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.080395:0:21334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.080402:0:21334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.080408:0:21334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e371800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144672.080412:0:21334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.080420:0:21334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.080435:0:21334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.080441:0:21334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e371800/0xa7c849b16e01c449 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.080518:0:21334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1963:x1830964746993792:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 35745us (36694us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144672.080528:0:21334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4923 00010000:00010000:2.0:1746144672.087958:0:21596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.087973:0:21596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.087980:0:21596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.087986:0:21596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f177400 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:2.0:1746144672.087990:0:21596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.087997:0:21596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.088017:0:21596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.088024:0:21596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f177400/0xa7c849b16e01c418 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.091185:0:21596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1963:x1830964746992000:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 54242us (54571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144672.091198:0:21596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4916 00010000:00010000:1.0:1746144672.093181:0:21597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.093195:0:21597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.093204:0:21597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.093210:0:21597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c00d800 already unused, calling callback (ffffffffa0872d70) 00010000:00010000:1.0:1746144672.093214:0:21597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.093220:0:21597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.093241:0:21597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.093246:0:21597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c00d800/0xa7c849b16e01c442 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144672.096109:0:21597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1963:x1830964746993536:12345-192.168.204.23@tcp:3:lfs.0 Request processed in 52162us (52929us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144672.096120:0:21597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4922 00000100:00100000:0.0:1746144672.101236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.101405:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994048 00000100:00100000:2.0:1746144672.101418:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994048 00000100:00100000:2.0:1746144672.101495:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10272 00000100:00100000:2.0:1746144672.101503:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29551:x1830964746994048:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746144672.101543:0:14710:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144672.101566:0:14710:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013490d600/0xa7c849b16e01c3e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530107 expref: 298 pid: 14710 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.101581:0:14710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144672.101586:0:14710:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144672.101637:0:14710:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.101648:0:14710:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.101656:0:14710:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000004:00010000:2.0:1746144672.101810:0:14710:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ee0bb80 reply state ffff880133f83000 transno 8589944183 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14710 initiator: MDT0 00000100:00100000:2.0:1746144672.101816:0:14710:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144672.101911:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:29551:x1830964746994048:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 408us (687us total) trans 8589944183 rc 0/0 00000100:00100000:2.0:1746144672.101917:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10272 00010000:00010000:2.0:1746144672.103570:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.103581:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.103587:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.103592:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f322e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:2.0:1746144672.103595:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.103600:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.103611:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144672.103613:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144672.103615:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00010000:00010000:2.0:1746144672.103619:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c450 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14710 initiator: MDT0 00000100:00100000:0.0:1746144672.104053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144672.105413:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994176 00000100:00100000:1.0:1746144672.105422:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994176 00000100:00100000:1.0:1746144672.105471:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12651 00000100:00100000:1.0:1746144672.105477:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29551:x1830964746994176:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144672.105493:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144672.105508:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c00de00/0xa7c849b16e01c457 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530138 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.105532:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144672.105539:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.105541:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.105544:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c00de00/0xa7c849b16e01c457 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530138 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.105568:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144672.105579:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746144672.105589:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747621632:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144672.106436:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144672.109851:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747621632:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144672.109886:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c00de00/0xa7c849b16e01c457 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530138 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.109902:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c00de00, rc 0) 00000100:00100000:1.0:1746144672.109994:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29551:x1830964746994176:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4516us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144672.110003:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12651 00000100:00100000:0.0:1746144672.110529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.112022:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994304 00000100:00100000:3.0:1746144672.112033:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994304 00010000:00010000:3.0:1746144672.112066:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.112104:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6310 00000100:00100000:3.0:1746144672.112111:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1960:x1830964746994304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.112123:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.112156:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.112166:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.112183:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1ba000/0xa7c849b16e01c3ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153010e expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.112206:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.112208:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.112214:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c00de00/0xa7c849b16e01c457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530138 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.112220:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c00de00/0xa7c849b16e01c457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530138 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.112246:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c00de00/0xa7c849b16e01c457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530138 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.112256:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747621760:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144672.112325:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144672.115333:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747621760:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144672.115358:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.115405:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746994304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3294us (4875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.115413:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6310 00000100:00100000:0.0:1746144672.115837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746144672.116593:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994432 00000100:00100000:1.0:1746144672.116600:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994432 00000100:00100000:1.0:1746144672.116744:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12652 00000100:00100000:1.0:1746144672.116752:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29551:x1830964746994432:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746144672.116771:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144672.116787:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f177400/0xa7c849b16e01c45e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153013f expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.116811:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144672.116821:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.116823:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144672.116826:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f177400/0xa7c849b16e01c45e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153013f expref: 17 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.116850:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144672.116860:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 751 lvb_type: 1 00000100:00100000:1.0:1746144672.116881:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747621888:192.168.204.23@tcp:104: 00000100:00100000:1.0:1746144672.117510:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090401cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144672.123037:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d0c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747621888:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746144672.123064:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f177400/0xa7c849b16e01c45e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153013f expref: 17 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144672.123080:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f177400, rc 0) 00000100:00100000:1.0:1746144672.123131:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29551:x1830964746994432:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6380us (7294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144672.123164:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12652 00000100:00100000:0.0:1746144672.123238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.123418:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994560 00000100:00100000:3.0:1746144672.123424:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994560 00010000:00010000:3.0:1746144672.123452:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.123479:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6311 00000100:00100000:3.0:1746144672.123485:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746994560:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.123495:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.123512:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.123521:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.123539:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b4fa00/0xa7c849b16e01c3f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530115 expref: 17 pid: 10724 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.123556:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.123558:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.123563:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f177400/0xa7c849b16e01c45e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153013f expref: 16 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.123570:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f177400/0xa7c849b16e01c45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153013f expref: 16 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.123594:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f177400/0xa7c849b16e01c45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153013f expref: 16 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.123604:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747622016:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144672.123652:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144672.125293:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747622016:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144672.125314:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.125355:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746994560:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1869us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.125364:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6311 00000100:00100000:1.0:1746144672.128737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.128862:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994688 00000100:00100000:2.0:1746144672.128878:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994688 00000100:00100000:2.0:1746144672.129058:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12653 00000100:00100000:2.0:1746144672.129065:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29551:x1830964746994688:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144672.129080:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144672.129094:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c465 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530146 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.129118:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.129124:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.129126:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.129128:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c465 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530146 expref: 17 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.129165:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.129174:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746144672.129183:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747622144:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144672.130051:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144672.133089:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747622144:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144672.133115:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c465 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530146 expref: 17 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.133160:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f322e00, rc 0) 00000100:00100000:2.0:1746144672.133204:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29551:x1830964746994688:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4138us (4474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144672.133211:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12653 00000100:00100000:0.0:1746144672.134455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.134522:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994816 00000100:00100000:3.0:1746144672.134528:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994816 00010000:00010000:3.0:1746144672.134553:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.134585:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6312 00000100:00100000:3.0:1746144672.134592:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1960:x1830964746994816:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.134606:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.134622:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.134632:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.134650:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013490c200/0xa7c849b16e01c403 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153011c expref: 17 pid: 8450 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.134663:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.134665:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.134670:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530146 expref: 16 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.134677:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530146 expref: 16 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.134699:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f322e00/0xa7c849b16e01c465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530146 expref: 16 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.134708:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747622272:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144672.134763:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144672.138937:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747622272:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144672.138966:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.139004:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1960:x1830964746994816:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4411us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.139014:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6312 00000100:00100000:0.0:1746144672.139249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.139394:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746994944 00000100:00100000:2.0:1746144672.139400:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746994944 00000100:00100000:2.0:1746144672.139428:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12654 00000100:00100000:2.0:1746144672.139434:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29551:x1830964746994944:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144672.139448:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144672.139463:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b4f600/0xa7c849b16e01c46c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153014d expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.139486:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.139493:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.139495:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.139498:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b4f600/0xa7c849b16e01c46c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153014d expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.139521:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.139531:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746144672.139548:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747622400:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144672.139601:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144672.142578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.142750:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995072 00000100:00100000:3.0:1746144672.142757:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995072 00010000:00010000:3.0:1746144672.142788:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 27 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.142813:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6313 00000100:00100000:3.0:1746144672.142820:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1960:x1830964746995072:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.142831:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.142849:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 27 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.142859:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 27 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.142887:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.142889:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.142895:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b4f600/0xa7c849b16e01c46c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153014d expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.142902:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b4f600/0xa7c849b16e01c46c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153014d expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.142926:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094b4f600/0xa7c849b16e01c46c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153014d expref: 27 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.142936:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747622528:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144672.143009:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144672.143472:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0xa7c849b16e01c3fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530123 expref: 27 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746144672.143486:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747622400:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144672.143500:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b4f600/0xa7c849b16e01c46c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153014d expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.143507:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4f600, rc 0) 00000100:00100000:2.0:1746144672.143527:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29551:x1830964746994944:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4094us (4279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144672.143533:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12654 00000100:00100000:3.0:1746144672.145308:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747622528:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144672.145327:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.145353:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1960:x1830964746995072:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2533us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.145360:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6313 00000100:00100000:0.0:1746144672.145800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.146117:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995200 00000100:00100000:2.0:1746144672.146123:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995200 00000100:00100000:2.0:1746144672.146182:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12655 00000100:00100000:2.0:1746144672.146188:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:29551:x1830964746995200:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144672.146201:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144672.146215:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094b4fe00/0xa7c849b16e01c473 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530154 expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.146237:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.146248:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.146249:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.146252:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b4fe00/0xa7c849b16e01c473 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530154 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.146273:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.146283:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746144672.146292:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747622656:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144672.146345:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144672.150390:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:22208:1830964747622656:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144672.150420:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094b4fe00/0xa7c849b16e01c473 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530154 expref: 26 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.150438:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4fe00, rc 0) 00000100:00100000:2.0:1746144672.150477:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:29551:x1830964746995200:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4289us (4677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144672.150485:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12655 00000100:00100000:0.0:1746144672.150660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.150994:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995328 00000100:00100000:3.0:1746144672.151000:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995328 00010000:00010000:3.0:1746144672.151035:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.151052:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6314 00000100:00100000:3.0:1746144672.151057:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746995328:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.151067:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.151082:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.151090:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.151107:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c02fa00/0xa7c849b16e01c411 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c9153012a expref: 26 pid: 30345 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.152052:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.152055:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.152062:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094b4fe00/0xa7c849b16e01c473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530154 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.152074:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094b4fe00/0xa7c849b16e01c473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530154 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.152102:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094b4fe00/0xa7c849b16e01c473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c91530154 expref: 25 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.152112:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747622784:192.168.204.23@tcp:105: 00000100:00100000:3.0:1746144672.152902:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144672.155026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.155178:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16008:1830964747622784:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144672.155201:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.155250:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+25:1961:x1830964746995328:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4192us (4590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.155260:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6314 00000100:00100000:2.0:1746144672.155344:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995456 00000100:00100000:2.0:1746144672.155350:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995456 00000100:00100000:2.0:1746144672.155374:0:22208:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12656 00000100:00100000:2.0:1746144672.155379:0:22208:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:29551:x1830964746995456:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746144672.155392:0:22208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144672.155405:0:22208:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b4ea00/0xa7c849b16e01c47a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c9153015b expref: -99 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.155425:0:22208:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.155431:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.155433:0:22208:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144672.155435:0:22208:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4ea00/0xa7c849b16e01c47a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153015b expref: 17 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.155456:0:22208:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 17 pid: 10724 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144672.155465:0:22208:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 17 pid: 10724 timeout: 751 lvb_type: 1 00000100:00100000:2.0:1746144672.155474:0:22208:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747622912:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144672.155519:0:22208:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144672.160950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.160994:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995584 00000100:00100000:3.0:1746144672.161001:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995584 00010000:00010000:3.0:1746144672.161031:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 18 pid: 10724 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.161053:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6315 00000100:00100000:3.0:1746144672.161059:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a498d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746995584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.161070:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.161087:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 18 pid: 10724 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.161102:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 18 pid: 10724 timeout: 751 lvb_type: 1 00010000:00010000:3.0:1746144672.161124:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.161126:0:16008:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144672.161145:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b4ea00/0xa7c849b16e01c47a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153015b expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.161152:0:16008:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b4ea00/0xa7c849b16e01c47a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153015b expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144672.161177:0:16008:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094b4ea00/0xa7c849b16e01c47a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c9153015b expref: 18 pid: 22208 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144672.161186:0:16008:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747623040:192.168.204.23@tcp:105: 00010000:00010000:2.0:1746144672.161187:0:22208:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f62de00/0xa7c849b16e01c40a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530131 expref: 18 pid: 10724 timeout: 751 lvb_type: 1 00000100:00100000:3.0:1746144672.161241:0:16008:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144672.161479:0:22208:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:22208:1830964747622912:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144672.161499:0:22208:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b4ea00/0xa7c849b16e01c47a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0xff14939c9153015b expref: 17 pid: 22208 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.161513:0:22208:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b4ea00, rc 0) 00000100:00100000:2.0:1746144672.161535:0:22208:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:29551:x1830964746995456:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 6155us (6517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144672.161541:0:22208:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12656 00000100:00100000:3.0:1746144672.168441:0:16008:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16008:1830964747623040:192.168.204.23@tcp:105: 00010000:00010000:3.0:1746144672.168467:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.168507:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a498d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746995584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7446us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.168517:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6315 00000100:00100000:0.0:1746144672.168979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.169013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.169049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.169065:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995712 00000100:00100000:0.0:1746144672.169070:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995712 00000100:00100000:0.0:1746144672.169103:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995840 00000100:00100000:0.0:1746144672.169105:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995840 00000100:00100000:0.0:1746144672.169116:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746996096 00000100:00100000:0.0:1746144672.169118:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746996096 00000100:00100000:0.0:1746144672.169128:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12657 00000100:00100000:0.0:1746144672.169156:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746995712:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:0.0:1746144672.169326:0:3010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144672.169329:0:3010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144670 -> 1746144671 00002000:00010000:0.0:1746144672.169331:0:3010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144671 00002000:00010000:0.0:1746144672.169333:0:3010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144670 -> 1746144672 00002000:00010000:0.0:1746144672.169334:0:3010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746144672.169357:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746995712:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 223us (379us total) trans 17179873445 rc 0/0 00000100:00100000:0.0:1746144672.169363:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12657 00000100:00100000:0.0:1746144672.169374:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12658 00000100:00100000:0.0:1746144672.169378:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+16:1961:x1830964746995840:12345-192.168.204.23@tcp:2:lfs.0 00000100:00100000:1.0:1746144672.169696:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12659 00000100:00100000:1.0:1746144672.169705:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+26:1961:x1830964746996096:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144672.169774:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144672.169776:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.169778:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.169780:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144670 -> 1746144672 00002000:00010000:1.0:1746144672.169781:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746144672.169800:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746996096:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 98us (751us total) trans 17179873446 rc 0/0 00000100:00100000:1.0:1746144672.169805:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12659 00002000:00010000:0.0:1746144672.170253:0:3010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144672.170256:0:3010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144670 -> 1746144671 00002000:00010000:0.0:1746144672.170257:0:3010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144669 -> 1746144671 00002000:00010000:0.0:1746144672.170259:0:3010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144670 -> 1746144672 00002000:00010000:0.0:1746144672.170261:0:3010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746144672.170378:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+17:1961:x1830964746995840:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 998us (1363us total) trans 21474840660 rc 0/0 00000100:00100000:0.0:1746144672.170384:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12658 00000100:00100000:2.0:1746144672.171003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.171114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.171662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.171679:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746996352 00000100:00100000:2.0:1746144672.171685:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746996352 00000100:00100000:2.0:1746144672.172437:0:22208:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746995968 00000100:00100000:2.0:1746144672.172441:0:22208:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746995968 00000100:00100000:1.0:1746144672.172487:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746996224 00000100:00100000:1.0:1746144672.172491:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746996224 00000100:00100000:1.0:1746144672.172511:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12660 00000100:00100000:1.0:1746144672.172517:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746996352:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144672.172654:0:3010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144672.172656:0:3010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144670 -> 1746144671 00002000:00010000:1.0:1746144672.172658:0:3010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144669 -> 1746144671 00002000:00010000:1.0:1746144672.172660:0:3010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144670 -> 1746144672 00002000:00010000:1.0:1746144672.172662:0:3010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144672.172691:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746996352:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 174us (1688us total) trans 21474840661 rc 0/0 00000100:00100000:1.0:1746144672.172697:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12660 00000100:00100000:1.0:1746144672.172709:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12661 00000100:00100000:1.0:1746144672.172714:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+18:1961:x1830964746995968:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144672.172772:0:3010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144672.172775:0:3010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144670 -> 1746144671 00002000:00010000:1.0:1746144672.172777:0:3010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144670 -> 1746144671 00002000:00010000:1.0:1746144672.172779:0:3010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144670 -> 1746144672 00002000:00010000:1.0:1746144672.172781:0:3010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746144672.172796:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+19:1961:x1830964746995968:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 83us (1683us total) trans 21474840662 rc 0/0 00000100:00100000:1.0:1746144672.172801:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12661 00000100:00100000:1.0:1746144672.172811:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12662 00000100:00100000:1.0:1746144672.172816:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+27:1961:x1830964746996224:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746144672.172900:0:3010:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:1.0:1746144672.172903:0:3010:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.172904:0:3010:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.172906:0:3010:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144671 -> 1746144672 00002000:00010000:1.0:1746144672.172908:0:3010:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5623 -> 5623 00000100:00100000:1.0:1746144672.172923:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+28:1961:x1830964746996224:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 107us (1261us total) trans 17179873447 rc 0/0 00000100:00100000:1.0:1746144672.172928:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12662 00000100:00100000:0.0:1746144672.175893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746144672.175982:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746996608 00000100:00100000:2.0:1746144672.175995:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746996608 00000100:00100000:2.0:1746144672.176054:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4191 00000100:00100000:2.0:1746144672.176061:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29551:x1830964746996608:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:2.0:1746144672.176108:0:14712:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36c:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c39a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f9 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.176185:0:14712:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14712 initiator: MDT0 00010000:00010000:2.0:1746144672.176196:0:14712:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.176202:0:14712:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14712 initiator: MDT0 00010000:00010000:2.0:1746144672.176228:0:14712:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144672.176238:0:14712:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 298 pid: 20319 timeout: 751 lvb_type: 0 00000100:00100000:2.0:1746144672.176250:0:14712:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14712:1830964747623168:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746144672.176970:0:14712:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e8e9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144672.181082:0:14712:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14712:1830964747623168:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746144672.181105:0:14712:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00000100:00100000:0.0:1746144672.183122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746144672.183258:0:16008:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746996736 00000100:00100000:3.0:1746144672.183267:0:16008:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746996736 00010000:00010000:3.0:1746144672.183302:0:16008:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 299 pid: 20319 timeout: 751 lvb_type: 0 00000100:00100000:3.0:1746144672.183352:0:16008:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6316 00000100:00100000:3.0:1746144672.183359:0:16008:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+299:1961:x1830964746996736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144672.183372:0:16008:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144672.183377:0:16008:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 299 pid: 20319 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144672.183386:0:16008:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 299 pid: 20319 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144672.183404:0:16008:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942f1e00/0xa7c849b16e01c3d9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xff14939c91530100 expref: 299 pid: 20319 timeout: 751 lvb_type: 0 00010000:00010000:3.0:1746144672.183433:0:16008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:3.0:1746144672.183438:0:16008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00010000:00010000:3.0:1746144672.183446:0:16008:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14712 initiator: MDT0 00010000:00010000:3.0:1746144672.183451:0:16008:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14712 initiator: MDT0 00010000:00010000:3.0:1746144672.183478:0:16008:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144672.183522:0:16008:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:1961:x1830964746996736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 163us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144672.183528:0:16008:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6316 00010000:00010000:2.0:1746144672.184001:0:14712:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00010000:00010000:2.0:1746144672.184007:0:14712:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00000040:00080000:2.0:1746144672.185108:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3049, 88 off255272 00000004:00080000:2.0:1746144672.185115:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651393979969ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185180:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2954, 88 off246904 00000004:00080000:2.0:1746144672.185185:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394050321ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185208:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2955, 88 off246992 00000004:00080000:2.0:1746144672.185211:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394076671ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185219:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3050, 88 off255360 00000004:00080000:2.0:1746144672.185222:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394087263ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185228:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3051, 88 off255448 00000004:00080000:2.0:1746144672.185231:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394096871ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185238:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2956, 88 off247080 00000004:00080000:2.0:1746144672.185241:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394106168ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185247:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2957, 88 off247168 00000004:00080000:2.0:1746144672.185249:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394114567ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185256:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2958, 88 off247256 00000004:00080000:2.0:1746144672.185258:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394123967ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185265:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3052, 88 off255536 00000004:00080000:2.0:1746144672.185267:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394132671ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185274:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2959, 88 off247344 00000004:00080000:2.0:1746144672.185276:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394141954ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185283:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3053, 88 off255624 00000004:00080000:2.0:1746144672.185285:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394150881ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185291:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2960, 88 off247432 00000004:00080000:2.0:1746144672.185294:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394159324ns, next at 593480289301ns, rc = 0 00000040:00080000:2.0:1746144672.185301:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3054, 88 off255712 00000004:00080000:2.0:1746144672.185303:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394168874ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185309:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3055, 88 off255800 00000004:00080000:2.0:1746144672.185312:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394177193ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185318:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3056, 88 off255888 00000004:00080000:2.0:1746144672.185320:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394185939ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185327:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3057, 88 off255976 00000004:00080000:2.0:1746144672.185329:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 651394194933ns, next at 593496143484ns, rc = 0 00000040:00080000:2.0:1746144672.185335:0:14712:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2961, 88 off247520 00000004:00080000:2.0:1746144672.185337:0:14712:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651394202677ns, next at 593480289301ns, rc = 0 00000004:00010000:2.0:1746144672.218557:0:14712:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012bd65450 reply state ffff88009a2e1000 transno 8589944184 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14712 initiator: MDT0 00000100:00100000:2.0:1746144672.218569:0:14712:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746144672.218579:0:14712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:2.0:1746144672.218581:0:14712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746144672.218589:0:14712:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b4f400/0xa7c849b16e01c39a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xff14939c915300f9 expref: 298 pid: 20319 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144672.218678:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+298:29551:x1830964746996608:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 42617us (42795us total) trans 8589944184 rc 0/0 00000100:00100000:2.0:1746144672.218686:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4191 00000001:00080000:1.0:1746144672.218792:0:14781:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944184 is committed 00000004:00080000:1.0:1746144672.218798:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2145 committed 00000004:00080000:1.0:1746144672.218805:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2237 committed 00000004:00080000:1.0:1746144672.218810:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2236 committed 00000004:00080000:1.0:1746144672.218811:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2235 committed 00000004:00080000:1.0:1746144672.218813:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2234 committed 00000004:00080000:1.0:1746144672.218814:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2144 committed 00000004:00080000:1.0:1746144672.218816:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2233 committed 00000004:00080000:1.0:1746144672.218817:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2143 committed 00000004:00080000:1.0:1746144672.218819:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2232 committed 00000004:00080000:1.0:1746144672.218820:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2142 committed 00000004:00080000:1.0:1746144672.218822:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2141 committed 00000004:00080000:1.0:1746144672.218824:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2140 committed 00000004:00080000:1.0:1746144672.218826:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2231 committed 00000004:00080000:1.0:1746144672.218827:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2230 committed 00000004:00080000:1.0:1746144672.218829:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2139 committed 00000004:00080000:1.0:1746144672.218830:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2138 committed 00000004:00080000:1.0:1746144672.218831:0:14781:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2229 committed 00010000:00010000:1.0:1746144672.218852:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14712 initiator: MDT0 00010000:00010000:1.0:1746144672.218859:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14712 initiator: MDT0 00010000:00010000:1.0:1746144672.218864:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14712 initiator: MDT0 00010000:00010000:1.0:1746144672.218879:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f323e00 already unused, calling callback (ffffffffa1376690) 00010000:00010000:1.0:1746144672.218882:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14712 initiator: MDT0 00010000:00010000:1.0:1746144672.218888:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14712 initiator: MDT0 00010000:00010000:1.0:1746144672.218898:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88012ced8400) 00010000:00010000:1.0:1746144672.218900:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144672.218902:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14712 initiator: MDT0 00010000:00010000:1.0:1746144672.218906:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f323e00/0xa7c849b16e01c481 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14712 initiator: MDT0 00000100:00100000:0.0:1746144672.219107:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747623296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.219156:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144672.219183:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747623424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.219197:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144672.219207:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747623552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.219219:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144672.219240:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747623296 00000100:00100000:0.0:1746144672.219245:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747623296 00000100:00100000:0.0:1746144672.219264:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747623424 00000100:00100000:0.0:1746144672.219266:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747623424 00000100:00100000:0.0:1746144672.219273:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747623552 00000100:00100000:0.0:1746144672.219275:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747623552 00000100:00100000:0.0:1746144672.219284:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12663 00000100:00100000:0.0:1746144672.219288:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3295:x1830964747623296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144672.219426:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746144672.219429:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:0.0:1746144672.219432:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:0.0:1746144672.219433:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb ctime from disk: 1746144672 -> 1746144672 00002000:00010000:0.0:1746144672.219435:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e8:0x0] updating lvb blocks from disk: 2057 -> 2057 00000100:00100000:0.0:1746144672.219454:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3295:x1830964747623296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (298us total) trans 17179873448 rc 0/0 00000100:00100000:0.0:1746144672.219459:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12663 00000100:00100000:0.0:1746144672.219468:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12664 00000100:00100000:0.0:1746144672.219472:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3296:x1830964747623424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144672.219527:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746144672.219529:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:0.0:1746144672.219531:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:0.0:1746144672.219533:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb ctime from disk: 1746144672 -> 1746144672 00002000:00010000:0.0:1746144672.219534:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3ea:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746144672.219550:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3296:x1830964747623424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (352us total) trans 17179873449 rc 0/0 00000100:00100000:0.0:1746144672.219554:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12664 00000100:00100000:0.0:1746144672.219561:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12665 00000100:00100000:0.0:1746144672.219565:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3293:x1830964747623552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746144672.219617:0:30345:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb size from disk: 4938848 -> 4938848 00002000:00010000:0.0:1746144672.219619:0:30345:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:0.0:1746144672.219621:0:30345:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:0.0:1746144672.219622:0:30345:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb ctime from disk: 1746144672 -> 1746144672 00002000:00010000:0.0:1746144672.219624:0:30345:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3eb:0x0] updating lvb blocks from disk: 5623 -> 5623 00000100:00100000:0.0:1746144672.219640:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3293:x1830964747623552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (420us total) trans 17179873450 rc 0/0 00000100:00100000:0.0:1746144672.219647:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12665 00000100:00100000:1.0:1746144672.219940:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747623680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.219961:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.219977:0:3010:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747623680 00000100:00100000:1.0:1746144672.219979:0:3010:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747623680 00000100:00100000:1.0:1746144672.219993:0:3010:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12666 00000100:00100000:1.0:1746144672.219996:0:3010:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3294:x1830964747623680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.220074:0:3010:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+18:3294:x1830964747623680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (112us total) trans 17179873451 rc 0/0 00000100:00100000:1.0:1746144672.220079:0:3010:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12666 00000004:00080000:1.0:1746144672.221542:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32c700/2, rc 0, transno 17179873449 00000100:00100000:1.0:1746144672.221550:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747623424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.221555:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747623936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.221578:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.224087:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746144672.224107:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cfb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.224174:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.224215:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747623936 00000100:00100000:1.0:1746144672.224222:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747623936 00000100:00100000:1.0:1746144672.224251:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624320 00000100:00100000:1.0:1746144672.224253:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624320 00000100:00100000:1.0:1746144672.224265:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12667 00000100:00100000:1.0:1746144672.224272:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747623936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.224461:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747623936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (2881us total) trans 17179873452 rc 0/0 00000100:00100000:1.0:1746144672.224467:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12667 00000100:00100000:1.0:1746144672.224480:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12668 00000100:00100000:1.0:1746144672.224484:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3296:x1830964747624320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.224559:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747624320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (386us total) trans 17179873453 rc 0/0 00000100:00100000:1.0:1746144672.224565:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12668 00000004:00080000:1.0:1746144672.224599:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cfb9180/2, rc 0, transno 17179873453 00000100:00100000:1.0:1746144672.224603:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cfb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144672.224610:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32d500/2, rc 0, transno 17179873452 00000100:00100000:1.0:1746144672.224612:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747623936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746144672.224846:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32c380/2, rc 0, transno 17179873451 00000100:00100000:1.0:1746144672.224850:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747623680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.224855:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747624192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.224884:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746144672.226131:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32f800/2, rc 0, transno 17179873448 00000100:00100000:1.0:1746144672.226262:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747624704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.226290:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144672.226308:0:4760:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624192 00000100:00100000:2.0:1746144672.226313:0:4760:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624192 00000100:00100000:2.0:1746144672.226342:0:4760:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12669 00000100:00100000:2.0:1746144672.226348:0:4760:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3294:x1830964747624192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.226493:0:4760:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3294:x1830964747624192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (1607us total) trans 17179873454 rc 0/0 00000100:00100000:2.0:1746144672.226498:0:4760:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12669 00000100:00100000:1.0:1746144672.226613:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747625216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.226632:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746144672.226649:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32ce00/2, rc 0, transno 17179873454 00000100:00100000:1.0:1746144672.226653:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747624192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746144672.226662:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746144672.226667:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747624576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.226685:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.226696:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747625088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.226709:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.226730:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624704 00000100:00100000:1.0:1746144672.226732:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624704 00000100:00100000:1.0:1746144672.226753:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625216 00000100:00100000:1.0:1746144672.226754:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625216 00000100:00100000:1.0:1746144672.226764:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624576 00000100:00100000:1.0:1746144672.226766:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624576 00000100:00100000:1.0:1746144672.226776:0:8389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625088 00000100:00100000:1.0:1746144672.226778:0:8389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625088 00000100:00100000:1.0:1746144672.226789:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12670 00000100:00100000:1.0:1746144672.226793:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1830964747624704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144672.226918:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746144672.226921:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.226922:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.226924:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb ctime from disk: 1746144672 -> 1746144672 00002000:00010000:1.0:1746144672.226925:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e8:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746144672.226947:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1830964747624704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (656us total) trans 21474840663 rc 0/0 00000100:00100000:1.0:1746144672.226951:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12670 00000100:00100000:1.0:1746144672.226960:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12671 00000100:00100000:1.0:1746144672.226965:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1830964747625216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227031:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1830964747625216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (398us total) trans 21474840664 rc 0/0 00000100:00100000:1.0:1746144672.227036:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12671 00000100:00100000:1.0:1746144672.227043:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12672 00000100:00100000:1.0:1746144672.227047:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1830964747624576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144672.227098:0:8389:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144672.227100:0:8389:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.227102:0:8389:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.227103:0:8389:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb ctime from disk: 1746144672 -> 1746144672 00002000:00010000:1.0:1746144672.227105:0:8389:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e7:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746144672.227119:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1830964747624576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (434us total) trans 21474840665 rc 0/0 00000100:00100000:1.0:1746144672.227123:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12672 00000100:00100000:1.0:1746144672.227228:0:8389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12673 00000100:00100000:1.0:1746144672.227232:0:8389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3294:x1830964747625088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227289:0:8389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3294:x1830964747625088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (579us total) trans 21474840666 rc 0/0 00000100:00100000:1.0:1746144672.227293:0:8389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12673 00000100:00100000:1.0:1746144672.227314:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227326:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.227335:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227344:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.227352:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746144672.227356:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227365:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.227372:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747625344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227381:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144672.227391:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624448 00000100:00100000:1.0:1746144672.227393:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624448 00000100:00100000:1.0:1746144672.227403:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624960 00000100:00100000:1.0:1746144672.227404:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624960 00000100:00100000:1.0:1746144672.227410:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624832 00000100:00100000:1.0:1746144672.227411:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624832 00000100:00100000:1.0:1746144672.227417:0:4758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625344 00000100:00100000:1.0:1746144672.227419:0:4758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625344 00000100:00100000:1.0:1746144672.227425:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12674 00000100:00100000:1.0:1746144672.227428:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747624448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144672.227489:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746144672.227491:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb mtime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.227493:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb atime from disk: 1746144671 -> 1746144671 00002000:00010000:1.0:1746144672.227494:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb ctime from disk: 1746144672 -> 1746144672 00002000:00010000:1.0:1746144672.227496:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e6:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746144672.227516:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747624448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (189us total) trans 21474840667 rc 0/0 00000100:00100000:1.0:1746144672.227521:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12674 00000100:00100000:1.0:1746144672.227530:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12675 00000100:00100000:1.0:1746144672.227533:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747624960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227590:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747624960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (244us total) trans 21474840668 rc 0/0 00000100:00100000:1.0:1746144672.227594:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12675 00000100:00100000:1.0:1746144672.227601:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12676 00000100:00100000:1.0:1746144672.227604:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747624832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746144672.227647:0:4758:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144672.227648:0:4758:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb mtime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144672.227650:0:4758:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb atime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144672.227652:0:4758:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb ctime from disk: 1746144609 -> 1746144609 00002000:00010000:1.0:1746144672.227653:0:4758:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144672.227667:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747624832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (301us total) trans 21474840669 rc 0/0 00000100:00100000:1.0:1746144672.227671:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12676 00000100:00100000:1.0:1746144672.227677:0:4758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12677 00000100:00100000:1.0:1746144672.227681:0:4758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830964747625344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746144672.227732:0:4758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747625344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (350us total) trans 21474840670 rc 0/0 00000100:00100000:1.0:1746144672.227737:0:4758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12677 00000004:00080000:1.0:1746144672.227759:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ee5500/2, rc 0, transno 21474840669 00000100:00100000:1.0:1746144672.227762:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227768:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12f800/2, rc 0, transno 21474840670 00000100:00100000:1.0:1746144672.227770:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747625344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227774:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9f8000/2, rc 0, transno 21474840667 00000100:00100000:1.0:1746144672.227776:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227780:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12d500/2, rc 0, transno 21474840668 00000100:00100000:1.0:1746144672.227782:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747624960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227794:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9f8380/2, rc 0, transno 21474840665 00000100:00100000:1.0:1746144672.227796:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747624576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227800:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12dc00/2, rc 0, transno 21474840666 00000100:00100000:1.0:1746144672.227802:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747625088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227807:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e9fbb80/2, rc 0, transno 21474840663 00000100:00100000:1.0:1746144672.227808:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747624704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746144672.227812:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e12f480/2, rc 0, transno 21474840664 00000100:00100000:1.0:1746144672.227814:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747625216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746144672.227867:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747623296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.227881:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747623808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.227901:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144672.228019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.228038:0:20319:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746996864 00000100:00100000:0.0:1746144672.228042:0:20319:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746996864 00000100:00100000:0.0:1746144672.228064:0:20319:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10273 00000100:00100000:0.0:1746144672.228068:0:20319:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+295:29551:x1830964746996864:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746144672.228081:0:20319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144672.228097:0:20319:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdf200/0xa7c849b16e01c488 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xff14939c91530162 expref: -99 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.228151:0:20319:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdf200/0xa7c849b16e01c488 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530162 expref: 296 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.228164:0:20319:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbdf200/0xa7c849b16e01c488 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xff14939c91530162 expref: 296 pid: 20319 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144672.228180:0:20319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36c:0x0].0x0 (ffff88009ee48500) 00010000:00010000:0.0:1746144672.228183:0:20319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746144672.228185:0:20319:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbdf200, rc 0) 00000100:00100000:0.0:1746144672.228215:0:20319:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:29551:x1830964746996864:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 145us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144672.228220:0:20319:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10273 00000004:00080000:0.0:1746144672.228291:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32f100/2, rc 0, transno 17179873450 00000100:00100000:0.0:1746144672.228295:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747623552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.228300:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747624064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.228319:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144672.228347:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747623808 00000100:00100000:0.0:1746144672.228350:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747623808 00000100:00100000:0.0:1746144672.228361:0:30345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747624064 00000100:00100000:0.0:1746144672.228362:0:30345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747624064 00000100:00100000:0.0:1746144672.228371:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12678 00000100:00100000:0.0:1746144672.228374:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3295:x1830964747623808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.228489:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3295:x1830964747623808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (586us total) trans 17179873455 rc 0/0 00000100:00100000:0.0:1746144672.228494:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12678 00000100:00100000:0.0:1746144672.228504:0:30345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12679 00000100:00100000:0.0:1746144672.228508:0:30345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3293:x1830964747624064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746144672.228589:0:30345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3293:x1830964747624064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (269us total) trans 17179873456 rc 0/0 00000100:00100000:0.0:1746144672.228594:0:30345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12679 00000004:00080000:0.0:1746144672.228615:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32e300/2, rc 0, transno 17179873456 00000100:00100000:0.0:1746144672.228618:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830964747624064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746144672.228630:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b32fb80/2, rc 0, transno 17179873455 00000100:00100000:0.0:1746144672.228633:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830964747623808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746144672.237936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746144672.238028:0:14712:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964746997120 00000100:00100000:0.0:1746144672.238036:0:14712:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964746997120 00000100:00100000:0.0:1746144672.238076:0:14712:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4192 00000100:00100000:0.0:1746144672.238084:0:14712:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+296:29551:x1830964746997120:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1746144672.238778:0:14712:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a00d6683-c21a-4de9-a7b1-674f4a36e4fa+297:29551:x1830964746997120:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 691us (848us total) trans 8589944185 rc 0/0 00000100:00100000:0.0:1746144672.238785:0:14712:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4192 00010000:00010000:2.0:1746144672.739237:0:8466:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1746144672.932697:0:3406:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00000100:00100000:2.0:1746144673.367371:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747625472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746144673.367444:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144673.367653:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625472 00000100:00100000:2.0:1746144673.367661:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625472 00000100:00100000:2.0:1746144673.367712:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1746144673.367720:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747625472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746144673.367762:0:8455:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 248446976 pending 0 free 3853516800 avail 3851419648 00000100:00100000:2.0:1746144673.367811:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830964747625472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144673.367817:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1746144673.367861:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747625472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746144673.384384:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830964747625856:0@lo:400:kworker.0 00000100:00100000:2.0:1746144673.384384:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747625984:0@lo:400:kworker.0 00000100:00100000:0.0:1746144673.384480:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3293:1830964747625600:0@lo:400:kworker.0 00000100:00100000:1.0:1746144673.384739:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830964747625728:0@lo:400:kworker.0 00000100:00100000:0.0:1746144673.384833:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144673.384834:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144673.384834:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144673.384884:0:14704:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625600 00000100:00100000:3.0:1746144673.384885:0:10724:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625984 00000100:00100000:3.0:1746144673.384891:0:10724:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625984 00000100:00100000:2.0:1746144673.384891:0:14704:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625600 00000100:00100000:0.0:1746144673.384893:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830964747626112:0@lo:400:kworker.0 00000100:00100000:1.0:1746144673.384911:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144673.384917:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625856 00000100:00100000:0.0:1746144673.384920:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625856 00000100:00100000:3.0:1746144673.384929:0:10724:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1746144673.384929:0:14704:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1746144673.384935:0:10724:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830964747625984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144673.384935:0:14704:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3293:x1830964747625600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144673.384948:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747625728 00000100:00100000:0.0:1746144673.384950:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747625728 00000100:00100000:1.0:1746144673.384963:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144673.384966:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1746144673.384970:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830964747625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144673.384974:0:14704:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4d0d92c-96d4-4527-b7af-c24cb2af9653+18:3293:x1830964747625600:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144673.384977:0:10724:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830964747625984:12345-0@lo:400:kworker.0 Request processed in 42us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144673.384980:0:14704:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1746144673.384983:0:10724:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1746144673.384987:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144673.384996:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ee0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830964747625856:12345-0@lo:400:kworker.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144673.385002:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1746144673.385009:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747626240 00000100:00100000:1.0:1746144673.385011:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747626240 00000100:00080000:2.0:1746144673.385014:0:7112:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144673.385014:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1746144673.385017:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830964747625856:0@lo:400:kworker.0 00000100:00100000:0.0:1746144673.385018:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830964747625728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144673.385031:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1746144673.385036:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747626240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144673.385038:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830964747625728:12345-0@lo:400:kworker.0 Request processed in 20us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144673.385042:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00002000:00000024:1.0:1746144673.385050:0:8455:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 299433984 pending 3407872 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746144673.385053:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144673.385071:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4d0d92c-96d4-4527-b7af-c24cb2af9653:3293:1830964747625600:0@lo:400:kworker.0 00000100:00100000:1.0:1746144673.385073:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3294:x1830964747626240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144673.385078:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1746144673.385089:0:14710:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830964747626112 00000100:00100000:0.0:1746144673.385091:0:14710:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830964747626112 00000100:00100000:1.0:1746144673.385099:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830964747626240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746144673.385108:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830964747625728:0@lo:400:kworker.0 00000100:00100000:0.0:1746144673.385117:0:14710:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1746144673.385121:0:14710:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830964747626112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144673.385174:0:14710:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830964747626112:12345-0@lo:400:kworker.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144673.385179:0:14710:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1746144673.385193:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830964747626112:0@lo:400:kworker.0 00000100:00100000:2.0:1746144673.385697:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830964747625984:0@lo:400:kworker.0 Debug log: 69798 lines, 69798 kept, 0 dropped, 0 bad.